Evaluating my own model

[John6666]

Like this?

How can I evaluate a fine tuned LLM?

Hi there! I am curious about how fine tuned large language models are evaluated? I mean, I fine tuned a model for specific task like a question-answer chatbot for my business but how can I decide to my language model is good, bad or terrible? Is there any ways to evaluate fine tuned model such as token similarity, semantic similarity…

Let's talk about LLM evaluation