What role does human evaluation play in assessing LLM outputs?

Human evaluation is crucial for assessing LLM outputs because it provides qualitative insights that automated metrics may overlook. Evaluators can assess aspects such as relevance, coherence, and nuance, which are difficult to quantify. This form of evaluation helps identify unexpected issues such as biases, inappropriate content, and contextual misunderstandings, enabling better alignment with human expectations. It can be done through surveys, blind tests, or comparative assessments against other outputs.