Article

DAFE: LLM-Based Evaluation Through Dynamic Arbitration for Free-Form Question-Answering

2025-03-21

Abstract excerpt

Evaluating Large Language Models (LLMs) free-form generated responses remains a challenge due to their diverse and open-ended nature. Traditional supervised signal-based automatic metrics fail to capture semantic equivalence or handle the variability of open-ended responses, while human evaluation, though reliable, is resource-intensive. Leveraging LLMs as evaluators offers a promising alternative due to their str...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: e854a8d7-a165-5e83-b9d7-acccdd406833
DOI: 10.32388/b69sky

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

DAFE: LLM-Based Evaluation Through Dynamic Arbitration for Free-Form Question-AnsweringDOI 10.32388/b69skyRead

Fine-Tuning PHI-3 for Multiple-Choice Question Answering: Methodology, Results, and ChallengesSemantic proximity Read

MedScope: A Lightweight Benchmark of Open-Source Large Language Models for Medical Question AnsweringSemantic proximity Read

Explainable Automatic Evaluation: Interpretable Decision-Making in Large Language Model AutoratersSemantic proximity Read

The Unreliable Judges: Assessing Reproducibility and Self-Preference Bias of LLMs as Free-Text EvaluatorsSemantic proximity Read

Evaluating Open-Source LLMs for Automated Essay Scoring: The Critical Role of Prompt DesignSemantic proximity Read

Chat-WanJuan: A Fine-Tuned Compact Language Model for Multiple- Choice Question Generation in Medical EducationSemantic proximity Read

QUEST-AI: A System for Question Generation, Verification, and Refinement using AI for USMLE-Style ExamsSemantic proximity Read

Dynamic Multi-Hop Retrieval-Augmented Generation Framework for Professional Domain Question AnsweringSemantic proximity Read

SuperGLUE: The AI raceSemantic proximity Read

Are LLMs better expert judges? Rethinking content validity assessment in the age of AISemantic proximity Read

Are LLMs better expert judges? Rethinking content validity assessment in the age of AISemantic proximity Read

Standardized Assessment of LLM English ProficiencySemantic proximity Read