Article

Adaptive Rigor in AI System Evaluation using Temperature-Controlled Verdict Aggregation via Generalized Power Mean

2026-03-20

Abstract excerpt

<title>Abstract</title> <p>Today, AI systems based on large language models (LLM) are widely used in various fields, such as medicine, finance, retail, education and others. However, existing evaluation methods, such as LLM as a Judge, verdict system, NLI, despite their reliability, do not always show results that correlate with human assessment, which requires AI specialists to regularly deeply validate the resu...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 0c6679f0-dcd9-5aaf-98da-09bb32af145c
DOI: 10.21203/rs.3.rs-8658973/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Adaptive Rigor in AI System Evaluation using Temperature-Controlled Verdict Aggregation via Generalized Power MeanDOI 10.21203/rs.3.rs-8658973/v1Read

Adaptive Rigor in AI System Evaluation using Temperature-Controlled Verdict Aggregation via Generalized Power MeanSemantic proximity Read

Improved Value Alignment in Large Language Models Using Variational Best-of-N TechniquesSemantic proximity Read

Measurement of retrieved chunk quality from real-world knowledge in retrieval-augmented generation: A Phase 1 foundational studySemantic proximity Read

Are LLMs better expert judges? Rethinking content validity assessment in the age of AISemantic proximity Read

Are LLMs better expert judges? Rethinking content validity assessment in the age of AISemantic proximity Read

AI Language Model Rivals Expert Ethicist in Perceived Moral ExpertiseSemantic proximity Read

AI Language Model Rivals Expert Ethicist in Perceived Moral ExpertiseSemantic proximity Read

Comprehensive Review of AI Hallucinations: Impacts and Mitigation Strategies for Financial and Business ApplicationsSemantic proximity Read

Uncertainty-Aware Assessment of LLM-Enhanced Topic Models: An Experton-Based Approach to InterpretabilitySemantic proximity Read

ChatGPT's Expanding Horizons and Transformative Impact Across Domains: A Critical Review of Capabilities, Challenges, and Future DirectionsSemantic proximity Read

Trustworthy Agentic AI: A Rapid, PRISMA-Informed Evidence Review of Safety, Explainability, Alignment, and Human Oversight in Autonomous AI SystemsSemantic proximity Read

Benchmarking of Commercial Large Language Models: ChatGPT, Mistral, and LlamaSemantic proximity Read