Article

HumanELY: Human evaluation of LLM yield, using a novel web-based evaluation tool

2023-12-27

Abstract excerpt

<h4> A bstract </h4> Large language models (LLMs) have caught the imagination of researchers,developers and public in general the world over with their potential for transformation. Vast amounts of research and development resources are being provided to implement these models in all facets of life. Trained using billions of parameters, various measures of their accuracy and performance have been proposed and u...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 95b81b92-c494-5221-be22-433365f66d74
DOI: 10.1101/2023.12.22.23300458

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

HumanELY: Human evaluation of LLM yield, using a novel web-based evaluation toolDOI 10.1101/2023.12.22.23300458Read

Systematic Literature Review of LLM-Large Language Model in Medical: Digital Health, Technology and ApplicationsSemantic proximity Read

The TRIPOD-LLM Statement: A Targeted Guideline For Reporting Large Language Models UseSemantic proximity Read

A Systematic Review of Testing and Evaluation of Healthcare Applications of Large Language Models (LLMs)Semantic proximity Read

Research through Evaluation for Large Language Model in Patient-Clinician CommunicationsSemantic proximity Read

Assessing the research landscape and clinical utility of large language models: A scoping reviewSemantic proximity Read

Expert-level validation of AI-generated medical text with scalable language modelsSemantic proximity Read

Large Language Models in Healthcare Current Development and Future DirectionsSemantic proximity Read

One and a Half Year of ChatGPT: An Umbrella Review of Large Language Model (LLM) Perception Across Time and Research FieldsSemantic proximity Read

Systematic Review of Large Language Models for Patient Care: Current Applications and ChallengesSemantic proximity Read

Automated Evaluation of Large Language Model Response Concordance with Human Specialist Responses on Physician-to-Physician eConsult CasesSemantic proximity Read

Investigating Expectations and Needs of Medical Professionals Regarding the Use of Large Language Models: A Study at German University ClinicsSemantic proximity Read

The Unreliable Judges: Assessing Reproducibility and Self-Preference Bias of LLMs as Free-Text EvaluatorsSemantic proximity Read