Article

Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models: A Case Study on ChatGPT

2023-03-14

Abstract excerpt

Generative large language models (LLMs), e.g., ChatGPT, have demonstrated remarkable proficiency across several NLP tasks such as machine translation, question answering, text summarization, and natural language understanding. Recent research has shown that utilizing ChatGPT for assessing the quality of machine translation (MT) achieves state-of-the-art performance at the system level but performs poorly at the se...

Topics

Open a Topic to create a Post that cites this publication.

COVID-19 diagnosis using AI

Identifiers and source

Literature Corpus work: c87cadaf-26b8-5094-addf-bd0c51a7263a
DOI: 10.20944/preprints202303.0255.v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models: A Case Study on ChatGPTDOI 10.20944/preprints202303.0255.v1Read

Explainable Automatic Evaluation: Interpretable Decision-Making in Large Language Model AutoratersSemantic proximity Read

RLHF-Aligned Open LLMs: A Comparative SurveySemantic proximity Read

Boost Large Language Model Performance through Self-Training with Reward Guided Tree SearchSemantic proximity Read

MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation SystemsSemantic proximity Read

ChatGPT: A Brief Narrative ReviewSemantic proximity Read

ChatGPT vs. Bard: A Comparative StudySemantic proximity Read

A Categorical Archive of ChatGPT FailuresSemantic proximity Read

Evaluating ChatGPT’s Semantic Alignment with Community Answers: A Topic-Aware Analysis Using BERTScore and BERTopicSemantic proximity Read

LLMs4All: A Review of Large Language Models Across Academic DisciplinesSemantic proximity Read

An Extensive Analysis Between Different Language Models: GPT-3, BERT and MACAWSemantic proximity Read

ChatGPT's Expanding Horizons and Transformative Impact Across Domains: A Critical Review of Capabilities, Challenges, and Future DirectionsSemantic proximity Read

Unraveling the Mysteries of AI ChatbotsSemantic proximity Read