Article

Can GPT-4 Replace Human Examiners? A Competition on Checking Open-Text Answers

2024-07-11

Abstract excerpt

<title>Abstract</title> <p>Under what circumstances can GPT-4 be relied upon as a safe and efficient decision-maker? To address this question we explore the performance of GPT-4 as an examiner of answers to open text questions. We formulate questions and sample solutions in the subject area of macroeconomics and collect answers from cohorts of students. Subsequently, we conduct a fair competition between GPT-4 an...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: fcb14865-eb48-555b-a7fa-3eb5ffe0dd1c
DOI: 10.21203/rs.3.rs-4431780/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Can GPT-4 Replace Human Examiners? A Competition on Checking Open-Text AnswersDOI 10.21203/rs.3.rs-4431780/v1Read

Using ChatGPT-4 to Check Assignments and Provide Feedback; A Mixed Methods StudySemantic proximity Read

Risks of Using Large Language Models in Grading: LLMs and Humans Prefer LLM-Generated Writing Over Human’s but LLMs Show a Stronger Systematic BiasSemantic proximity Read

Utilizing Artificial Intelligence for Crafting Medical Examinations: A Medical Education Study with GPT-4Semantic proximity Read

Looks good on paper: LLM-generated exams are face-valid but psychometrically weaker than human assessmentsSemantic proximity Read

Can ChatGPT Replace the Teacher in Assessment? A Review of Research on the Use of Large Language Models in Grading and Providing FeedbackSemantic proximity Read

Quality assurance and validity of AI-generated Single Best Answer questionsSemantic proximity Read

Psychometric Performance and Student Perceptions of AI- versus Human-Generated Multiple-Choice Questions: The AHEAD Randomized Controlled TrialSemantic proximity Read

Leveraging on Chatgpt, an Artificial Intelligence (AI) Tool to Transform Examination Writing in Higher EducationSemantic proximity Read

ChatGPT versus human in generating medical graduate exam questions – An international prospective studySemantic proximity Read

Optimizing GPT-Based Distractor Generation for the Korean CSAT English ExamSemantic proximity Read

Evaluating ChatGPT-4o’s Performance in Construction of Q-Matrix for a Cognitive Diagnostic AssessmentSemantic proximity Read

GPT-4 versus human authors in clinically complex MCQ creation: a blinded analysis of item qualitySemantic proximity Read