Article

Predicting Item-Level Characteristics of Knowledge Tests Using Large-Language Models

2026-04-21

Abstract excerpt

<p>Efficient test construction depends on accurate estimates of item difficulty and discrimination, yet obtaining such estimates through piloting with human participants is costly and time-consuming. Whereas item parameters of decontextualized reasoning tasks can often be approximated from formal construction rules, comparable predictor sets for contextualized knowledge items remain scarce. We investigated whether...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: a94d1a9e-c8f5-523e-abb0-122ea36ab732
DOI: 10.31234/osf.io/mv8sk_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Predicting Item-Level Characteristics of Knowledge Tests Using Large-Language ModelsDOI 10.31234/osf.io/mv8sk_v1Read

Optimizing GPT-Based Distractor Generation for the Korean CSAT English ExamSemantic proximity Read

Field-testing multiple-choice questions with AI examinees: English grammar itemsSemantic proximity Read

Generating Better Items for Cognitive Assessments Using Large Language ModelsSemantic proximity Read

Looks good on paper: LLM-generated exams are face-valid but psychometrically weaker than human assessmentsSemantic proximity Read

Do Large Language Models Truly Grasp Mathematics? An Empirical ExplorationSemantic proximity Read

Transformer-Based Deep Neural Language Modeling for Construct-Specific Automatic Item GenerationSemantic proximity Read

Proprietary and Open-Source Large Language Models on the Korean Pharmacist Licensing Examination: A Comparative Benchmarking StudySemantic proximity Read

Beyond Human Boundaries: Exploring the Proficiency of AI Technology and its Potential in Psychometric Test ConstructionSemantic proximity Read

Across Generations, Sizes, and Types, Large Language Models Poorly Report Self-Confidence in Gastroenterology Clinical Reasoning TasksSemantic proximity Read

Language-dependent variability in large language model performance on pharmaceutical knowledge tasksSemantic proximity Read

Are LLMs better expert judges? Rethinking content validity assessment in the age of AISemantic proximity Read

Are LLMs better expert judges? Rethinking content validity assessment in the age of AISemantic proximity Read