Article

Classifying 25 Misinterpretations of Statistical Tests: A Comparison of Six Large Language Models

2026-01-20

Abstract excerpt

<title>Abstract</title> <p>Background Misinterpretations of statistical tests remain widespread and can be amplified by tools increasingly used to support scientific reasoning, including large language models (LLMs). This study evaluates whether LLMs endorse or reproduce well documented interpretive errors when asked to assess benchmark statements about frequentist inference. Methods We used a fixed benchmark o...

Topics

Open a Topic to create a Post that cites this publication.

Genomics and Rare Diseases

Identifiers and source

Literature Corpus work: 291e3e26-4d3e-53c2-a6fd-d0985302a257
DOI: 10.21203/rs.3.rs-8630701/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Classifying 25 Misinterpretations of Statistical Tests: A Comparison of Six Large Language ModelsDOI 10.21203/rs.3.rs-8630701/v1Read

A statistical framework for evaluating the repeatability and reproducibility of large language modelsSemantic proximity Read

Large Language Models for Accessible Reporting of Bioinformatics Analyses in Interdisciplinary ContextsSemantic proximity Read

MISP-Bench: Decomposing User-Provided False Priors into Answer, Rationale, and Guard EffectsSemantic proximity Read

Model shopping: how answer selection across AI models inflates scientific error ratesSemantic proximity Read

Are ChatGPT and Copilot Reliable for Health Education on Statistical Testing?Semantic proximity Read

LLM Reasoning Does Not Protect Against Clinical Cognitive Biases - An Evaluation Using BiasMedQASemantic proximity Read

From Output Errors to Workflow Harm: A Practitioner-Audit Method for LLM-Mediated ResearchSemantic proximity Read

When Algorithms Meet Ethics: Systematic Evidence of Framing Effects in LLM Organizational Decision-MakingSemantic proximity Read

WITHDRAWN: From Interpolation to Extrapolation: How Language Models Theorize in Data-Sparse RegimesSemantic proximity Read

Benchmarking Large Language Model Rationality Using Measurement AxiomsSemantic proximity Read

Successful Automatic Model Discovery Can Produce False MechanismsSemantic proximity Read

Large Language Models in Psychology: Application in the Context of a Systematic Literature Review.Semantic proximity Read