Article

The Dice Roll Method: A StandardizedProtocol for Measuring Stochastic Bias in Large Language Model Output

2026-06-26

Abstract excerpt

<title>Abstract</title> <p>Researchers increasingly use repeated identical prompts to measure stochastic bias in large languagemodel (LLM) outputs, yet no standardized protocol exists for determining adequate iteration counts,selecting appropriate stability metrics, or establishing reliability thresholds under the conditional,non-Gaussian structure of autoregressive text generation. This paper formalizes the Dice...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 046b4a2b-fe49-51ef-9be4-793bceacf411
DOI: 10.21203/rs.3.rs-9496731/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

The Dice Roll Method: A StandardizedProtocol for Measuring Stochastic Bias in Large Language Model OutputDOI 10.21203/rs.3.rs-9496731/v1Read

Emergent Numeric Bias in Large Language Models: An Empirical Study on the Anomalous Recurrence of the Number 27 Across Independent SessionsSemantic proximity Read

Automated reproducibility assessments in the social and behavioral sciences using large language modelsSemantic proximity Read

Evaluating Large Language Models in Psychological Research: A Guide for ReviewersSemantic proximity Read

Synthetic Participants Generated by Large Language Models: A Systematic Literature ReviewSemantic proximity Read

A lightweight computational method for monitoring lexical response convergence in LLM-based synthetic populationsSemantic proximity Read

A Primer for Evaluating Large Language Models in Social Science ResearchSemantic proximity Read

A Primer for Evaluating Large Language Models in Social Science ResearchSemantic proximity Read

A lightweight computational method for monitoring response convergence in LLM-based synthetic populationsSemantic proximity Read

Harm-Conditioned Computational Friction as a Contrastive Diagnostic of Safety Representations in Language Models: A Proof-of-Concept and Control AuditSemantic proximity Read

Protocol-Dependent Resolution in Finite-Sample Model SelectionSemantic proximity Read

Quantifying and Mitigating Gender Bias in Legal Large Language Models:A Counterfactual Fairness FrameworkSemantic proximity Read

Task Sampling, Score Reliability, and Apparent Intervention Effects in Writing Research: A Monte Carlo Study of Pretest–Posttest DesignsSemantic proximity Read