Article

Task Sampling, Score Reliability, and Apparent Intervention Effects in Writing Research: A Monte Carlo Study of Pretest–Posttest Designs

2026-08-22

Abstract excerpt

<title>Abstract</title> <p>This study investigates measurement reliability in writing research using a Monte Carlo pretest–posttest experiment varying the number of writing tasks and score reliability while holding a latent intervention effect at 0.30 SD. The computational design was created to isolate the principal trade-offs described in the target literature while maintaining full reproducibility. The comparis...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 33c06000-669c-5b78-bc57-f6e9c01a9ddb
DOI: 10.21203/rs.3.rs-10721012/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Task Sampling, Score Reliability, and Apparent Intervention Effects in Writing Research: A Monte Carlo Study of Pretest–Posttest DesignsDOI 10.21203/rs.3.rs-10721012/v1Read

The Dice Roll Method: A StandardizedProtocol for Measuring Stochastic Bias in Large Language Model OutputSemantic proximity Read

Evaluating Large Language Models for Psychometric Simulation Studies in R: Integrating Best Practices in Simulation and Prompt DesignSemantic proximity Read

Can Large Language Models Emulate Human Performance on Educational Assessments?Semantic proximity Read

Beyond Automated Scoring: An Evidence-Informed Human–GenAI Complementarity Framework for Formative Writing AssessmentSemantic proximity Read

An expert guide to planning experimental tasks for evidence accumulation modellingSemantic proximity Read

Sample Size Planning in Item Response Theory: A TutorialSemantic proximity Read

Understanding Ability and Reliability Differences Measured with Count Items: The Distributional Regression Test Model and the Count Latent Regression ModelSemantic proximity Read

Using AI-Simulated Personas to Explore Motivational Interventions: A Methodological InvestigationSemantic proximity Read

Protocol-Dependent Resolution in Finite-Sample Model SelectionSemantic proximity Read

Standardized study performance, quality assurance, and quality control in a cluster-randomized trial: The Pneumococcal Vaccine Schedules TrialSemantic proximity Read

Automating the Generation and Documentation of Experimental Designs with Natural Language ProcessingSemantic proximity Read