Article

Machine Psychometrics for Artificial Agents

2026-08-10

Abstract excerpt

<p>Artificial intelligence systems are increasingly evaluated as behavioral agents, yet many evaluation practices still treat model outputs as isolated responses to be scored for accuracy, safety, bias, or preference alignment. We argue that this response-level paradigm is insufficient for systems whose behavior is generated from probability distributions and changes across contexts, versions, and interventions. H...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 713634c8-e375-5094-b5c8-4c141d0879ba
DOI: 10.31234/osf.io/up3ye_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Machine Psychometrics for Artificial AgentsDOI 10.31234/osf.io/up3ye_v1Read

Cognitive modeling using artificial intelligenceSemantic proximity Read

Deterministic AI Agent Personality Expression through Standard Psychological DiagnosticsSemantic proximity Read

Designing AI-Agents with Personalities: A Psychometric ApproachSemantic proximity Read

Synthetic respondents and the illusion of human dataSemantic proximity Read

AI Surrogacy in Psychological ResearchSemantic proximity Read

Trustworthy Agentic AI: A Rapid, PRISMA-Informed Evidence Review of Safety, Explainability, Alignment, and Human Oversight in Autonomous AI SystemsSemantic proximity Read

AI in the Government: Responses to FailuresSemantic proximity Read

Benchmarking Large Language Model Rationality Using Measurement AxiomsSemantic proximity Read

Automated AI Model Development: a Systematic Literature ReviewSemantic proximity Read

The advice gap: adaptive yet suboptimal advice integrationSemantic proximity Read

Artificial intelligence in psychology researchSemantic proximity Read

Artificial Cognition: How Experimental Psychology Can Help Generate Explainable Artificial IntelligenceSemantic proximity Read