Article

Evaluating Large Language Models for Belief Inference: Mapping Belief Networks at Scale

2025-10-24

Abstract excerpt

<p>Beliefs are interconnected, influencing how people process and update what they think. To study the interconnectedness of beliefs at scale, we introduce a novel analytical pipeline leveraging a finetuned GPT-4o model to infer belief structures from large-scale social media data. We evaluate the model's performance by (1) comparing it to human annotated data (2) and its inferences to human-generated survey data....

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 6c3930ba-7cdb-531c-be41-6dfcb4e2914c
DOI: 10.31234/osf.io/dht9j_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating Large Language Models for Belief Inference: Mapping Belief Networks at ScaleDOI 10.31234/osf.io/dht9j_v1Read

Mapping how LLMs debate societal issues when shadowing human personality traits, sociodemographics and social media behaviorSemantic proximity Read

Reasoning in Large Language Models: From Chain-of-Thought to Massively Decomposed Agentic ProcessesSemantic proximity Read

Anchoring Bias in Large Language Models: An Experimental StudySemantic proximity Read

From Message Passing to Prompting: Rethinking Graph Learning with Large Language ModelsSemantic proximity Read

Collective problem decomposition improves the wisdom of deliberative crowdsSemantic proximity Read

Contextual Assembly of Lexical Functions in Large Language ModelsSemantic proximity Read

Inferring the Public Mind: Accuracy and Biases in Out-of-Sample Public Opinion Estimation with Large Language ModelsSemantic proximity Read

Reasoning from social information enables efficient human intelligenceSemantic proximity Read