Article

Evaluating information-theoretic measures of word prediction in naturalistic sentence reading

2019-08-01

Abstract excerpt

<p>We review information-theoretic measures of cognitive load during sentence processing that have been used to quantify word prediction effort. Two such measures, surprisal and next-word entropy, suffer from shortcomings when employed for a predictive processing view. We propose a novel metric, lookahead information gain, that can overcome these short-comings. We estimate the different measures using probabilisti...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 881483c9-3a33-58d9-bf25-6a8e21f169ef
DOI: 10.31234/osf.io/j83xy

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Evaluating information-theoretic measures of word prediction in naturalistic sentence readingDOI 10.31234/osf.io/j83xyRead

Comprehension effort as the cost of inferenceSemantic proximity Read

Optimizing Predictive Metrics for Human Reading BehaviorSemantic proximity Read

What's surprising about surprisalSemantic proximity Read

A note on co-occurrence, transitional probability, and causal inferenceSemantic proximity Read

Bayesian Surprise Predicts Human Event Segmentation in Story ListeningSemantic proximity Read

Thinking ahead: spontaneous prediction in context as a keystone of language in humans and machinesSemantic proximity Read

Multimodality and Attention Increase Alignment in Natural Language Prediction Between Humans and Computational ModelsSemantic proximity Read

Temporal Dissociation of Syntactic Disambiguation and Memory Retrieval during Sentence Processing: Naturalistic MEG Evidence from Interpretable ModelsSemantic proximity Read

The neural architecture of language: Integrative modeling converges on predictive processingSemantic proximity Read

Modeling word and morpheme order in natural language as an efficient tradeoff of memory and surprisalSemantic proximity Read

Decoding semantic predictions from EEG prior to word onsetSemantic proximity Read

Hierarchical Resource Rationality Explains Human Reading BehaviorSemantic proximity Read