Article

Modeling word and morpheme order in natural language as an efficient tradeoff of memory and surprisal

2020-06-26

Abstract excerpt

<p>Memory limitations are known to constrain language comprehension and production, and have been argued to account for crosslinguistic word order regularities. However, a systematic assessment of the role of memory limitations in language structure has proven elusive, in part because it is hard to extract precise large-scale quantitative generalizations about language from existing mechanistic models of memory us...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 270194c0-b55a-5e0f-bffe-3ecab4e3a38f
DOI: 10.31234/osf.io/nu4qz

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Modeling word and morpheme order in natural language as an efficient tradeoff of memory and surprisalDOI 10.31234/osf.io/nu4qzRead

Modeling memory effects in a head-final language with category localitySemantic proximity Read

Evaluating information-theoretic measures of word prediction in naturalistic sentence readingSemantic proximity Read

What's surprising about surprisalSemantic proximity Read

Predictability and variation in language are differentially affected by learning and productionSemantic proximity Read

Temporal Dissociation of Syntactic Disambiguation and Memory Retrieval during Sentence Processing: Naturalistic MEG Evidence from Interpretable ModelsSemantic proximity Read

The roles of neural networks in language acquisitionSemantic proximity Read

Comprehension effort as the cost of inferenceSemantic proximity Read

Neural Language Models Capture Some, But Not All, Agreement Attraction EffectsSemantic proximity Read

Overlap in Meaning Is a Stronger Predictor of Semantic Activation in GPT-3 Than in HumansSemantic proximity Read

Language processing in brains and deep neural networks: computational convergence and its limitsSemantic proximity Read

A Novel Approach to Emergent Contextual Dynamics in Large Language Models Through Stochastic Interlayer ModulationSemantic proximity Read

The Road Not Taken: Unsaid Word Alternatives are Represented in the BrainSemantic proximity Read