Article

Sensory context as a universal principle of language in humans and LLMs

2025-05-04

Abstract excerpt

<p>Language is a fundamental human capacity. Large language models (LLMs) have presented the first viable model of language outside of humans, yet how these models learn and use language differs significantly from humans. Here, we compare LLMs and humans processing language with varying levels of sensory information – from disembodied written text to audiovisual videos of speakers – to demonstrate that, in both hu...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 385f0a28-df63-5598-882f-f2b031be60b4
DOI: 10.31234/osf.io/nz5eg_v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Sensory context as a universal principle of language in humans and LLMsDOI 10.31234/osf.io/nz5eg_v1Read

Sensory context improves language prediction in humans and LLMsSemantic proximity Read

Multimodality and Attention Increase Alignment in Natural Language Prediction Between Humans and Computational ModelsSemantic proximity Read

Beyond robotic speech: mutual benefits to cognitive psychology and artificial intelligence from the study of multimodal communicationSemantic proximity Read

A deep hierarchy of predictions enables assignment of semantic roles in online speech comprehensionSemantic proximity Read

Language experience shapes predictive coding of rhythmic sound sequencesSemantic proximity Read

The neural architecture of language: Integrative modeling converges on predictive processingSemantic proximity Read

The channel capacity of multilevel linguistic features constrains speech comprehensionSemantic proximity Read

Comparative perspectives on communication in human and nonhuman primates: Grounding meaning in broadly conserved processes of voice production, perception, affect and cognitionSemantic proximity Read

Language as infrastructure for human intelligence in Large Language ModelsSemantic proximity Read

Large Language Models Reveal the Neural Tracking of Linguistic Context in Attended and Unattended Multi-Talker SpeechSemantic proximity Read

Centaur: a foundation model of human cognitionSemantic proximity Read

Centaur: a foundation model of human cognitionSemantic proximity Read