Article

Shared functional specialization in transformer-based language models and the human brain

2022-06-09

Abstract excerpt

Humans use complex linguistic structures to transmit ideas to one another. The brain is thought to deploy specialized computations to process these structures. Recently, a new class of artificial neural networks based on the Transformer architecture has revolutionized the field of language modeling, attracting attention from neuroscientists seeking to understand the neurobiology of language in silico . Transforme...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: a2f047dd-76d5-5dc9-88a2-cf58a1a0c540
DOI: 10.1101/2022.06.08.495348

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Shared functional specialization in transformer-based language models and the human brainDOI 10.1101/2022.06.08.495348Read

Language processing in brains and deep neural networks: computational convergence and its limitsSemantic proximity Read

The neural architecture of language: Integrative modeling converges on predictive processingSemantic proximity Read

Driving and suppressing the human language network using large language modelsSemantic proximity Read

Linguistic inputs must be syntactically parsable to fully engage the language networkSemantic proximity Read

Brain-Informed Fine-Tuning for Improved Multilingual Understanding in Language ModelsSemantic proximity Read

Lexical semantic content, not syntactic structure, is the main contributor to ANN-brain similarity of fMRI responses in the language networkSemantic proximity Read

Multiple dimensions underlying the functional organisation of the language networkSemantic proximity Read

Reorganization of the neurobiology of language after sentence overlearningSemantic proximity Read

Hierarchical dynamic coding coordinates speech comprehension in the human brainSemantic proximity Read

Decoding words during sentence production: Syntactic role encoding and structure-dependent dynamics revealed by ECoGSemantic proximity Read

fMRI reveals language-specific predictive coding during naturalistic sentence comprehensionSemantic proximity Read

Neurocognitive Mechanisms Supporting the Generalization of Concepts Across LanguagesSemantic proximity Read