Article

Computation or Weight Adaptation? Rethinking the Role of Plasticity in Learning

2024-03-07

Abstract excerpt

The human brain is an adaptive learning system that can generalize to new tasks and unfamiliar environments. The traditional view is that such adaptive behavior requires a structural change of the learning system (e.g., via neural plasticity). In this work, we use artificial neural networks, specifically large language models (LLMs), to challenge this traditional view and suggest that such adaptive behavior can be...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 1392114a-d64f-5938-a402-b4665a16cc31
DOI: 10.1101/2024.03.07.583890

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Computation or Weight Adaptation? Rethinking the Role of Plasticity in LearningDOI 10.1101/2024.03.07.583890Read

Language processing in brains and deep neural networks: computational convergence and its limitsSemantic proximity Read

The neural architecture of language: Integrative modeling converges on predictive processingSemantic proximity Read

Semantic plasticity across timescales in the human brainSemantic proximity Read

Shared functional specialization in transformer-based language models and the human brainSemantic proximity Read

Generalization in Sensorimotor Networks Configured with Natural Language InstructionsSemantic proximity Read

The roles of neural networks in language acquisitionSemantic proximity Read

Brain-like dynamics in speech representations can emerge through self-supervised learningSemantic proximity Read

Predictability and variation in language are differentially affected by learning and productionSemantic proximity Read

Thinking ahead: spontaneous prediction in context as a keystone of language in humans and machinesSemantic proximity Read

Driving and suppressing the human language network using large language modelsSemantic proximity Read

Artificial Language LearningSemantic proximity Read

Cortical knowledge structures guide word concept learningSemantic proximity Read