Article

Dopamine encoding of novelty facilitates efficient uncertainty-driven exploration

2023-09-18

Abstract excerpt

When facing an unfamiliar environment, animals need to explore to gain new knowledge about which actions provide reward, but also put the newly acquired knowledge to use as quickly as possible. Optimal reinforcement learning strategies should therefore assess the uncertainties of these action– reward associations and utilise them to inform decision making. We propose a novel model whereby direct and indirect stria...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 468f74a9-6205-563e-94bf-5ef1a937ee48
DOI: 10.1101/2023.09.17.558180

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Dopamine encoding of novelty facilitates efficient uncertainty-driven explorationDOI 10.1101/2023.09.17.558180Read

Reinforcement learning under uncertainty: expected versus unexpected uncertainty and state versus reward uncertaintySemantic proximity Read

Striatal Gradient in Value-Decay Explains Regional Differences in Dopamine Patterns and Reinforcement Learning ComputationsSemantic proximity Read

On the computational principles underlying human explorationSemantic proximity Read

Posterior parietal cortex mediates rarity-induced decision bias and learning under uncertaintySemantic proximity Read

The Role of Executive Function in Shaping Reinforcement LearningSemantic proximity Read

Dopamine depletion in Parkinson’s increases directed but not random explorationSemantic proximity Read

ACTIVITY IN HUMAN DORSAL RAPHE NUCLEUS SIGNALS CHANGES IN BEHAVIOURAL POLICYSemantic proximity Read

Firing patterns of serotonin neurons underlying cognitive flexibilitySemantic proximity Read

Pupil size predicts the onset of exploration and changes in prefrontal dynamicsSemantic proximity Read

Dopaminergic genes are associated with both directed and random explorationSemantic proximity Read

Rapid value learning reveals generalized and context-dependent codes in frontal cortexSemantic proximity Read

Information-based planning for optimal intermittent controlSemantic proximity Read