Article

Memory Consolidation with Orthogonal Gradients for avoiding Catastrophic Forgetting

2023-11-29

Abstract excerpt

<title>Abstract</title> <p>The memory consolidation process enables the accumulation of recent and remote memories in the long-term memory store. In general, the deep network models of memory suffer from forgetting old information while learning new information, called catastrophic forgetting/interference, while the human brain overcomes this problem quite effectively. We propose a regularization-based model to s...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 5cfa54d1-dd4d-511a-a3de-bb786caabd2a
DOI: 10.21203/rs.3.rs-2471036/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

Memory Consolidation with Orthogonal Gradients for avoiding Catastrophic ForgettingDOI 10.21203/rs.3.rs-2471036/v1Read

Memory Consolidation with Orthogonal Gradients for avoiding Catastrophic ForgettingSemantic proximity Read

Overcoming Catastrophic Interference: Neuroscience-inspired Models for Continuous Learning in Neural NetworksSemantic proximity Read

AMG: a memory generation model based on Hebbian plasticity and inferential associationSemantic proximity Read

A neural network account of memory replay and knowledge consolidationSemantic proximity Read

Learning sculpts orthogonal task manifolds for continual skill learning in recurrent networksSemantic proximity Read

A bio-inspired hybrid lifelong learning based on self-selective memristorsSemantic proximity Read

Backpropagation-Free Continual Learning: A Unified Energy-Based Framework, Reproducible Benchmark, and Open ChallengesSemantic proximity Read

Computational Decomposition of New Memory Failure in Alzheimers Disease Through a Hippocampal Cortical Consolidation Bottleneck ModelSemantic proximity Read

Flexible working memory through selective gating and attentional taggingSemantic proximity Read

Neuro-inspired cascaded memory coordination enables continual generalizationSemantic proximity Read

One-shot memory in hippocampal CA3 networks.Semantic proximity Read

Scaffolded representation learning in deep networksSemantic proximity Read