Javascript must be enabled to continue!
The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning
View through CrossRef
Abstract
We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatiotemporal contexts. We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer). This theory entails a novel characterization of hippocampal reactivations as
generative replay
: the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences. We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps. Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks. This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.
Title: The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning
Description:
Abstract
We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatiotemporal contexts.
We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer).
This theory entails a novel characterization of hippocampal reactivations as
generative replay
: the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences.
We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps.
Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks.
This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.
Related Results
Evaluating hippocampal replay without a ground truth
Evaluating hippocampal replay without a ground truth
AbstractDuring rest and sleep, memory traces replay in the brain. The dialogue between brain regions during replay is thought to stabilize labile memory traces for long-term storag...
Exploring the roles of memory replay in targeted memory reactivation and birdsong development: Insights from computational models of complementary learning systems
Exploring the roles of memory replay in targeted memory reactivation and birdsong development: Insights from computational models of complementary learning systems
AbstractReplay facilitates memory consolidation in both biological and artificial systems. Using the complementary learning systems (CLS) framework, we study replay in both humans ...
Continual Learning of Large Language Models: A Comprehensive Survey
Continual Learning of Large Language Models: A Comprehensive Survey
The challenge of effectively and efficiently adapting statically pre-trained Large Language ModelsĀ (LLMs) to ever-evolving data distributions remains predominant. When tailored for...
Memory Function Related to Hippocampal Imaging Findings
Memory Function Related to Hippocampal Imaging Findings
Bilateral Hippocampal Atrophy: Consequences to Verbal Memory Following Temporal Lobectomy Martin RC, Sawrie SM, Knowlton RC, Bilir E, Gilliam FG, Faught E, Morawetz RB, Kuzniecky ...
Hippocampal Volumetry among Sudanese Patients attending Elmoalem Hospital, Sudan; structural MRI study (2021-2022)
Hippocampal Volumetry among Sudanese Patients attending Elmoalem Hospital, Sudan; structural MRI study (2021-2022)
Background: Hippocampal volume has sharp rise till age of 2 years; then it rises slowly. Objective: To build a reference for hippocampus volume among Sudanese population. Method: I...
Exploring Replay
Exploring Replay
Exploration is vital for animals and artificial agents who face uncertainty about their environments due to initial ignorance or subsequent changes. Their choices need to balance e...
Generative replay for compositional visual understanding in the prefrontal-hippocampal circuit
Generative replay for compositional visual understanding in the prefrontal-hippocampal circuit
AbstractUnderstanding the visual world is a constructive process. Whilst a frontal-hippocampal circuit is known to be essential for this task, little is known about the associated ...
The Role of Experience in Prioritizing Hippocampal Replay
The Role of Experience in Prioritizing Hippocampal Replay
Abstract
During sleep, recent memories are consolidated, whereby behavioral episodes first encoded by the hippocampus get transformed into long-term memories. However, the ...

