Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning

View through CrossRef
Abstract We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatiotemporal contexts. We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer). This theory entails a novel characterization of hippocampal reactivations as generative replay : the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences. We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps. Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks. This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.
Title: The hippocampal formation as a hierarchical generative model supporting generative replay and continual learning
Description:
Abstract We advance a novel computational theory of the hippocampal formation as a hierarchical generative model that organizes sequential experiences, such as rodent trajectories during spatial navigation, into coherent spatiotemporal contexts.
We propose that the hippocampal generative model is endowed with inductive biases to identify individual items of experience (first hierarchical layer), organize them into sequences (second layer) and cluster them into maps (third layer).
This theory entails a novel characterization of hippocampal reactivations as generative replay : the offline resampling of fictive sequences from the generative model, which supports the continual learning of multiple sequential experiences.
We show that the model learns and efficiently retains multiple spatial navigation trajectories, by organizing them into spatial maps.
Furthermore, the model reproduces flexible and prospective aspects of hippocampal dynamics that are challenging to explain within existing frameworks.
This theory reconciles multiple roles of the hippocampal formation in map-based navigation, episodic memory and imagination.

Related Results

Evaluating hippocampal replay without a ground truth
Evaluating hippocampal replay without a ground truth
AbstractDuring rest and sleep, memory traces replay in the brain. The dialogue between brain regions during replay is thought to stabilize labile memory traces for long-term storag...
Continual Learning of Large Language Models: A Comprehensive Survey
Continual Learning of Large Language Models: A Comprehensive Survey
The challenge of effectively and efficiently adapting statically pre-trained Large Language ModelsĀ (LLMs) to ever-evolving data distributions remains predominant. When tailored for...
Memory Function Related to Hippocampal Imaging Findings
Memory Function Related to Hippocampal Imaging Findings
Bilateral Hippocampal Atrophy: Consequences to Verbal Memory Following Temporal Lobectomy Martin RC, Sawrie SM, Knowlton RC, Bilir E, Gilliam FG, Faught E, Morawetz RB, Kuzniecky ...
Hippocampal Volumetry among Sudanese Patients attending Elmoalem Hospital, Sudan; structural MRI study (2021-2022)
Hippocampal Volumetry among Sudanese Patients attending Elmoalem Hospital, Sudan; structural MRI study (2021-2022)
Background: Hippocampal volume has sharp rise till age of 2 years; then it rises slowly. Objective: To build a reference for hippocampus volume among Sudanese population. Method: I...
Exploring Replay
Exploring Replay
Exploration is vital for animals and artificial agents who face uncertainty about their environments due to initial ignorance or subsequent changes. Their choices need to balance e...
Generative replay for compositional visual understanding in the prefrontal-hippocampal circuit
Generative replay for compositional visual understanding in the prefrontal-hippocampal circuit
AbstractUnderstanding the visual world is a constructive process. Whilst a frontal-hippocampal circuit is known to be essential for this task, little is known about the associated ...
The Role of Experience in Prioritizing Hippocampal Replay
The Role of Experience in Prioritizing Hippocampal Replay
Abstract During sleep, recent memories are consolidated, whereby behavioral episodes first encoded by the hippocampus get transformed into long-term memories. However, the ...

Back to Top