Javascript must be enabled to continue!
Stability by gating plasticity in recurrent neural networks
View through CrossRef
Abstract
With Hebbian learning ‘who fires together wires together’, well-known problems arise. Hebbian plasticity can cause unstable network dynamics and overwrite stored memories. Unstable dynamics can partly be addressed with homeostatic plasticity mechanisms. Unfortunately, the time constants of homeostatic mechanisms required in network models are much shorter than those measured experimentally.
We propose that homeostatic time constants can be slow if plasticity is gated. We investigate how gating plasticity influences network stability and memories in plastic balanced spiking networks of neurons with dendrites. We compare how different factors such as excitability, learning rate, and inhibition lift the requirements for homeostatic time constants. We investigate how dendritic versus perisomatic gating allows for different amounts of weight changes in stable networks. We suggest that the compartmentalisation of pyramidal cells enables dendritic synaptic changes while maintaining stability. We show that spatially restricted plasticity improves stability. Finally, we compare how different gates protect memories.
Significance statement
How does the brain maintain stable neural activity in the presence of synaptic changes? This question has been studied extensively in the past, but we argue that one crucial aspect is missing in previous studies. While all theoretical work has assumed plasticity to be
on
all the time, plasticity is in fact heavily gated. In this light, we must reconsider the theories on stability and homeostasis of neural activity. In particular, theoretical studies show that neural networks undergoing plasticity require fast compensatory homeostatic mechanisms to be stable. However, experimentally measured homeostatic processes operate on much slower time scales. We studied how the gating of plasticity can improve network stability and thereby reduce the discrepancy in the homeostatic time constant between models and experiments.
Title: Stability by gating plasticity in recurrent neural networks
Description:
Abstract
With Hebbian learning ‘who fires together wires together’, well-known problems arise.
Hebbian plasticity can cause unstable network dynamics and overwrite stored memories.
Unstable dynamics can partly be addressed with homeostatic plasticity mechanisms.
Unfortunately, the time constants of homeostatic mechanisms required in network models are much shorter than those measured experimentally.
We propose that homeostatic time constants can be slow if plasticity is gated.
We investigate how gating plasticity influences network stability and memories in plastic balanced spiking networks of neurons with dendrites.
We compare how different factors such as excitability, learning rate, and inhibition lift the requirements for homeostatic time constants.
We investigate how dendritic versus perisomatic gating allows for different amounts of weight changes in stable networks.
We suggest that the compartmentalisation of pyramidal cells enables dendritic synaptic changes while maintaining stability.
We show that spatially restricted plasticity improves stability.
Finally, we compare how different gates protect memories.
Significance statement
How does the brain maintain stable neural activity in the presence of synaptic changes? This question has been studied extensively in the past, but we argue that one crucial aspect is missing in previous studies.
While all theoretical work has assumed plasticity to be
on
all the time, plasticity is in fact heavily gated.
In this light, we must reconsider the theories on stability and homeostasis of neural activity.
In particular, theoretical studies show that neural networks undergoing plasticity require fast compensatory homeostatic mechanisms to be stable.
However, experimentally measured homeostatic processes operate on much slower time scales.
We studied how the gating of plasticity can improve network stability and thereby reduce the discrepancy in the homeostatic time constant between models and experiments.
Related Results
Dendrites Help Mitigate the Plasticity-Stability Dilemma
Dendrites Help Mitigate the Plasticity-Stability Dilemma
With Hebbian learning ‘who fires together wires together', well-known problems arise. Hebbian plasticity can cause unstable network dynamics and overwrite stored memories....
On the role of network dynamics for information processing in artificial and biological neural networks
On the role of network dynamics for information processing in artificial and biological neural networks
Understanding how interactions in complex systems give rise to various collective behaviours has been of interest for researchers across a wide range of fields. However, despite ma...
Fuzzy Chaotic Neural Networks
Fuzzy Chaotic Neural Networks
An understanding of the human brain’s local function has improved in recent years. But the cognition of human brain’s working process as a whole is still obscure. Both fuzzy logic ...
P015 Improving the diagnostic performance of ANCA testing: evaluating the use of a gating strategy for ANCA test requests
P015 Improving the diagnostic performance of ANCA testing: evaluating the use of a gating strategy for ANCA test requests
Abstract
Background/Aims
Anti-neutrophil cytoplasmic antibody (ANCAs) associated vasculitis (AAV) encompasses: Granulomatosis with polyangiitis (GPA)...
NEURAL NETWORKS AND DEEP LEARNING: THEORITICAL INSIGHTS AND FRAMEWORKS
NEURAL NETWORKS AND DEEP LEARNING: THEORITICAL INSIGHTS AND FRAMEWORKS
“NEURAL NETWORKS AND DEEP LEARNING: THEORITICAL INSIGHTS AND FRAMEWORKS” is a comprehensive guide that dives deep into the world of neural networks and their applications in modern...
Reproductive plasticity in both sexes interacts to determine mating behaviour and fecundity
Reproductive plasticity in both sexes interacts to determine mating behaviour and fecundity
AbstractOrganisms alter their phenotype in response to variation in their environment by expressing phenotypic plasticity. Both sexes exhibit such plasticity in response to contras...
fects of early drought-induced phenotypic plasticity on late plant seedling interactions
fects of early drought-induced phenotypic plasticity on late plant seedling interactions
Abstract
In nature, plants are often exposed to a variety of environments. The study of plant phenotypic plasticity cannot ignore a variety of environmental factors. At pre...
Short-term depression and long-term plasticity together tune sensitive range of synaptic plasticity
Short-term depression and long-term plasticity together tune sensitive range of synaptic plasticity
Abstract
Synaptic efficacy is subjected to activity-dependent changes on short- and long time scales. While short-term changes decay over minutes, long-term modific...

