Javascript must be enabled to continue!
Neuromorphic hierarchical modular reservoirs
View through CrossRef
Modularity is a fundamental principle of brain organization, reflected in the presence of segregated sub-networks that enable specialized information processing. These small, densely connected modules are often nested within larger, higher-order modules, giving rise to a hierarchical modular architecture. This structure is posited to balance information segregation in specialized neuronal communities and global integration via intermodular communication. Yet, how hierarchical modularity shapes network function remains unclear. Here we introduce a simple blockmodeling framework for generating and comparing multi-level hierarchical modular networks and implement them as recurrent neural network reservoirs to evaluate their computational capacity. We show that hierarchical modular networks enhance memory capacity, support multitasking, and give rise to a broader range of temporal dynamics compared to strictly modular and random networks. These functional advantages can be traced to topological features enriched in hierarchical modular networks, which include reciprocal and cyclic network motifs. To test whether the computational advantages of hierarchical modularity subsist in empirical human brain structural connectivity patterns, we develop a novel hierarchical modularity-preserving network null model, allowing us to isolate the positive effect of empirical hierarchical modularity patterns on memory capacity. To evaluate the biomimetic validity of connectome-informed reservoir dynamics, we compare reservoir timescales to empirical brain timescales derived from MEG data and find that hierarchical modularity contributes to shaping brain-like neural timescales. Altogether, across multiple benchmarks, these results show that hierarchical modularity endows networks with computationally advantageous properties, providing insight into the relationship between neural network structure and function with potential applications for the design of neuromorphic computing architectures.
Cold Spring Harbor Laboratory
Title: Neuromorphic hierarchical modular reservoirs
Description:
Modularity is a fundamental principle of brain organization, reflected in the presence of segregated sub-networks that enable specialized information processing.
These small, densely connected modules are often nested within larger, higher-order modules, giving rise to a hierarchical modular architecture.
This structure is posited to balance information segregation in specialized neuronal communities and global integration via intermodular communication.
Yet, how hierarchical modularity shapes network function remains unclear.
Here we introduce a simple blockmodeling framework for generating and comparing multi-level hierarchical modular networks and implement them as recurrent neural network reservoirs to evaluate their computational capacity.
We show that hierarchical modular networks enhance memory capacity, support multitasking, and give rise to a broader range of temporal dynamics compared to strictly modular and random networks.
These functional advantages can be traced to topological features enriched in hierarchical modular networks, which include reciprocal and cyclic network motifs.
To test whether the computational advantages of hierarchical modularity subsist in empirical human brain structural connectivity patterns, we develop a novel hierarchical modularity-preserving network null model, allowing us to isolate the positive effect of empirical hierarchical modularity patterns on memory capacity.
To evaluate the biomimetic validity of connectome-informed reservoir dynamics, we compare reservoir timescales to empirical brain timescales derived from MEG data and find that hierarchical modularity contributes to shaping brain-like neural timescales.
Altogether, across multiple benchmarks, these results show that hierarchical modularity endows networks with computationally advantageous properties, providing insight into the relationship between neural network structure and function with potential applications for the design of neuromorphic computing architectures.
Related Results
From Solid to Fluid: Novel Approaches in Neuromorphic Engineering
From Solid to Fluid: Novel Approaches in Neuromorphic Engineering
Neuromorphic engineering is rapidly developing as an approach to mimicking processes
in brains using artificial memristors, devices that change conductivity in response to the elec...
Neuromorphic Computing: Cutting-Edge Advances and Future Directions
Neuromorphic Computing: Cutting-Edge Advances and Future Directions
Neuromorphic computing draws motivation from the human brain and presents a distinctive substitute for the traditional von Neumann architecture. Neuromorphic systems provide simult...
MULTISCALE MODELING OF NEUROMORPHIC SYSTEMS
MULTISCALE MODELING OF NEUROMORPHIC SYSTEMS
Multiscale approaches, models and algorithms for designing neuromorphic devices for the memory of new generation computers are presented. The developed approaches make it possible ...
Neuromorphic Computing for Edge AI
Neuromorphic Computing for Edge AI
The Neuromorphic computing and Edge AI (Artificial intelligence) are two inter related concepts that have left a lasting impression in recent years. As a result of the ability of n...
Robust analogue neuromorphic hardware networks using intrinsic physics-adaptive learning
Robust analogue neuromorphic hardware networks using intrinsic physics-adaptive learning
Abstract
Analogue neuromorphic computing hardware is highly energy-efficient and has been regarded as one of the most promising technologies for advancing artificial intell...
Neuromorphic computing for energy-efficient machine intelligence
Neuromorphic computing for energy-efficient machine intelligence
Abstract
Neuromorphic computing has gained a significant amount of attention from industry as well as the research community as a means of overcoming the growing ...
Hierarchical Zeolites from Production Sand Waste as Catalysts for CO2 to Carbon Nanotubes CNTs: Exploration and Production Sustainability
Hierarchical Zeolites from Production Sand Waste as Catalysts for CO2 to Carbon Nanotubes CNTs: Exploration and Production Sustainability
Abstract
This project targets to convert sand waste from oil & gas production, which is typically disposed as landfill, to be the higher-value products, called "...
A Comparative Study on Some Modular Approaches for Analysis and Synthesis of Planar Linkages: Part II — Modular Dynamic Analysis, Modular Structural Synthesis and Modular Kinematic Synthesis
A Comparative Study on Some Modular Approaches for Analysis and Synthesis of Planar Linkages: Part II — Modular Dynamic Analysis, Modular Structural Synthesis and Modular Kinematic Synthesis
Abstract
This paper presents a systematical comparative study of various modular methods based on the different module types: basic kinematic chains (BKCs), single o...

