Javascript must be enabled to continue!
Neuromorphic hierarchical modular reservoirs
View through CrossRef
Modularity is a fundamental principle of brain organization, reflected in the presence of segregated sub-networks that enable specialized information processing. These small, densely connected modules are often nested within larger, higher-order modules, giving rise to a hierarchical modular architecture. This structure is posited to balance information segregation in specialized neuronal communities and global integration via intermodular communication. Yet, how hierarchical modularity shapes network function remains unclear. Here we introduce a simple blockmodeling framework for generating and comparing multi-level hierarchical modular networks and implement them as recurrent neural network reservoirs to evaluate their computational capacity. We show that hierarchical modular networks enhance memory capacity, support multitasking, and give rise to a broader range of temporal dynamics compared to strictly modular and random networks. These functional advantages can be traced to topological features enriched in hierarchical modular networks, which include reciprocal and cyclic network motifs. To test whether the computational advantages of hierarchical modularity subsist in empirical human brain structural connectivity patterns, we develop a novel hierarchical modularity-preserving network null model, allowing us to isolate the positive effect of empirical hierarchical modularity patterns on memory capacity. To evaluate the biomimetic validity of connectome-informed reservoir dynamics, we compare reservoir timescales to empirical brain timescales derived from MEG data and find that hierarchical modularity contributes to shaping brain-like neural timescales. Altogether, across multiple benchmarks, these results show that hierarchical modularity endows networks with computationally advantageous properties, providing insight into the relationship between neural network structure and function with potential applications for the design of neuromorphic computing architectures.
Cold Spring Harbor Laboratory
Title: Neuromorphic hierarchical modular reservoirs
Description:
Modularity is a fundamental principle of brain organization, reflected in the presence of segregated sub-networks that enable specialized information processing.
These small, densely connected modules are often nested within larger, higher-order modules, giving rise to a hierarchical modular architecture.
This structure is posited to balance information segregation in specialized neuronal communities and global integration via intermodular communication.
Yet, how hierarchical modularity shapes network function remains unclear.
Here we introduce a simple blockmodeling framework for generating and comparing multi-level hierarchical modular networks and implement them as recurrent neural network reservoirs to evaluate their computational capacity.
We show that hierarchical modular networks enhance memory capacity, support multitasking, and give rise to a broader range of temporal dynamics compared to strictly modular and random networks.
These functional advantages can be traced to topological features enriched in hierarchical modular networks, which include reciprocal and cyclic network motifs.
To test whether the computational advantages of hierarchical modularity subsist in empirical human brain structural connectivity patterns, we develop a novel hierarchical modularity-preserving network null model, allowing us to isolate the positive effect of empirical hierarchical modularity patterns on memory capacity.
To evaluate the biomimetic validity of connectome-informed reservoir dynamics, we compare reservoir timescales to empirical brain timescales derived from MEG data and find that hierarchical modularity contributes to shaping brain-like neural timescales.
Altogether, across multiple benchmarks, these results show that hierarchical modularity endows networks with computationally advantageous properties, providing insight into the relationship between neural network structure and function with potential applications for the design of neuromorphic computing architectures.
Related Results
Robust analogue neuromorphic hardware networks using intrinsic physics-adaptive learning
Robust analogue neuromorphic hardware networks using intrinsic physics-adaptive learning
Abstract
Analogue neuromorphic computing hardware is highly energy-efficient and has been regarded as one of the most promising technologies for advancing artificial intell...
Neuromorphic computing for energy-efficient machine intelligence
Neuromorphic computing for energy-efficient machine intelligence
Abstract
Neuromorphic computing has gained a significant amount of attention from industry as well as the research community as a means of overcoming the growing ...
Hierarchical Zeolites from Production Sand Waste as Catalysts for CO2 to Carbon Nanotubes CNTs: Exploration and Production Sustainability
Hierarchical Zeolites from Production Sand Waste as Catalysts for CO2 to Carbon Nanotubes CNTs: Exploration and Production Sustainability
Abstract
This project targets to convert sand waste from oil & gas production, which is typically disposed as landfill, to be the higher-value products, called "...
All on board
All on board
Machine learning models offer transformative benefits across disciplines such as medicine, chemistry, and physics. However, as these models grow in size and usage, their energy dem...
Neuromorphic Memristive Chips: Design and Technology
Neuromorphic Memristive Chips: Design and Technology
Memristive neuromorphic chips exploit a prospective class of novel functional materials (memristors) to deploy a new architecture of spiking neural networks for developing basic bl...
Editorial: Focus on algorithms for neuromorphic computing
Editorial: Focus on algorithms for neuromorphic computing
Abstract
Neuromorphic computing provides a promising energy-efficient alternative to von-Neumann-type computing and learning architectures. However, the best neuromo...
Sand Control Application in Mediterranean Sea Pliocene Gas Reservoirs-Case Study
Sand Control Application in Mediterranean Sea Pliocene Gas Reservoirs-Case Study
Abstract
In the last ten years a lot of gas fields were discovered in Egypt at Mediterranean Sea area, the most reservoirs of these fields were discovered in the ...
Comparisons of Pore Structure for Unconventional Tight Gas, Coalbed Methane and Shale Gas Reservoirs
Comparisons of Pore Structure for Unconventional Tight Gas, Coalbed Methane and Shale Gas Reservoirs
Extended abstract
Tight sands gas, coalbed methane and shale gas are three kinds of typical unconventional natural gas. With the decrease of conventional oil and gas...

