Javascript must be enabled to continue!
Neuromorphic hierarchical modular reservoirs
View through CrossRef
Modularity is a fundamental principle of brain organization, reflected in the presence of segregated sub-networks that enable specialized information processing. These small, densely connected modules are often nested within larger, higher-order modules, giving rise to a hierarchical modular architecture. This structure is posited to balance information segregation in specialized neuronal communities and global integration via intermodular communication. Yet, how hierarchical modularity shapes network function remains unclear. Here we introduce a simple blockmodeling framework for generating and comparing multi-level hierarchical modular networks and implement them as recurrent neural network reservoirs to evaluate their computational capacity. We show that hierarchical modular networks enhance memory capacity, support multitasking, and give rise to a broader range of temporal dynamics compared to strictly modular and random networks. These functional advantages can be traced to topological features enriched in hierarchical modular networks, which include reciprocal and cyclic network motifs. To test whether the computational advantages of hierarchical modularity subsist in empirical human brain structural connectivity patterns, we develop a novel hierarchical modularity-preserving network null model, allowing us to isolate the positive effect of empirical hierarchical modularity patterns on memory capacity. To evaluate the biomimetic validity of connectome-informed reservoir dynamics, we compare reservoir timescales to empirical brain timescales derived from MEG data and find that hierarchical modularity contributes to shaping brain-like neural timescales. Altogether, across multiple benchmarks, these results show that hierarchical modularity endows networks with computationally advantageous properties, providing insight into the relationship between neural network structure and function with potential applications for the design of neuromorphic computing architectures.
Cold Spring Harbor Laboratory
Title: Neuromorphic hierarchical modular reservoirs
Description:
Modularity is a fundamental principle of brain organization, reflected in the presence of segregated sub-networks that enable specialized information processing.
These small, densely connected modules are often nested within larger, higher-order modules, giving rise to a hierarchical modular architecture.
This structure is posited to balance information segregation in specialized neuronal communities and global integration via intermodular communication.
Yet, how hierarchical modularity shapes network function remains unclear.
Here we introduce a simple blockmodeling framework for generating and comparing multi-level hierarchical modular networks and implement them as recurrent neural network reservoirs to evaluate their computational capacity.
We show that hierarchical modular networks enhance memory capacity, support multitasking, and give rise to a broader range of temporal dynamics compared to strictly modular and random networks.
These functional advantages can be traced to topological features enriched in hierarchical modular networks, which include reciprocal and cyclic network motifs.
To test whether the computational advantages of hierarchical modularity subsist in empirical human brain structural connectivity patterns, we develop a novel hierarchical modularity-preserving network null model, allowing us to isolate the positive effect of empirical hierarchical modularity patterns on memory capacity.
To evaluate the biomimetic validity of connectome-informed reservoir dynamics, we compare reservoir timescales to empirical brain timescales derived from MEG data and find that hierarchical modularity contributes to shaping brain-like neural timescales.
Altogether, across multiple benchmarks, these results show that hierarchical modularity endows networks with computationally advantageous properties, providing insight into the relationship between neural network structure and function with potential applications for the design of neuromorphic computing architectures.
Related Results
Robust analogue neuromorphic hardware networks using intrinsic physics-adaptive learning
Robust analogue neuromorphic hardware networks using intrinsic physics-adaptive learning
Abstract
Analogue neuromorphic computing hardware is highly energy-efficient and has been regarded as one of the most promising technologies for advancing artificial intell...
Design features of modular buildings
Design features of modular buildings
The paper is devoted to modular buildings as а current topic of modern construction. A significant number of studies on this topic have appeared both in Russia and abroad in last y...
The Absence of Smart Technology as One of The Key Factors of Transportation in Modular Construction: A Case Study in Malaysia
The Absence of Smart Technology as One of The Key Factors of Transportation in Modular Construction: A Case Study in Malaysia
Modular construction is a new method introduced to meet the modernisation agenda in the Malaysian construction industry. It provides various benefits to the construction industry, ...
Comparisons of Pore Structure for Unconventional Tight Gas, Coalbed Methane and Shale Gas Reservoirs
Comparisons of Pore Structure for Unconventional Tight Gas, Coalbed Methane and Shale Gas Reservoirs
Extended abstract
Tight sands gas, coalbed methane and shale gas are three kinds of typical unconventional natural gas. With the decrease of conventional oil and gas...
Compositional Numerical Modelling In Naturally Fractured Reservoirs
Compositional Numerical Modelling In Naturally Fractured Reservoirs
Abstract
Recent improvements in the speed of numerical compositional simulators has made it possible to use a large number of gridblocks to model condensate reser...
Compositional Numerical Modelling In Naturally Fractured Reservoirs
Compositional Numerical Modelling In Naturally Fractured Reservoirs
Abstract
Recent improvements in the. speed. of numerical compositional simulators has made it possible to use a large number of grid blocks to model condensate re...
Understanding Unconventional Gas Reservoir Damages
Understanding Unconventional Gas Reservoir Damages
Abstract
It is estimated that there are large reserves of unconventional gas located throughout the world, including coalbed methane, shale gas and tight gas sand...
Dynamic Field Division of Hydrocarbon Migration, Accumulation and Hydrocarbon Enrichment Rules in Sedimentary Basins
Dynamic Field Division of Hydrocarbon Migration, Accumulation and Hydrocarbon Enrichment Rules in Sedimentary Basins
Abstract:Hydrocarbon distribution rules in the deep and shallow parts of sedimentary basins are considerably different, particularly in the following four aspects. First, the criti...

