Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Neuromorphic hierarchical modular reservoirs

View through CrossRef
Modularity is a fundamental principle of brain organization, reflected in the presence of segregated sub-networks that enable specialized information processing. These small, densely connected modules are often nested within larger, higher-order modules, giving rise to a hierarchical modular architecture. This structure is posited to balance information segregation in specialized neuronal communities and global integration via intermodular communication. Yet, how hierarchical modularity shapes network function remains unclear. Here we introduce a simple blockmodeling framework for generating and comparing multi-level hierarchical modular networks and implement them as recurrent neural network reservoirs to evaluate their computational capacity. We show that hierarchical modular networks enhance memory capacity, support multitasking, and give rise to a broader range of temporal dynamics compared to strictly modular and random networks. These functional advantages can be traced to topological features enriched in hierarchical modular networks, which include reciprocal and cyclic network motifs. To test whether the computational advantages of hierarchical modularity subsist in empirical human brain structural connectivity patterns, we develop a novel hierarchical modularity-preserving network null model, allowing us to isolate the positive effect of empirical hierarchical modularity patterns on memory capacity. To evaluate the biomimetic validity of connectome-informed reservoir dynamics, we compare reservoir timescales to empirical brain timescales derived from MEG data and find that hierarchical modularity contributes to shaping brain-like neural timescales. Altogether, across multiple benchmarks, these results show that hierarchical modularity endows networks with computationally advantageous properties, providing insight into the relationship between neural network structure and function with potential applications for the design of neuromorphic computing architectures.
Title: Neuromorphic hierarchical modular reservoirs
Description:
Modularity is a fundamental principle of brain organization, reflected in the presence of segregated sub-networks that enable specialized information processing.
These small, densely connected modules are often nested within larger, higher-order modules, giving rise to a hierarchical modular architecture.
This structure is posited to balance information segregation in specialized neuronal communities and global integration via intermodular communication.
Yet, how hierarchical modularity shapes network function remains unclear.
Here we introduce a simple blockmodeling framework for generating and comparing multi-level hierarchical modular networks and implement them as recurrent neural network reservoirs to evaluate their computational capacity.
We show that hierarchical modular networks enhance memory capacity, support multitasking, and give rise to a broader range of temporal dynamics compared to strictly modular and random networks.
These functional advantages can be traced to topological features enriched in hierarchical modular networks, which include reciprocal and cyclic network motifs.
To test whether the computational advantages of hierarchical modularity subsist in empirical human brain structural connectivity patterns, we develop a novel hierarchical modularity-preserving network null model, allowing us to isolate the positive effect of empirical hierarchical modularity patterns on memory capacity.
To evaluate the biomimetic validity of connectome-informed reservoir dynamics, we compare reservoir timescales to empirical brain timescales derived from MEG data and find that hierarchical modularity contributes to shaping brain-like neural timescales.
Altogether, across multiple benchmarks, these results show that hierarchical modularity endows networks with computationally advantageous properties, providing insight into the relationship between neural network structure and function with potential applications for the design of neuromorphic computing architectures.

Related Results

From Solid to Fluid: Novel Approaches in Neuromorphic Engineering
From Solid to Fluid: Novel Approaches in Neuromorphic Engineering
Neuromorphic engineering is rapidly developing as an approach to mimicking processes in brains using artificial memristors, devices that change conductivity in response to the elec...
Neuromorphic Computing: Cutting-Edge Advances and Future Directions
Neuromorphic Computing: Cutting-Edge Advances and Future Directions
Neuromorphic computing draws motivation from the human brain and presents a distinctive substitute for the traditional von Neumann architecture. Neuromorphic systems provide simult...
MULTISCALE MODELING OF NEUROMORPHIC SYSTEMS
MULTISCALE MODELING OF NEUROMORPHIC SYSTEMS
Multiscale approaches, models and algorithms for designing neuromorphic devices for the memory of new generation computers are presented. The developed approaches make it possible ...
Neuromorphic Computing for Edge AI
Neuromorphic Computing for Edge AI
The Neuromorphic computing and Edge AI (Artificial intelligence) are two inter related concepts that have left a lasting impression in recent years. As a result of the ability of n...
Robust analogue neuromorphic hardware networks using intrinsic physics-adaptive learning
Robust analogue neuromorphic hardware networks using intrinsic physics-adaptive learning
Abstract Analogue neuromorphic computing hardware is highly energy-efficient and has been regarded as one of the most promising technologies for advancing artificial intell...
Neuromorphic computing for energy-efficient machine intelligence
Neuromorphic computing for energy-efficient machine intelligence
Abstract Neuromorphic computing has gained a significant amount of attention from industry as well as the research community as a means of overcoming the growing ...

Back to Top