Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Spiking neural network with local plasticity and sparse connectivity for audio classification

View through CrossRef
Purpose. Studying the possibility of implementing a data classification method based on a spiking neural network, which has a low number of connections and is trained based on local plasticity rules, such as Spike-Timing-Dependent Plasticity. Methods. As the basic architecture of a spiking neural network we use a network included an input layer and layers of excitatory and inhibitory spiking neurons (Leaky Integrate and Fire). Various options for organizing connections in the selected neural network are explored. We have proposed a method for organizing connectivity between layers of neurons, in which synaptic connections are formed with a certain probability, calculated on the basis of the spatial arrangement of neurons in the layers. In this case, a limited area of connectivity leads to a higher sparseness of connections in the overall network. We use frequency-based coding of data into spike trains, and logistic regression is used for decoding. Results. As a result, based on the proposed method of organizing connections, a set of spiking neural network architectures with different connectivity coefficients for different layers of the original network was implemented. A study of the resulting spiking network architectures was carried out using the Free Spoken Digits dataset, consisting of 3000 audio recordings corresponding to 10 classes of digits from 0 to 9. Conclusion. It is shown that the proposed method of organizing connections for the selected spiking neural network allows reducing the number of connections by up to 60% compared to a fully connected architecture. At the same time, the accuracy of solving the classification problem does not deteriorate and is 0.92...0.95 according to the F1 metric. This matches the accuracy of standard support vector machine, k-nearest neighbor, and random forest classifiers. The source code for this article is publicly available: https://github.com/sag111/Sparse-WTA-SNN.
Title: Spiking neural network with local plasticity and sparse connectivity for audio classification
Description:
Purpose.
Studying the possibility of implementing a data classification method based on a spiking neural network, which has a low number of connections and is trained based on local plasticity rules, such as Spike-Timing-Dependent Plasticity.
Methods.
As the basic architecture of a spiking neural network we use a network included an input layer and layers of excitatory and inhibitory spiking neurons (Leaky Integrate and Fire).
Various options for organizing connections in the selected neural network are explored.
We have proposed a method for organizing connectivity between layers of neurons, in which synaptic connections are formed with a certain probability, calculated on the basis of the spatial arrangement of neurons in the layers.
In this case, a limited area of connectivity leads to a higher sparseness of connections in the overall network.
We use frequency-based coding of data into spike trains, and logistic regression is used for decoding.
Results.
As a result, based on the proposed method of organizing connections, a set of spiking neural network architectures with different connectivity coefficients for different layers of the original network was implemented.
A study of the resulting spiking network architectures was carried out using the Free Spoken Digits dataset, consisting of 3000 audio recordings corresponding to 10 classes of digits from 0 to 9.
Conclusion.
It is shown that the proposed method of organizing connections for the selected spiking neural network allows reducing the number of connections by up to 60% compared to a fully connected architecture.
At the same time, the accuracy of solving the classification problem does not deteriorate and is 0.
92.
95 according to the F1 metric.
This matches the accuracy of standard support vector machine, k-nearest neighbor, and random forest classifiers.
The source code for this article is publicly available: https://github.
com/sag111/Sparse-WTA-SNN.

Related Results

Embedding optimization reveals long-lasting history dependence in neural spiking activity
Embedding optimization reveals long-lasting history dependence in neural spiking activity
AbstractInformation processing can leave distinct footprints on the statistics of neural spiking. For example, efficient coding minimizes the statistical dependencies on the spikin...
Sparse connectivity enables efficient information processing in cortex-like artificial neural networks
Sparse connectivity enables efficient information processing in cortex-like artificial neural networks
Neurons in cortical networks are very sparsely connected; even neurons whose axons and dendrites overlap are highly unlikely to form a synaptic connection. What is the relevance of...
Adaptive Drop Approaches to Train Spiking-YOLO Network for Traffic Flow Counting
Adaptive Drop Approaches to Train Spiking-YOLO Network for Traffic Flow Counting
Abstract Traffic flow counting is an object detection problem. YOLO (" You Only Look Once ") is a popular object detection network. Spiking-YOLO converts the YOLO network f...
Reproductive plasticity in both sexes interacts to determine mating behaviour and fecundity
Reproductive plasticity in both sexes interacts to determine mating behaviour and fecundity
AbstractOrganisms alter their phenotype in response to variation in their environment by expressing phenotypic plasticity. Both sexes exhibit such plasticity in response to contras...
Autapses enable temporal pattern recognition in spiking neural networks
Autapses enable temporal pattern recognition in spiking neural networks
ABSTRACTMost sensory stimuli are temporal in structure. How action potentials encode the information incoming from sensory stimuli remains one of the central research questions in ...
Geometry of population activity in spiking networks with low-rank structure
Geometry of population activity in spiking networks with low-rank structure
AbstractRecurrent network models are instrumental in investigating how behaviorally-relevant computations emerge from collective neural dynamics. A recently developed class of mode...
fects of early drought-induced phenotypic plasticity on late plant seedling interactions
fects of early drought-induced phenotypic plasticity on late plant seedling interactions
Abstract In nature, plants are often exposed to a variety of environments. The study of plant phenotypic plasticity cannot ignore a variety of environmental factors. At pre...
Backpropagation With Sparsity Regularization for Spiking Neural Network Learning
Backpropagation With Sparsity Regularization for Spiking Neural Network Learning
The spiking neural network (SNN) is a possible pathway for low-power and energy-efficient processing and computing exploiting spiking-driven and sparsity features of biological sys...

Back to Top