Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

An Efficient Hardware Implementation of the Convolution Layer for the CNN Digit Recognition

View through CrossRef
This work proposes an efficient hardware design of the convolution layer for a convolutional neural network (CNN) in digit recognition applications. CNN is a computation extensive process in which software implementation might not give the best performance. Hardware implementation could accelerate the runtime of the CNN as it offers parallel computation. The CNN for digit recognition was first modelled in MATLAB, where the model was trained with the Modified National Institute of Standards and Technology (MNIST). The training in MATLAB produces convolution layer’s weights that are used in convolution layer in image processing. The input image is a 28×28 pixels image, which is equivalent to 784 input nodes. The design has 20 convolution filters with a size of 9×9 each. After the training and verification were performed in MATLAB, the filter weights were utilized in the hardware design. The efficient design is achieved by implementing adder tree reduction, smart scheduling, and hardware allocation techniques. The design is coded in Verilog HDL and targeted to implement in Intel Cyclone IV E field programmable gate array (FPGA) while the verification is performed using ModelSim. Simulation results show that the proposed hardware design of the CNN convolution layer hardware is performing well, and the results are consistent with the results from MATLAB. Benchmarking results show that the proposed hardware design can run up to 50 times faster than software implementation in MATLAB although it is running at much lower clock speed at only 50 MHz. The fast and low logic implementation (11.6k logic elements) proved that the proposed design is efficient and optimized.
Title: An Efficient Hardware Implementation of the Convolution Layer for the CNN Digit Recognition
Description:
This work proposes an efficient hardware design of the convolution layer for a convolutional neural network (CNN) in digit recognition applications.
CNN is a computation extensive process in which software implementation might not give the best performance.
Hardware implementation could accelerate the runtime of the CNN as it offers parallel computation.
The CNN for digit recognition was first modelled in MATLAB, where the model was trained with the Modified National Institute of Standards and Technology (MNIST).
The training in MATLAB produces convolution layer’s weights that are used in convolution layer in image processing.
The input image is a 28×28 pixels image, which is equivalent to 784 input nodes.
The design has 20 convolution filters with a size of 9×9 each.
After the training and verification were performed in MATLAB, the filter weights were utilized in the hardware design.
The efficient design is achieved by implementing adder tree reduction, smart scheduling, and hardware allocation techniques.
The design is coded in Verilog HDL and targeted to implement in Intel Cyclone IV E field programmable gate array (FPGA) while the verification is performed using ModelSim.
Simulation results show that the proposed hardware design of the CNN convolution layer hardware is performing well, and the results are consistent with the results from MATLAB.
Benchmarking results show that the proposed hardware design can run up to 50 times faster than software implementation in MATLAB although it is running at much lower clock speed at only 50 MHz.
The fast and low logic implementation (11.
6k logic elements) proved that the proposed design is efficient and optimized.

Related Results

SOC Reconfigurable Architecture for Software-Trained Neural Networks on FPGA
SOC Reconfigurable Architecture for Software-Trained Neural Networks on FPGA
Neural networks are extensively used in software and hardware applications. In hardware applications, it is necessary to implement a small, accelerated, and configurable...
Detectability of an intermediate layer by magnetotelluric sounding
Detectability of an intermediate layer by magnetotelluric sounding
Abstract The recent publication by Verma and Mallick (1979) on the detectability of an intermediate layer by time domain EM sounding provides some informative ans...
Graph convolutional neural networks for 3D data analysis
Graph convolutional neural networks for 3D data analysis
(English) Deep Learning allows the extraction of complex features directly from raw input data, eliminating the need for hand-crafted features from the classical Machine Learning p...
A Compact and Flexible FPGA Accelerator for Regular and Octave Convolutional Neural Networks
A Compact and Flexible FPGA Accelerator for Regular and Octave Convolutional Neural Networks
<p>Convolutional Neural Networks has (CNN) have been widely used in various Internet-of-Things (IoT) applications to offer smart solutions in our daily lives. Many hardware a...
A Compact and Flexible FPGA Accelerator for Regular and Octave Convolutional Neural Networks
A Compact and Flexible FPGA Accelerator for Regular and Octave Convolutional Neural Networks
Convolutional Neural Networks has (CNN) have been widely used in various Internet-of-Things (IoT) applications to offer smart solutions in our daily lives. Many hardware accelerato...
A Compact and Flexible FPGA Accelerator for Regular and Octave Convolutional Neural Networks
A Compact and Flexible FPGA Accelerator for Regular and Octave Convolutional Neural Networks
Convolutional Neural Networks has (CNN) have been widely used in various Internet-of-Things (IoT) applications to offer smart solutions in our daily lives. Many hardware accelerato...
Relationship Between Weight Correlation of the Convolution Kernels and the Optimal Architecture of CNN
Relationship Between Weight Correlation of the Convolution Kernels and the Optimal Architecture of CNN
Currently, deep learning has been one of the most popular research topics, and it has already been successfully applied in many fields such as image recognition, recommendation sys...
Digit Recognition Using Convolutional Neural Network
Digit Recognition Using Convolutional Neural Network
Digit detection using convolutional neural networks works as an exciting area of computer vision and machine learning. Developed to process and analyze visual data, they comprise s...

Back to Top