Javascript must be enabled to continue!
Training Pi-Sigma Network by Online Gradient Algorithm with Penalty for Small Weight Update
View through CrossRef
A pi-sigma network is a class of feedforward neural networks with product units in the output layer. An online gradient algorithm is the simplest and most often used training method for feedforward neural networks. But there arises a problem when the online gradient algorithm is used for pi-sigma networks in that the update increment of the weights may become very small, especially early in training, resulting in a very slow convergence. To overcome this difficulty, we introduce an adaptive penalty term into the error function, so as to increase the magnitude of the update increment of the weights when it is too small. This strategy brings about faster convergence as shown by the numerical experiments carried out in this letter.
Title: Training Pi-Sigma Network by Online Gradient Algorithm with Penalty for Small Weight Update
Description:
A pi-sigma network is a class of feedforward neural networks with product units in the output layer.
An online gradient algorithm is the simplest and most often used training method for feedforward neural networks.
But there arises a problem when the online gradient algorithm is used for pi-sigma networks in that the update increment of the weights may become very small, especially early in training, resulting in a very slow convergence.
To overcome this difficulty, we introduce an adaptive penalty term into the error function, so as to increase the magnitude of the update increment of the weights when it is too small.
This strategy brings about faster convergence as shown by the numerical experiments carried out in this letter.
Related Results
L᾽«unilinguisme» officiel de Constantinople byzantine (VIIe-XIIe s.)
L᾽«unilinguisme» officiel de Constantinople byzantine (VIIe-XIIe s.)
<p>Νίκος Οικονομίδης</...
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED]Prima Weight Loss Dragons Den UK :-Obesity is a not kidding medical issue brought about by devouring an excessive amount of fat, eating terrible food sources, and practi...
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED]Prima Weight Loss Dragons Den UK :-Obesity is a not kidding medical issue brought about by devouring an excessive amount of fat, eating terrible food sources, and practi...
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED]Prima Weight Loss Dragons Den UK With regards to losing overabundance weight and fat, there are numerous meds, activities, medicines, and enhancements that are accessibl...
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED]Prima Weight Loss Dragons Den UK With regards to losing overabundance weight and fat, there are numerous meds, activities, medicines, and enhancements that are accessibl...
Product Recommendation based on Sybil and Trusted Votes in Social Networks
Product Recommendation based on Sybil and Trusted Votes in Social Networks
Social Networks is a platform which is easily accessible by normal users worldwide. Online Social Networks facilitates users online to get registered with ease of speed and create ...
On the Death Penalty as Seen in the *Falü Dawen 法律答問 Manuscript from the Shuihudi 睡虎地 Qin Slips: A Discussion of the Terms Lu 戮 and Dingsha 定殺
On the Death Penalty as Seen in the *Falü Dawen 法律答問 Manuscript from the Shuihudi 睡虎地 Qin Slips: A Discussion of the Terms Lu 戮 and Dingsha 定殺
Abstract
This paper presents a comprehensive discussion of the terms lu 戮 and dingsha 定殺 for the death penalty in the excavated legal document entitled *Falü dawen 法律答問 (Questions ...
Toward Net Zero: an Engine Electrification Strategy Approach of Fuel Cell and Steam Injection
Toward Net Zero: an Engine Electrification Strategy Approach of Fuel Cell and Steam Injection
Abstract
The turbofan engine electrification is a promising element in the global effort to achieve the 2050 net-zero emission target. This transformative shift embr...
Recent Results
Flights of Fancy and the Dissolution of Shakespearean Space-Time in Angela Carter’s Nights at the Circus
Flights of Fancy and the Dissolution of Shakespearean Space-Time in Angela Carter’s Nights at the Circus
While much attention has been paid to Angela Carter’s intertextual appropriation of Shakespeare and her interrogation of the patriarchal ideology at work in his representations of ...
Understanding Female Sport Attrition in a Stereotypical Male Sport Within the Framework of Eccles's Expectancy–Value Model
Understanding Female Sport Attrition in a Stereotypical Male Sport Within the Framework of Eccles's Expectancy–Value Model
An empirical research study based upon the expectancy–value model of Eccles and colleagues (1983) investigated the effect of gender-role orientations on psychological dimensions of...
Art Orienté Objet, Jeter les bois (2007)
Art Orienté Objet, Jeter les bois (2007)
Sculpture & Photography...