Javascript must be enabled to continue!
Training Pi-Sigma Network by Online Gradient Algorithm with Penalty for Small Weight Update
View through CrossRef
A pi-sigma network is a class of feedforward neural networks with product units in the output layer. An online gradient algorithm is the simplest and most often used training method for feedforward neural networks. But there arises a problem when the online gradient algorithm is used for pi-sigma networks in that the update increment of the weights may become very small, especially early in training, resulting in a very slow convergence. To overcome this difficulty, we introduce an adaptive penalty term into the error function, so as to increase the magnitude of the update increment of the weights when it is too small. This strategy brings about faster convergence as shown by the numerical experiments carried out in this letter.
Title: Training Pi-Sigma Network by Online Gradient Algorithm with Penalty for Small Weight Update
Description:
A pi-sigma network is a class of feedforward neural networks with product units in the output layer.
An online gradient algorithm is the simplest and most often used training method for feedforward neural networks.
But there arises a problem when the online gradient algorithm is used for pi-sigma networks in that the update increment of the weights may become very small, especially early in training, resulting in a very slow convergence.
To overcome this difficulty, we introduce an adaptive penalty term into the error function, so as to increase the magnitude of the update increment of the weights when it is too small.
This strategy brings about faster convergence as shown by the numerical experiments carried out in this letter.
Related Results
L᾽«unilinguisme» officiel de Constantinople byzantine (VIIe-XIIe s.)
L᾽«unilinguisme» officiel de Constantinople byzantine (VIIe-XIIe s.)
<p>Νίκος Οικονομίδης</...
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED]Prima Weight Loss Dragons Den UK :-Obesity is a not kidding medical issue brought about by devouring an excessive amount of fat, eating terrible food sources, and practi...
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED]Prima Weight Loss Dragons Den UK :-Obesity is a not kidding medical issue brought about by devouring an excessive amount of fat, eating terrible food sources, and practi...
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED]Prima Weight Loss Dragons Den UK With regards to losing overabundance weight and fat, there are numerous meds, activities, medicines, and enhancements that are accessibl...
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED]Prima Weight Loss Dragons Den UK With regards to losing overabundance weight and fat, there are numerous meds, activities, medicines, and enhancements that are accessibl...
Product Recommendation based on Sybil and Trusted Votes in Social Networks
Product Recommendation based on Sybil and Trusted Votes in Social Networks
Social Networks is a platform which is easily accessible by normal users worldwide. Online Social Networks facilitates users online to get registered with ease of speed and create ...
On the Death Penalty as Seen in the *Falü Dawen 法律答問 Manuscript from the Shuihudi 睡虎地 Qin Slips: A Discussion of the Terms Lu 戮 and Dingsha 定殺
On the Death Penalty as Seen in the *Falü Dawen 法律答問 Manuscript from the Shuihudi 睡虎地 Qin Slips: A Discussion of the Terms Lu 戮 and Dingsha 定殺
Abstract
This paper presents a comprehensive discussion of the terms lu 戮 and dingsha 定殺 for the death penalty in the excavated legal document entitled *Falü dawen 法律答問 (Questions ...
Toward Net Zero: an Engine Electrification Strategy Approach of Fuel Cell and Steam Injection
Toward Net Zero: an Engine Electrification Strategy Approach of Fuel Cell and Steam Injection
Abstract
The turbofan engine electrification is a promising element in the global effort to achieve the 2050 net-zero emission target. This transformative shift embr...
Recent Results
Cherchell (Algeria). Acquedotto romano del II secolo
Cherchell (Algeria). Acquedotto romano del II secolo
Roman aqueduct in Cherchell...
Italian transnational masculinity: Jeeg Robot, Il ragazzo invisibile and MilzaMan
Italian transnational masculinity: Jeeg Robot, Il ragazzo invisibile and MilzaMan
Abstract This article looks at three recent examples of superheroic masculinity in Italian film and media, arguing that it is always conceptualized transnationally, triangulated be...
Crucifixion
Crucifixion
Rectangular polychromed enamel plaque of the Crucifixion incorporating blue, green, red, and gold with grisaille flesh tones....
A partire da Egon Kunz: una teoria male interpretata
A partire da Egon Kunz: una teoria male interpretata
Partendo dalla teoria proposta da Egon Kunz, nota come pushpull theory, il saggio si propone di indagare la cattiva interpretazione che ne è stata data, irrigidendo la tassonomia d...