Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Training Pi-Sigma Network by Online Gradient Algorithm with Penalty for Small Weight Update

View through CrossRef
A pi-sigma network is a class of feedforward neural networks with product units in the output layer. An online gradient algorithm is the simplest and most often used training method for feedforward neural networks. But there arises a problem when the online gradient algorithm is used for pi-sigma networks in that the update increment of the weights may become very small, especially early in training, resulting in a very slow convergence. To overcome this difficulty, we introduce an adaptive penalty term into the error function, so as to increase the magnitude of the update increment of the weights when it is too small. This strategy brings about faster convergence as shown by the numerical experiments carried out in this letter.
Title: Training Pi-Sigma Network by Online Gradient Algorithm with Penalty for Small Weight Update
Description:
A pi-sigma network is a class of feedforward neural networks with product units in the output layer.
An online gradient algorithm is the simplest and most often used training method for feedforward neural networks.
But there arises a problem when the online gradient algorithm is used for pi-sigma networks in that the update increment of the weights may become very small, especially early in training, resulting in a very slow convergence.
To overcome this difficulty, we introduce an adaptive penalty term into the error function, so as to increase the magnitude of the update increment of the weights when it is too small.
This strategy brings about faster convergence as shown by the numerical experiments carried out in this letter.

Related Results

L᾽«unilinguisme» officiel de Constantinople byzantine (VIIe-XIIe s.)
L᾽«unilinguisme» officiel de Constantinople byzantine (VIIe-XIIe s.)
&nbsp; <p>&Nu;ί&kappa;&omicron;&sigmaf; &Omicron;&iota;&kappa;&omicron;&nu;&omicron;&mu;ί&delta;&eta;&sigmaf;</...
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED]Prima Weight Loss Dragons Den UK :-Obesity is a not kidding medical issue brought about by devouring an excessive amount of fat, eating terrible food sources, and practi...
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED] Prima Weight Loss Dragons Den UK v1
[RETRACTED]Prima Weight Loss Dragons Den UK :-Obesity is a not kidding medical issue brought about by devouring an excessive amount of fat, eating terrible food sources, and practi...
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED]Prima Weight Loss Dragons Den UK With regards to losing overabundance weight and fat, there are numerous meds, activities, medicines, and enhancements that are accessibl...
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED] Prima Weight Loss Dragons Den UK[Dragons Den Advantage 2022] - Pills Reviews? v1
[RETRACTED]Prima Weight Loss Dragons Den UK With regards to losing overabundance weight and fat, there are numerous meds, activities, medicines, and enhancements that are accessibl...
Product Recommendation based on Sybil and Trusted Votes in Social Networks
Product Recommendation based on Sybil and Trusted Votes in Social Networks
Social Networks is a platform which is easily accessible by normal users worldwide. Online Social Networks facilitates users online to get registered with ease of speed and create ...
Toward Net Zero: an Engine Electrification Strategy Approach of Fuel Cell and Steam Injection
Toward Net Zero: an Engine Electrification Strategy Approach of Fuel Cell and Steam Injection
Abstract The turbofan engine electrification is a promising element in the global effort to achieve the 2050 net-zero emission target. This transformative shift embr...

Recent Results

Flights of Fancy and the Dissolution of Shakespearean Space-Time in Angela Carter’s Nights at the Circus
Flights of Fancy and the Dissolution of Shakespearean Space-Time in Angela Carter’s Nights at the Circus
While much attention has been paid to Angela Carter’s intertextual appropriation of Shakespeare and her interrogation of the patriarchal ideology at work in his representations of ...
Understanding Female Sport Attrition in a Stereotypical Male Sport Within the Framework of Eccles's Expectancy–Value Model
Understanding Female Sport Attrition in a Stereotypical Male Sport Within the Framework of Eccles's Expectancy–Value Model
An empirical research study based upon the expectancy–value model of Eccles and colleagues (1983) investigated the effect of gender-role orientations on psychological dimensions of...

Back to Top