Javascript must be enabled to continue!
Unsupervised Learning
View through CrossRef
What use can the brain make of the massive flow of sensory information that occurs without any associated rewards or punishments? This question is reviewed in the light of connectionist models of unsupervised learning and some older ideas, namely the cognitive maps and working models of Tolman and Craik, and the idea that redundancy is important for understanding perception (Attneave 1954), the physiology of sensory pathways (Barlow 1959), and pattern recognition (Watanabe 1960). It is argued that (1) The redundancy of sensory messages provides the knowledge incorporated in the maps or models. (2) Some of this knowledge can be obtained by observations of mean, variance, and covariance of sensory messages, and perhaps also by a method called “minimum entropy coding.” (3) Such knowledge may be incorporated in a model of “what usually happens” with which incoming messages are automatically compared, enabling unexpected discrepancies to be immediately identified. (4) Knowledge of the sort incorporated into such a filter is a necessary prerequisite of ordinary learning, and a representation whose elements are independent makes it possible to form associations with logical functions of the elements, not just with the elements themselves.
Title: Unsupervised Learning
Description:
What use can the brain make of the massive flow of sensory information that occurs without any associated rewards or punishments? This question is reviewed in the light of connectionist models of unsupervised learning and some older ideas, namely the cognitive maps and working models of Tolman and Craik, and the idea that redundancy is important for understanding perception (Attneave 1954), the physiology of sensory pathways (Barlow 1959), and pattern recognition (Watanabe 1960).
It is argued that (1) The redundancy of sensory messages provides the knowledge incorporated in the maps or models.
(2) Some of this knowledge can be obtained by observations of mean, variance, and covariance of sensory messages, and perhaps also by a method called “minimum entropy coding.
” (3) Such knowledge may be incorporated in a model of “what usually happens” with which incoming messages are automatically compared, enabling unexpected discrepancies to be immediately identified.
(4) Knowledge of the sort incorporated into such a filter is a necessary prerequisite of ordinary learning, and a representation whose elements are independent makes it possible to form associations with logical functions of the elements, not just with the elements themselves.
Related Results
Phenotype to genotype mapping using supervised and unsupervised learning
Phenotype to genotype mapping using supervised and unsupervised learning
AbstractThe relationship between the genotype, the genetic instructions encoded into a genome, and phenotype, the macroscopic realization of such instructions, remains mostly uncha...
Intercultural Competence Development Among University Students From a Self-Regulated Learning Perspective
Intercultural Competence Development Among University Students From a Self-Regulated Learning Perspective
Abstract. Intercultural competence is defined as a lifelong learning task that can be developed in any intergroup situation. A self-regulated learning model is applied to better un...
Graphic Design for Children with Learning Disabilities Based on the Isaan Mural Painting
Graphic Design for Children with Learning Disabilities Based on the Isaan Mural Painting
The study of 'Graphic design for children with learning disabilities' is a study that delves into learning-disabled children in the Isaan region. The author used the survey to form...
PENINGKATAN AKTIVITAS DAN HASIL BELAJAR MELALUI METODE JIGSAW
PENINGKATAN AKTIVITAS DAN HASIL BELAJAR MELALUI METODE JIGSAW
This study aimed to determine the effect of the use of jigsaw cooperative learning on the activeness and learning outcomes of Civics learning in class VIII.1 SMP Negeri 2 Sungayang...
Nurses’ Lifelong-Learning Tendencies and Their Attitudes Toward Distance Education: A Sample of Turkey
Nurses’ Lifelong-Learning Tendencies and Their Attitudes Toward Distance Education: A Sample of Turkey
Little is known about nurses’ viewpoints, experience, and opinions regarding this issue even though lifelong learning and distance education are of great importance in nursing. It ...
Redesigning Assessment for Holistic Learning
Redesigning Assessment for Holistic Learning
This paper discusses the importance of holistic assessment in the teaching and learning process at all levels of education, both in schools and in higher education institutions. Re...
Learning with ANIMA
Learning with ANIMA
The paper develops a semi-formal model of learning which modifies the traditional paradigm of artificial neural networks, implementing deep learning by means of a key insight borro...
Think, Pair, Freeze: The Association between Social Anxiety and Student Discomfort in the Active Learning Environment
Think, Pair, Freeze: The Association between Social Anxiety and Student Discomfort in the Active Learning Environment
Active learning instructional techniques, often characterized by paired or small group work (e.g., problem solving, discussion), are typically associated with improved student perf...
Recent Results
Urban Patterns in Pre-Safavid Isfahan
Urban Patterns in Pre-Safavid Isfahan
The splendour of Safavid Isfahan is no doubt proverbial. The landmarks that come to mind--the great Maydān-i Shāh with its stage perpetually set, the elegant Chahār Bāgh avenue, th...
Mode coupling and scattering in a submarine canyon environment
Mode coupling and scattering in a submarine canyon environment
Acoustic propagation in a realistic ocean environment based on the Hudson Canyon is computed using an Omnidirectional Coupled Mode (OCM) and a 3-D Parabolic Equation (3DPE) approac...
„Man vergilt einem Lehrer schlecht, wenn man immer nur der Schüler bleibt“: Ein neuer Blick auf Gasts Verhältnis zu Nietzsche
„Man vergilt einem Lehrer schlecht, wenn man immer nur der Schüler bleibt“: Ein neuer Blick auf Gasts Verhältnis zu Nietzsche
Abstract
“One repays a teacher poorly, if one always remains only a student”: A New Look at Gast’s Relation to Nietzsche. It is widely known that Heinrich Köselitz (...
Unified Islamic Calendar in the Perspective of Islamic Legal Philosophy
Unified Islamic Calendar in the Perspective of Islamic Legal Philosophy
This paper discusses the principles of unified Islamic calendar in the perspective of Uṣūl al-Fiqh. It answers questions about the possibility of applying the theory of maqāṣid al-...