Abstract
Internal models of the environment have an important role to play in adaptive systems, in general, and are of particular importance for the supervised learning paradigm. In this article we demonstrate that certain classical problems associated with the notion of the “teacher” in supervised learning can be solved by judicious use of learned internal models as components of the adaptive system. In particular, we show how supervised learning algorithms can be utilized in cases in which an unknown dynamical system intervenes between actions and desired outcomes. Our approach applies to any supervised learning algorithm that is capable of learning in multilayer networks.
Keywords
Computer scienceSupervised learningArtificial intelligenceMachine learningSemi-supervised learningInternal modelAdaptive learningUnsupervised learningArtificial neural network
Affiliated Institutions
Related Publications
Identification and control of dynamical systems using neural networks
It is demonstrated that neural networks can be used effectively for the identification and control of nonlinear dynamical systems. The emphasis is on models for both identificat...
Adaptive Mixtures of Local Experts
We present a new supervised learning procedure for systems composed of many separate networks, each of which learns to handle a subset of the complete set of training cases. The...
Semi-Supervised Classification of Network Data Using Very Few Labels
The goal of semi-supervised learning (SSL) methods is to reduce the amount of labeled training data required by learning from both labeled and unlabeled instances. Macskassy and...
Deterministic annealing for clustering, compression, classification, regression, and related optimization problems
The deterministic annealing approach to clustering and its extensions has demonstrated substantial performance improvement over standard supervised and unsupervised learning met...
Deep Sparse Rectifier Neural Networks
While logistic sigmoid neurons are more biologically plausible than hyperbolic tangent neurons, the latter work better for training multi-layer neural networks. This paper shows...
Publication Info
- Year
- 1992
- Type
- article
- Volume
- 16
- Issue
- 3
- Pages
- 307-354
- Citations
- 1458
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
1458
OpenAlex
Cite This
Michael I. Jordan,
David E. Rumelhart
(1992).
Forward Models: Supervised Learning with a Distal Teacher.
Cognitive Science
, 16
(3)
, 307-354.
https://doi.org/10.1207/s15516709cog1603_1
Identifiers
- DOI
- 10.1207/s15516709cog1603_1