Abstract
A new conceptual framework and a minimization principle together provide an understanding of computation in model neural circuits. The circuits consist of nonlinear graded-response model neurons organized into networks with effectively symmetric synaptic connections. The neurons represent an approximation to biological neurons in which a simplified set of important computational properties is retained. Complex circuits solving problems similar to those essential in biology can be analyzed and understood without the need to follow the circuit dynamics in detail. Implementation of the model with electronic devices will provide a class of electronic circuits of novel form and function.
Keywords
Electronic circuitComputer scienceBiological neural networkComputationNonlinear systemArtificial neural networkClass (philosophy)Set (abstract data type)Function (biology)Topology (electrical circuits)Theoretical computer scienceAlgorithmArtificial intelligenceMathematicsPhysicsMachine learningBiologyElectrical engineeringEngineering
Affiliated Institutions
Related Publications
Neurons with graded response have collective computational properties like those of two-state neurons.
A model for a large network of "neurons" with a graded response (or sigmoid input-output relation) is studied. This deterministic system has collective properties in very close ...
Generalization of back-propagation to recurrent neural networks
An adaptive neural network with asymmetric connections is introduced. This network is related to the Hopfield network with graded neurons and uses a recurrent generalization of ...
Neural computation by concentrating information in time.
An analog model neural network that can solve a general problem of recognizing patterns in a time-dependent signal is presented. The networks use a patterned set of delays to co...
Deep Sparse Rectifier Neural Networks
While logistic sigmoid neurons are more biologically plausible than hyperbolic tangent neurons, the latter work better for training multi-layer neural networks. This paper shows...
ACTIVATION FUNCTIONS IN NEURAL NETWORKS
Artificial Neural Networks are inspired from the human brain and the network of neurons present in the brain.The information is processed and passed on from one neuron to anothe...
Publication Info
- Year
- 1986
- Type
- article
- Volume
- 233
- Issue
- 4764
- Pages
- 625-633
- Citations
- 2107
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
2107
OpenAlex
Cite This
J. J. Hopfield,
David W. Tank
(1986).
Computing with Neural Circuits: A Model.
Science
, 233
(4764)
, 625-633.
https://doi.org/10.1126/science.3755256
Identifiers
- DOI
- 10.1126/science.3755256