Abstract
Computational properties of use of biological organisms or to the construction of computers can emerge as collective properties of systems having a large number of simple equivalent components (or neurons). The physical meaning of content-addressable memory is described by an appropriate phase space flow of the state of a system. A model of such a system is given, based on aspects of neurobiology but readily adapted to integrated circuits. The collective properties of this model produce a content-addressable memory which correctly yields an entire memory from any subpart of sufficient size. The algorithm for the time evolution of the state of the system is based on asynchronous parallel processing. Additional emergent collective properties include some capacity for generalization, familiarity recognition, categorization, error correction, and time sequence retention. The collective properties are only weakly sensitive to details of the modeling or the failure of individual devices.
Keywords
Computer scienceAsynchronous communicationCollective behaviorGeneralizationSimple (philosophy)CategorizationContent-addressable memoryNeural systemArtificial neural networkPhysical systemState spaceMeaning (existential)Theoretical computer scienceArtificial intelligenceCognitive scienceNeurosciencePsychology
MeSH Terms
AnimalsComputersMathematicsMemoryModelsNeurologicalNeurons
Related Publications
Neurons with graded response have collective computational properties like those of two-state neurons.
A model for a large network of "neurons" with a graded response (or sigmoid input-output relation) is studied. This deterministic system has collective properties in very close ...
Bidirectional associative memories
Stability and encoding properties of two-layer nonlinear feedback neural networks are examined. Bidirectionality is introduced in neural nets to produce two-way associative sear...
Holographic reduced representations
Associative memories are conventionally used to represent data with very simple structure: sets of pairs of vectors. This paper describes a method for representing more complex ...
Generalization of Back propagation to Recurrent and Higher Order Neural Networks
A general method for deriving backpropagation algorithms for networks with recurrent and higher order networks is introduced. The propagation of activation in these networks is ...
Stability Analysis of Social Foraging Swarms
In this article we specify an M-member "individual-based" continuous time swarm model with individuals that move in an n-dimensional space according to an attractant/repellent o...
Publication Info
- Year
- 1982
- Type
- article
- Volume
- 79
- Issue
- 8
- Pages
- 2554-2558
- Citations
- 18877
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
18877
OpenAlex
951
Influential
Cite This
J. J. Hopfield
(1982).
Neural networks and physical systems with emergent collective computational abilities..
Proceedings of the National Academy of Sciences
, 79
(8)
, 2554-2558.
https://doi.org/10.1073/pnas.79.8.2554
Identifiers
- DOI
- 10.1073/pnas.79.8.2554
- PMID
- 6953413
- PMCID
- PMC346238