Abstract
Stability and encoding properties of two-layer nonlinear feedback neural networks are examined. Bidirectionality is introduced in neural nets to produce two-way associative search for stored associations. The bidirectional associative memory (BAM) is the minimal two-layer nonlinear feedback network. The author proves that every n-by-p matrix M is a bidirectionally stable heteroassociative content-addressable memory for both binary/bipolar and continuous neurons. When the BAM neutrons are activated, the network quickly evolves to a stable state of two-pattern reverberation, or resonance. The stable reverberation corresponds to a system energy local minimum. Heteroassociative information is encoded in a BAM by summing correlation matrices. The BAM storage capacity for reliable recall is roughly m<min (n,p). It is also shown that it is better on average to use bipolar (-1,1) coding than binary
Keywords
Bidirectional associative memoryContent-addressable memoryAssociative propertyEncoding (memory)Artificial neural networkComputer scienceCoding (social sciences)Binary numberContent-addressable storageStability (learning theory)ReverberationNonlinear systemTopology (electrical circuits)MathematicsArtificial intelligenceArithmeticPhysicsAcousticsCombinatoricsPure mathematics
Affiliated Institutions
Related Publications
A Fast Learning Algorithm for Deep Belief Nets
We show how to use “complementary priors” to eliminate the explaining-away effects that make inference difficult in densely connected belief nets that have many hidden layers. U...
Self-organisation: a derivation from first principles of a class of learning algorithms
A novel derivation of T. Kohonen's topographic mapping learning algorithm (Self-Organization and Associative Memory, Springer-Verlag, 1984) is presented. Thus the author prescri...
Neural networks and physical systems with emergent collective computational abilities.
Computational properties of use of biological organisms or to the construction of computers can emerge as collective properties of systems having a large number of simple equiva...
Words in the brain's language
If the cortex is an associative memory, strongly connected cell assemblies will form when neurons in different cortical areas are frequently active at the same time. The cortica...
How Does Acoustic Similarity Influence Short-Term Memory?
This study attempts to discover why items which are similar in sound are hard to recall in a short-term memory situation. The input, storage, and retrieval stages of the memory ...
Publication Info
- Year
- 1988
- Type
- article
- Volume
- 18
- Issue
- 1
- Pages
- 49-60
- Citations
- 2039
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
2039
OpenAlex
Cite This
Bart Kosko
(1988).
Bidirectional associative memories.
IEEE Transactions on Systems Man and Cybernetics
, 18
(1)
, 49-60.
https://doi.org/10.1109/21.87054
Identifiers
- DOI
- 10.1109/21.87054