Hierarchical neural networks for the storage of correlated memories

Deshpande, Varsha ; Dasgupta, Chandan (1991) Hierarchical neural networks for the storage of correlated memories Journal of Statistical Physics, 64 (3-4). pp. 755-779. ISSN 0022-4715

Full text not available from this repository.

Official URL: http://www.springerlink.com/content/n802t72454k030...

Related URL: http://dx.doi.org/10.1007/BF01048314


A class of hierarchical neural network models introduced by Dotsenko for the storage and associative recall of strongly correlated memories is studied analytically and numerically. In these models, patterns stored in higher levels of the hierarchy represent generalized categories and those stored in lower levels describe finer details. We first show that the models originally proposed by Dotsenko have a serious flaw: they are not able to detect or correct errors in categorization which may be present in the input. We then describe three different models which attempt to overcome this shortcoming of the original models. In the first model, the interaction between different levels of the hierarchy has the form of an external field conjugate to memories stored in the lower level. In the second model, a three-spin interaction term is included in addition to the usual binary interactions of the Hopfield type. The third model makes use of a time delay mechanism to induce, if necessary, transitions between memory states and their complements. Detailed analytical and numerical studies of the performance of these models are presented. Our analysis shows that all three models are able to detect and also to correct in varying degrees any error in categorization that may be present in the input pattern.

Item Type:Article
Source:Copyright of this article belongs to Springer-Verlag.
Keywords:Neural Networks; Associative Memory; Hierarchically Correlated Patterns; Statistical Mechanics of Ising Systems; Replica Formalism; Numerical Simulation
ID Code:22876
Deposited On:25 Nov 2010 13:55
Last Modified:07 Feb 2011 05:32

Repository Staff Only: item control page