TU Berlin

Neural Information ProcessingAll Publications

Neuronale Informationsverarbeitung

Page Content

to Navigation

All Publications

Structured Models from Structured Data: Emergence of Modular Information Processing within One Sheet of Neurons
Citation key Weber2000
Author Weber, C. and Obermayer, K.
Title of Book Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks
Pages 608 – 613
Year 2000
ISBN 0-7695-0619-4
ISSN 1098-7576
DOI 10.1109/IJCNN.2000.860838
Volume IV
Publisher IEEE
Abstract In our contribution we investigate how structured information processing within a neural net can emerge as a result of unsupervised learning from data. Our model consists of input neurons and hidden neurons which are recurrently connected and which represent the thalamus and the cortex, respectively. On the basis of a maximum likelihood framework the task is to generate given input data using the code of the hidden units. Hidden neurons are fully connected allowing for different roles to play within the unfolding time-dynamics of this data generation process. One parameter which is related to the sparsity of neuronal activation varies across the hidden neurons. As a result of training the net captures the structure of the data generation process. Trained on data which are generated by different mechanisms acting in parallel, the more active neurons will code for the more frequent input features. Trained on hierarchically generated data, the more active neurons will code on the higher level where each feature integrates several lower level features. The results imply that the division of the cortex into laterally and hierarchically organized areas can evolve to a certain degree as an adaptation to the environment.
Link to publication Link to original publication Download Bibtex entry


Quick Access

Schnellnavigation zur Seite über Nummerneingabe