Inhalt des Dokuments
All Publications
| Citation key | Graepel1997a |
|---|---|
| Author | Graepel, T. and Burger, M. and Obermayer, K. |
| Title of Book | Proceedings of the Workshop on Self-Organizing Maps - WSOM 97 |
| Pages | 345 – 350 |
| Year | 1997 |
| Editor | T. Kohonen |
| Abstract | We have developed a robust optimization scheme for self-organizing maps in the framework of noisy vector quantization. Based on a cost function that takes distortions from channel noise into account we derive a fuzzy algorithm of EM-type for topographic vector quantization (STVQ) which employs deterministic annealing. This annealing process leads to phase transitions in the cluster representation for which we are able to calculate critical modes and temperatures as a function of the neighbourhood function and the covariance matrix of the data. Similar results are obtained for the automatic selection of feature dimensions. Deterministic annealing also offers an alternative to the heuristic stepwise shrinking of the neighbourhood width in the SOM and makes it possible to use the neighbourhood solely to encode desired neighbourhood relations between the clusters. A soft version of the SOM (SSOM) is derived as a computationally efficient approximation to the E-step of STVQ. Both methods are numerically tested on a two-dimensional map of the plane and we conclude that the temperature annealing can be precisely controlled and could for many applications be the method of choice. We have developed a robust optimization scheme for self-organizing maps in the framework of noisy vector quantization. Based on a cost function that takes distortions from channel noise into account we derive a fuzzy algorithm of EM-type for topographic vector quantization (STVQ) which employs deterministic annealing. This annealing process leads to phase transitions in the cluster representation for which we are able to calculate critical modes and temperatures as a function of the neighbourhood function and the covariance matrix of the data. Similar results are obtained for the automatic selection of feature dimensions. Deterministic annealing also offers an alternative to the heuristic stepwise shrinking of the neighbourhood width in the SOM and makes it possible to use the neighbourhood solely to encode desired neighbourhood relations between the clusters. A soft version of the SOM (SSOM) is derived as a computationally efficient approximation to the E-step of STVQ. Both methods are numerically tested on a two-dimensional map of the plane and we conclude that the temperature annealing can be precisely controlled and could for many applications be the method of choice. |
Back [4]
/graepel97_wsom_stvq.ps.gz
0.1.1.27.7563&rep=rep1&type=ps
publications/?no_cache=1&tx_sibibtex_pi1%5Bdownload
_bibtex_uid%5D=1166566&tx_sibibtex_pi1%5Bcontentele
ment%5D=tt_content%3A310710
publications/
Zusatzinformationen / Extras
Quick Access:
Schnellnavigation zur Seite über Nummerneingabe
Auxiliary Functions
Copyright TU Berlin 2008