Variational bayesian generative topographic mapping
Abstract
General finite mixture models are powerful tools for the density-based grouping of multivariate i.i.d. data, but they lack data visualization capabilities, which reduces their practical applicability to real-world problems. Generative topographic mapping (GTM) was originally formulated as a constrained mixture of distributions in order to provide simultaneous visualization and clustering of multivariate data. In its inception, the adaptive parameters were determined by maximum likelihood (ML), using the expectation-maximization (EM) algorithm. The original GTM is, therefore, prone to data overfitting unless a regularization mechanism is included. In this paper, we define an alternative variational formulation of GTM that provides a full Bayesian treatment to a Gaussian process (GP)-based variation of the model. The generalization capabilities of the proposed Variational Bayesian GTM are assessed in some detail and compared with those of alternative GTM regularization approaches in terms of test log-likelihood, using several artificial and real datasets.
Citation
(2008). Variational bayesian generative topographic mapping. Journal of Mathematical Modelling and Algorithms, 371 -387. https://doi.org/10.1007/s10852-008-9088-7
Acceptance Date | Jul 27, 2008 |
---|---|
Publication Date | Dec 1, 2008 |
Journal | Journal of Mathematical Modelling and Algorithms |
Print ISSN | 1570-1166 |
Publisher | Springer Verlag |
Pages | 371 -387 |
DOI | https://doi.org/10.1007/s10852-008-9088-7 |
Keywords | variational methods, generative topographic mapping, clustering, data visualization adaptive regularization, overfitting |
Publisher URL | http://dx.doi.org/10.1007/s10852-008-9088-7 |
Downloadable Citations
About Keele Repository
Administrator e-mail: research.openaccess@keele.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search