2008
NIPS
NeurIPS 2008
Sparse probabilistic projections
Abstract
We present a generative model for performing sparse probabilistic projections, which includes sparse principal component analysis and sparse canonical correlation analysis as special cases. Sparsity is enforced by means of automatic relevance determination or by imposing appropriate prior distributions, such as generalised hyperbolic distributions. We derive a variational Expectation-Maximisation algorithm for the estimation of the hyperparameters and show that our novel probabilistic approach compares favourably to existing techniques. We illustrate how the proposed method can be applied in the context of cryptoanalysis as a pre-processing tool for the construction of template attacks.
🌉
Interdisciplinary Bridge
— Artificial Intelligence and Deep Learning and Machine Learning
📈
Trend Setter
— Variational Inference
🧭
Keyword Pioneer
— sparse probabilistic projections
🐣
Hot Topic Early Bird
— variational inference
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Speech & Audio
Authors
Topics
Artificial Intelligence > Bayesian & Probabilistic > Probabilistic Modeling
Machine Learning > Core Methods > Representation Learning
Deep Learning > Models > Variational Inference
Machine Learning > Bayesian & Probabilistic > Probabilistic Modeling
Machine Learning > Core Methods > Dimensionality Reduction
Machine Learning > Bayesian & Probabilistic > Variational Inference
Keywords
probabilistic modeling
variational inference
principal component analysis
sparse principal component analysis
automatic relevance determination
canonical correlation analysis
sparse probabilistic projections
generative model
probabilistic model
sparse projection
variational expectation-maximization
probabilistic projection