2010
NIPS
NeurIPS 2010
On Herding and the Perceptron Cycling Theorem
Abstract
The paper develops a connection between traditional perceptron algorithms and recently introduced herding algorithms. It is shown that both algorithms can be viewed as an application of the perceptron cycling theorem. This connection strengthens some herding results and suggests new (supervised) herding algorithms that, like CRFs or discriminative RBMs, make predictions by conditioning on the input attributes. We develop and investigate variants of conditional herding, and show that conditional herding leads to practical algorithms that perform better than or on par with related classifiers such as the voted perceptron and the discriminative RBM.
📈
Trend Setter
— Self-Supervised Learning
🧭
Keyword Pioneer
— herding algorithm
🐝
Cross-Pollinator
— Artificial Intelligence, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Robotics, Speech & Audio
🌉
Interdisciplinary Bridge
— Deep Learning and Machine Learning
🐣
Hot Topic Early Bird
— feature learning
Authors
Topics
Machine Learning > Core Methods > Classification
Machine Learning > Learning Types > Self-Supervised Learning
Machine Learning > Optimization & Theory > Learning Theory
Deep Learning > Architectures > Neural Networks
Machine Learning > Learning Paradigms > Meta-Learning
Machine Learning > Learning Types > Classification
Machine Learning > Core Methods > Optimization