← Back to papers
2012 AISTATS AISTATS 2012

CorrLog: Correlated Logistic Models for Joint Prediction of Multiple Labels

Abstract

In this paper, we present a simple but effective method for multi-label classification (MLC), termed Correlated Logistic Models (Corrlog), which extends multiple Independent Logistic Regressions (ILRs) by modeling the pairwise correlation between labels. Algorithmically, we propose an efficient method for learning parameters of Corrlog, which is based on regularized maximum pseudo-likelihood estimation and has a linear computational complexity with respect to the number of labels. Theoretically, we show that Corrlog enjoys a satisfying generalization bound which is independent of the number of labels. The effectiveness of Corrlog on modeling label correlations is illustrated by a toy example, and further experiments on real data show that Corrlog achieves competitive performance compared with popular MLC algorithms.

🧭 Keyword Pioneer — label correlation
🐣 Hot Topic Early Bird — generalization bound
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Data Science & Analytics, Deep Learning, Healthcare & Medicine, Interdisciplinary, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Speech & Audio
📈 Trend Setter — Multi-Label Classification

Authors

Wei Bian , Bo Xie , Dacheng Tao

Topics

Machine Learning > Core Methods > Classification Machine Learning > Optimization & Theory > Statistical Learning Machine Learning > Learning Types > Multi-Label Classification Machine Learning > Learning Types > Multi-Label Learning Machine Learning > Core Methods > Multi-Label Classification

Keywords

logistic regression multi-label classification generalization bound label correlation correlated logistic model maximum pseudo-likelihood estimation pairwise correlation
Download PDF

Related papers

Minimax rates for homology inference 2012
Scalable Personalization of Long-Term Physiological Monitoring: Active Learning Methodologies for Epileptic Seizure Onset Detection 2012
Adaptive Metropolis with Online Relabeling 2012
Joint Learning of Words and Meaning Representations for Open-Text Semantic Parsing 2012
Bayesian regularization of non-homogeneous dynamic Bayesian networks by globally coupling interaction parameters 2012