← Learning Types
Machine Learning › Learning Types ›

Sparse Learning

135 directly classified papers

Papers per year

Papers

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention ACL 2025
Measuring Progress in Dictionary Learning for Language Model Interpretability with Board Game Models NIPS 2024
How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective NIPS 2024
Solving Sparse \& High-Dimensional-Output Regression via Compression NIPS 2024
Breaking ReLU Barrier: Generalized MoEfication for Dense Pretrained Models EMNLP 2024
Improving Decision Sparsity NIPS 2024
XMoE: Sparse Models with Fine-grained and Adaptive Expert Selection ACL 2024
Sparse maximal update parameterization: A holistic approach to sparse training dynamics NIPS 2024
Symmetry-Informed Governing Equation Discovery NIPS 2024
UltraSparseBERT: 99% Conditionally Sparse Language Modelling ACL 2024
Sparse Parameterization for Epitomic Dataset Distillation NIPS 2023
Sparse Low-rank Adaptation of Pre-trained Language Models EMNLP 2023
L0Learn: A Scalable Package for Sparse Learning using L0 Regularization JMLR 2023
Feature Adaptation for Sparse Linear Regression NIPS 2023
Acceleration in Distributed Sparse Regression NIPS 2022
Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks NIPS 2022
Contrastive Dual Gating: Learning Sparse Features With Contrastive Learning CVPR 2022
Get More at Once: Alternating Sparse Training with Gradient Correction NIPS 2022
Sparse Structure Learning via Graph Neural Networks for Inductive Document Classification AAAI 2022
Early-Bird GCNs: Graph-Network Co-optimization towards More Efficient GCN Training and Inference via Drawing Early-Bird Lottery Tickets AAAI 2022
Learning the Structure of Large Networked Systems Obeying Conservation Laws NIPS 2022
Sparse Winning Tickets are Data-Efficient Image Recognizers NIPS 2022
Information Directed Sampling for Sparse Linear Bandits NIPS 2021
Efficient Neural Network Training via Forward and Backward Propagation Sparsification NIPS 2021
The Lottery Ticket Hypothesis for Object Recognition CVPR 2021