← Core Methods
Machine Learning › Core Methods ›

Model Compression

141 directly classified papers

Papers per year

Papers

RMT: Retentive Networks Meet Vision Transformers CVPR 2024
Attack To Defend: Exploiting Adversarial Attacks for Detecting Poisoned Models CVPR 2024
Attention-Driven Training-Free Efficiency Enhancement of Diffusion Models CVPR 2024
Initializing Variable-sized Vision Transformers from Learngene with Learnable Transformation NIPS 2024
Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization NIPS 2024
BMRS: Bayesian Model Reduction for Structured Pruning NIPS 2024
SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation NIPS 2024
Efficient Low-Dimensional Compression of Overparameterized Models AISTATS 2024
Practical Privacy-Preserving MLaaS: When Compressive Sensing Meets Generative Networks AAAI 2024
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models ACL 2024
SoftDedup: an Efficient Data Reweighting Method for Speeding Up Language Model Pre-training ACL 2024
LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation EMNLP 2024
Pruning Foundation Models for High Accuracy without Retraining EMNLP 2024
QEFT: Quantization for Efficient Fine-Tuning of LLMs EMNLP 2024
Extending Context Window of Large Language Models from a Distributional Perspective EMNLP 2024
Exploring Intrinsic Language-specific Subspaces in Fine-tuning Multilingual Neural Machine Translation EMNLP 2024
Tuning Stable Rank Shrinkage: Aiming at the Overlooked Structural Risk in Fine-tuning CVPR 2024
Layer-Adaptive State Pruning for Deep State Space Models NIPS 2024
Sparse maximal update parameterization: A holistic approach to sparse training dynamics NIPS 2024
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts NIPS 2024
DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models NIPS 2024
How Sparse Can We Prune A Deep Network: A Fundamental Limit Perspective NIPS 2024
Multi-Head Mixture-of-Experts NIPS 2024
Turning Dust into Gold: Distilling Complex Reasoning Capabilities from LLMs by Leveraging Negative Data AAAI 2024
Generalizability of Mixture of Domain-Specific Adapters from the Lens of Signed Weight Directions and its Application to Effective Model Pruning ACL 2024