← Back to papers
2024 ICML ICML 2024

Junk DNA Hypothesis: Pruning Small Pre-Trained Weights $\textitIrreversibly$ and $\textitMonotonically$ Impairs “Difficult" Downstream Tasks in LLMs

Authors

Lu Yin , Ajay Kumar Jaiswal , Shiwei Liu , Souvik Kundu , Zhangyang Wang
Download PDF

Related papers

Learning Latent Dynamic Robust Representations for World Models 2024
Beyond Individual Input for Deep Anomaly Detection on Tabular Data 2024
Risk Estimation in a Markov Cost Process: Lower and Upper Bounds 2024
Collapse-Aware Triplet Decoupling for Adversarially Robust Image Retrieval 2024
Ranking-based Client Imitation Selection for Efficient Federated Learning 2024