← Back to papers
2024 UAI UAI 2024

Quantization of Large Language Models with an Overdetermined Basis

🌉 Interdisciplinary Bridge — Artificial Intelligence and Natural Language Processing
🐝 Cross-Pollinator — Artificial Intelligence, Computer Science, Computer Vision, Deep Learning, Healthcare & Medicine, Interdisciplinary, Knowledge & Reasoning, Machine Learning, Mathematics & Optimization, Natural Language Processing, Reinforcement Learning, Speech & Audio

Authors

Daniil Merkulov , Daria Cherniuk , Alexander Rudikov , Ivan Oseledets , Ekaterina Muravleva , Aleksandr Mikhalev , Boris Kashin

Topics

Artificial Intelligence > Core AI > Model Compression Natural Language Processing > Resources & Methods > Large Language Models

Keywords

neural network compression model quantization parameter efficient large language model
Download PDF

Related papers

Unified PAC-Bayesian Study of Pessimism for Offline Policy Learning with Regularized Importance Sampling 2024
Inference in Probabilistic Answer Set Programs with Imprecise Probabilities via Optimization 2024
Differentially Private No-regret Exploration in Adversarial Markov Decision Processes 2024
Linearly Constrained Gaussian Processes are SkewGPs: application to Monotonic Preference Learning and Desirability 2024
Adaptive Time-Stepping Schedules for Diffusion Models 2024