2024 ICML ICML 2024

QuIP$#$: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks