Puzzle: Distillation-Based NAS for Inference-Optimized LLMs

Akhiad Bercovich , Tomer Ronen , Talor Abramovich , Nir Ailon , Nave Assaf , Mohammed Dabbah , Ido Galil , Amnon Geifman , Yonatan Geifman , Izhak Golan , Netanel Haber , Ehud Dov Karpas , Roi Koren , Itay Levy , Pavlo Molchanov , Shahar Mor , Zach Moshe , Najeeb Nabwani , Omri Puny , Ran Rubin , Itamar Schen , Ido Shahaf , Oren Tropp , Omer Ullman Argov , Ran Zilberstein , Ran El-Yaniv