EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism

Yanxi Chen , Xuchen Pan , Yaliang Li , Bolin Ding , Jingren Zhou