Ladder-Residual: Parallelism-Aware Architecture for Accelerating Large Model Inference with Communication Overlapping

Muru Zhang , Mayank Mishra , Zhongzhu Zhou , William Brandon , Jue Wang , Yoon Kim , Jonathan Ragan-Kelley , Shuaiwen Leon Song , Ben Athiwaratkun , Tri Dao

Machine Learning > Application Areas > Efficient Computing Deep Learning > Techniques > Model Architecture

model architecture efficient inference model parallelism distributed computing