Bifurcated Attention for Single-Context Large-Batch Sampling

Ben Athiwaratkun , Sujan Kumar Gonugondla , Sanjay Krishna Gouda , Haifeng Qian , Hantian Ding , Qing Sun , Jun Wang , Jiacheng Guo , Liangfu Chen , Parminder Bhatia , Ramesh Nallapati , Sudipta Sengupta , Bing Xiang