ULTRAFEEDBACK: Boosting Language Models with Scaled AI Feedback

Ganqu Cui , Lifan Yuan , Ning Ding , Guanming Yao , Bingxiang He , Wei Zhu , Yuan Ni , Guotong Xie , Ruobing Xie , Yankai Lin , Zhiyuan Liu , Maosong Sun