Larger or Smaller Reward Margins to Select Preferences for LLM Alignment?

Kexin Huang , Junkang Wu , Ziqian Chen , xue wang , Jinyang Gao , Bolin Ding , Jiancan Wu , Xiangnan He , Xiang Wang