2025 ICML ICML 2025

Energy-Based Preference Model Offers Better Offline Alignment than the Bradley-Terry Preference Model