Improving Reward Models with Proximal Policy Exploration for Preference-Based Reinforcement Learning - Zhu, Yiwen; Liu, Jinyi; Gu, Pengjie; Yuan, Yifu; Ge, Zhenxing; Wei, Wenya; Fang, Zhou; Hu, Yujing; An, Bo (Advances in Neural Information Processing Systems, 2025)