Distortion of AI Alignment: Does Preference Optimization Optimize for Preferences? - Gölz, Paul; Haghtalab, Nika; Yang, Kunhe (Advances in Neural Information Processing Systems, 2025)