Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training - Kosson, Atli; Messmer, Bettina; Jaggi, Martin (Advances in Neural Information Processing Systems, 2024)