Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo - Charles, Zachary; Teston, Gabriel; Dery, Lucio; Rush, John; Fallen, Nova; Garrett, Zachary; Szlam, Arthur; Douillard, Arthur (Advances in Neural Information Processing Systems, 2025)