The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text - Kandpal, Nikhil; Lester, Brian; Raffel, Colin; Majstorovic, Sebastian; Biderman, Stella; Abbasi, Baber; Soldaini, Luca; Shippole, Enrico; Cooper, A. Feder; Skowron, Aviya; Longpre, Shayne; Sutawika, Lintang; et al. (Advances in Neural Information Processing Systems, 2025)