Announcement_4

Our paper Measuring Progress in Diffusion Language Model Pretraining has been accepted at the NeurIPS 2026 BeNTo workshop! We propose a protocol to check which metrics reliably track progress during diffusion language model pretraining, and release an open-source speedrun built around downstream HellaSwag accuracy.