Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers. - Gavia Gray; Aman Tiwari; Shane Bergsma; Joel Hestness (NeurIPS, 2024)