Dayal Singh Kalra

According to our database, Dayal Singh Kalra authored at least 4 papers between 2023 and 2024.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of five.

2024

Why Warmup the Learning Rate? Underlying Mechanisms and Improvements.

Dayal Singh Kalra, Maissam Barkeshli

CoRR, 2024

2023

Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos.

Dayal Singh Kalra, Tianyu He, Maissam Barkeshli

CoRR, 2023

Phase diagram of training dynamics in deep neural networks: effect of learning rate, depth, and width.

Dayal Singh Kalra, Maissam Barkeshli

CoRR, 2023

Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width.

Dayal Singh Kalra, Maissam Barkeshli

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023