Madhu Advani

According to our database, Madhu Advani authored at least 12 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

How JEPA Avoids Noisy Features: The Implicit Bias of Deep Linear Self Distillation Networks.

Etai Littwin, Omid Saremi, Madhu Advani, Vimal Thilak, Preetum Nakkiran, Chen Huang, Joshua M. Susskind

CoRR, 2024

Step-by-Step Diffusion: An Elementary Tutorial.

Preetum Nakkiran, Arwen Bradley, Hattie Zhou, Madhu Advani

CoRR, 2024

2020

High-dimensional dynamics of generalization error in neural networks.

Madhu S. Advani, Andrew M. Saxe, Haim Sompolinsky

Neural Networks, 2020

A new role for circuit expansion for learning in neural networks.

Julia Steinberg, Madhu Advani, Haim Sompolinsky

CoRR, 2020

2019

Dimensionality compression and expansion in Deep Neural Networks.

Stefano Recanatesi, Matthew Farrell, Madhu Advani, Timothy Moore, Guillaume Lajoie, Eric Shea-Brown

CoRR, 2019

Generalisation dynamics of online learning in over-parameterised neural networks.

Sebastian Goldt, Madhu S. Advani, Andrew M. Saxe, Florent Krzakala, Lenka Zdeborová

CoRR, 2019

Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup.

Sebastian Goldt, Madhu Advani, Andrew M. Saxe, Florent Krzakala, Lenka Zdeborová

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

2018

Minnorm training: an algorithm for training over-parameterized deep neural networks.

Yamini Bansal, Madhu Advani, David D. Cox, Andrew M. Saxe

CoRR, 2018

Energy-entropy competition and the effectiveness of stochastic gradient descent in machine learning.

Yao Zhang, Andrew M. Saxe, Madhu S. Advani, Alpha A. Lee

CoRR, 2018

On the Information Bottleneck Theory of Deep Learning.

Andrew M. Saxe, Yamini Bansal, Joel Dapello, Madhu Advani, Artemy Kolchinsky, Brendan D. Tracey, David D. Cox

Proceedings of the 6th International Conference on Learning Representations, 2018

2017

High-dimensional dynamics of generalization error in neural networks.

Madhu S. Advani, Andrew M. Saxe

CoRR, 2017

2016

An equivalence between high dimensional Bayes optimal inference and M-estimation.

Madhu Advani, Surya Ganguli

Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, 2016