Nikhil Ghosh

According to our database, Nikhil Ghosh authored at least 13 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

The Impact of Initialization on LoRA Finetuning Dynamics.

Soufiane Hayou, Nikhil Ghosh, Bin Yu

CoRR, 2024

LoRA+: Efficient Low Rank Adaptation of Large Models.

Soufiane Hayou, Nikhil Ghosh, Bin Yu

Proceedings of the Forty-first International Conference on Machine Learning, 2024

More is Better: when Infinite Overparameterization is Optimal and Overfitting is Obligatory.

James B. Simon, Dhruva Karkada, Nikhil Ghosh, Mikhail Belkin

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors.

Nikhil Ghosh, Mikhail Belkin

SIAM J. Math. Data Sci., December, 2023

More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory.

James B. Simon, Dhruva Karkada, Nikhil Ghosh, Mikhail Belkin

CoRR, 2023

The Effect of SGD Batch Size on Autoencoder Learning: Sparsity, Sharpness, and Feature Learning.

Nikhil Ghosh, Spencer Frei, Wooseok Ha, Bin Yu

CoRR, 2023

The Power of External Memory in Increasing Predictive Model Capacity.

Cenk Baykal, Dylan J. Cutler, Nishanth Dikkala, Nikhil Ghosh, Rina Panigrahy, Xin Wang

CoRR, 2023

Alternating Updates for Efficient Transformers.

Cenk Baykal, Dylan J. Cutler, Nishanth Dikkala, Nikhil Ghosh, Rina Panigrahy, Xin Wang

CoRR, 2023

Alternating Updates for Efficient Transformers.

Cenk Baykal, Dylan J. Cutler, Nishanth Dikkala, Nikhil Ghosh, Rina Panigrahy, Xin Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Deconstructing Distributions: A Pointwise Framework of Learning.

Gal Kaplun, Nikhil Ghosh, Saurabh Garg, Boaz Barak, Preetum Nakkiran

Proceedings of the Eleventh International Conference on Learning Representations, 2023

On the Benefits of Learning to Route in Mixture-of-Experts Models.

Nishanth Dikkala, Nikhil Ghosh, Raghu Meka, Rina Panigrahy, Nikhil Vyas, Xin Wang

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

The Three Stages of Learning Dynamics in High-dimensional Kernel Methods.

Nikhil Ghosh, Song Mei, Bin Yu

Proceedings of the Tenth International Conference on Learning Representations, 2022

2019

Landmark Ordinal Embedding.

Nikhil Ghosh, Yuxin Chen, Yisong Yue

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019