Mansheej Paul

According to our database, Mansheej Paul authored at least 9 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2024

Critique-out-Loud Reward Models.

Zachary Ankner, Mansheej Paul, Brandon Cui, Jonathan D. Chang, Prithviraj Ammanabrolu

CoRR, 2024

Does your data spark joy? Performance gains from domain upsampling at the end of training.

Cody Blakeney, Mansheej Paul, Brett W. Larsen, Sean Owen, Jonathan Frankle

CoRR, 2024

Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models.

Zachary Ankner, Cody Blakeney, Kartik Sreenivasan, Max Marion, Matthew L. Leavitt, Mansheej Paul

CoRR, 2024

LoRA Learns Less and Forgets Less.

Dan Biderman, Jose Javier Gonzalez Ortiz, Jacob Portes, Mansheej Paul, Philip Greengard, Connor Jennings, Daniel King, Sam Havens, Vitaliy Chiley, Jonathan Frankle, Cody Blakeney, John P. Cunningham

CoRR, 2024

2023

Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression.

Allan Raventós, Mansheej Paul, Feng Chen, Surya Ganguli

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask?

Mansheej Paul, Feng Chen, Brett W. Larsen, Jonathan Frankle, Surya Ganguli, Gintare Karolina Dziugaite

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks.

Mansheej Paul, Brett W. Larsen, Surya Ganguli, Jonathan Frankle, Gintare Karolina Dziugaite

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

2021

Deep Learning on a Data Diet: Finding Important Examples Early in Training.

Mansheej Paul, Surya Ganguli, Gintare Karolina Dziugaite

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

2020

Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel.

Stanislav Fort, Gintare Karolina Dziugaite, Mansheej Paul, Sepideh Kharaghani, Daniel M. Roy, Surya Ganguli

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020