Sam Shleifer

According to our database, Sam Shleifer authored at least 18 papers between 2019 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Pritam Damania, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Ajit Mathews, Shen Li

Proc. VLDB Endow., 2023

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Shen Li

CoRR, 2023

2022

OPT: Open Pre-trained Transformer Language Models.

Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona T. Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer

CoRR, 2022

Efficient Language Modeling with Sparse all-MLP.

Ping Yu, Mikel Artetxe, Myle Ott, Sam Shleifer, Hongyu Gong, Ves Stoyanov, Xian Li

CoRR, 2022

8-bit Optimizers via Block-wise Quantization.

Tim Dettmers, Mike Lewis, Sam Shleifer, Luke Zettlemoyer

Proceedings of the Tenth International Conference on Learning Representations, 2022

Few-shot Learning with Multilingual Generative Language Models.

Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Efficient Large Scale Language Modeling with Mixtures of Experts.

Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giridharan Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeffrey Wang, Luke Zettlemoyer, Mona T. Diab, Zornitsa Kozareva, Veselin Stoyanov

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

Automated coronary calcium scoring using deep learning with multicenter external validation.

David Eng, Christopher Chute, Nishith Khandwala, Pranav Rajpurkar, Jin Long, Sam Shleifer, Mohamed H. Khalaf, Alexander T. Sandhu, Fátima Rodriguez, David J. Maron, Saeed Seyyedi, Daniele Marin, Ilana Golub, Matthew J. Budoff, Felipe Kitamura, Marcelo Straus Takahashi, Ross W. Filice, Rajesh Shah, John Mongan, Kimberly Kallianos, Curtis P. Langlotz, Matthew P. Lungren, Andrew Y. Ng, Bhavik N. Patel

npj Digit. Medicine, 2021

Efficient Large Scale Language Modeling with Mixtures of Experts.

Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Mona T. Diab, Zornitsa Kozareva, Ves Stoyanov

CoRR, 2021

Few-shot Learning with Multilingual Language Models.

Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li

CoRR, 2021

NormFormer: Improved Transformer Pretraining with Extra Normalization.

Sam Shleifer, Jason Weston, Myle Ott

CoRR, 2021

2020

Pre-trained Summarization Distillation.

Sam Shleifer, Alexander M. Rush

CoRR, 2020

Transformers: State-of-the-Art Natural Language Processing.

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander M. Rush

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, 2020

2019

Incrementally Improving Graph WaveNet Performance on Traffic Prediction.

Sam Shleifer, Clara McCreery, Vamsi Chitters

CoRR, 2019

Classification as Decoder: Trading Flexibility for Control in Medical Dialogue.

Sam Shleifer, Manish Chablani, Anitha Kannan, Namit Katariya, Xavier Amatriain

CoRR, 2019

Classification As Decoder: Trading Flexibility For Control In Neural Dialogue.

Sam Shleifer, Manish Chablani, Namit Katariya, Anitha Kannan, Xavier Amatriain

CoRR, 2019

Using Small Proxy Datasets to Accelerate Hyperparameter Search.

Sam Shleifer, Eric Prokop

CoRR, 2019

Low Resource Text Classification with ULMFit and Backtranslation.

Sam Shleifer

CoRR, 2019