Abhinav Venigalla

According to our database, Abhinav Venigalla authored at least 5 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text.

Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, David Hall, Betty Xiong, Tony Lee, Roxana Daneshjou, Jonathan Frankle, Percy Liang, Michael Carbin, Christopher D. Manning

CoRR, 2024

2023

MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining.

Jacob Portes, Alexander Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2021

Representation range needs for 16-bit neural network training.

Valentina Popescu, Abhinav Venigalla, Di Wu, Robert Schreiber

CoRR, 2021

Pipelined Backpropagation at Scale: Training Large Models without Batches.

Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness, Urs Köster

Proceedings of the Fourth Conference on Machine Learning and Systems, 2021

2020

Adaptive Braking for Mitigating Gradient Delay.

Abhinav Venigalla, Atli Kosson, Vitaliy Chiley, Urs Köster

CoRR, 2020