Igor Gitman

According to our database, Igor Gitman authored at least 11 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data.

Shubham Toshniwal, Wei Du, Ivan Moshkov, Branislav Kisacanin, Alexan Ayrapetyan, Igor Gitman

CoRR, 2024

Nemotron-4 340B Technical Report.

Bo Adler, Niket Agarwal, Ashwath Aithal, Dong H. Anh, Pallab Bhattacharya, Annika Brundyn, Jared Casper, Bryan Catanzaro, Sharon Clay, Jonathan M. Cohen, Sirshak Das, Ayush Dattagupta, Olivier Delalleau, Leon Derczynski, Yi Dong, Daniel Egert, Ellie Evans, Aleksander Ficek, Denys Fridman, Shaona Ghosh, Boris Ginsburg, Igor Gitman, Tomasz Grzegorzek, Robert Hero, Jining Huang, Vibhu Jawa, Joseph Jennings, Aastha Jhunjhunwala, John Kamalu, Sadaf Khan, Oleksii Kuchaiev, Patrick LeGresley, Hui Li, Jiwei Liu, Zihan Liu, Eileen Long, Ameya Sunil Mahabaleshwarkar, Somshubra Majumdar, James Maki, Miguel Martinez, Maer Rodrigues de Melo, Ivan Moshkov, Deepak Narayanan, Sean Narenthiran, Jesus Navarro, Phong Nguyen, Osvald Nitski, Vahid Noroozi, Guruprasad Nutheti, Christopher Parisien, Jupinder Parmar, Mostofa Patwary, Krzysztof Pawelec, Wei Ping, Shrimai Prabhumoye, Rajarshi Roy, Trisha Saar, Vasanth Rao Naik Sabavat, Sanjeev Satheesh, Jane Polak Scowcroft, Jason Sewall, Pavel Shamis, Gerald Shen, Mohammad Shoeybi, Dave Sizer, Misha Smelyanskiy, Felipe Soares, Makesh Narsimhan Sreedhar, Dan Su, Sandeep Subramanian, Shengyang Sun, Shubham Toshniwal, Hao Wang, Zhilin Wang, Jiaxuan You, Jiaqi Zeng, Jimmy Zhang, Jing Zhang, Vivienne Zhang, Yian Zhang, Chen Zhu

CoRR, 2024

OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset.

Shubham Toshniwal, Ivan Moshkov, Sean Narenthiran, Daria Gitman, Fei Jia, Igor Gitman

CoRR, 2024

2023

Confidence-based Ensembles of End-to-End Speech Recognition Models.

Igor Gitman, Vitaly Lavrukhin, Aleksandr Laptev, Boris Ginsburg

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Powerful and Extensible WFST Framework for Rnn-Transducer Losses.

Aleksandr Laptev, Vladimir Bataev, Igor Gitman, Boris Ginsburg

Proceedings of the IEEE International Conference on Acoustics, 2023

2019

Understanding the Role of Momentum in Stochastic Gradient Methods.

Igor Gitman, Hunter Lang, Pengchuan Zhang, Lin Xiao

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

2018

OpenSeq2Seq: extensible toolkit for distributed and mixed precision training of sequence-to-sequence models.

Oleksii Kuchaiev, Boris Ginsburg, Igor Gitman, Vitaly Lavrukhin, Carl Case, Paulius Micikevicius

CoRR, 2018

Novel Prediction Techniques Based on Clusterwise Linear Regression.

Igor Gitman, Jieshi Chen, Eric Lei, Artur Dubrawski

CoRR, 2018

Convergence Analysis of Gradient Descent Algorithms with Proportional Updates.

Igor Gitman, Deepak Dilipkumar, Ben Parr

CoRR, 2018

2017

Comparison of Batch Normalization and Weight Normalization Algorithms for the Large-scale Image Classification.

Igor Gitman, Boris Ginsburg

CoRR, 2017

Scaling SGD Batch Size to 32K for ImageNet Training.

Yang You, Igor Gitman, Boris Ginsburg

CoRR, 2017