Vijay Anand Korthikanti

According to our database, Vijay Anand Korthikanti authored at least 17 papers between 2008 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Upcycling Large Language Models into Mixture of Experts.

Ethan He, Abhinav Khattar, Ryan Prenger, Vijay Korthikanti, Zijie Yan, Tong Liu, Shiqing Fan, Ashwath Aithal, Mohammad Shoeybi, Bryan Catanzaro

CoRR, 2024

An Empirical Study of Mamba-based Language Models.

Roger Waleffe, Wonmin Byeon, Duncan Riach, Brandon Norick, Vijay Korthikanti, Tri Dao, Albert Gu, Ali Hatamizadeh, Sudhakar Singh, Deepak Narayanan, Garvit Kulshreshtha, Vartika Singh, Jared Casper, Jan Kautz, Mohammad Shoeybi, Bryan Catanzaro

CoRR, 2024

2023

Reducing Activation Recomputation in Large Transformer Models.

Vijay Anand Korthikanti, Jared Casper, Sangkug Lym, Lawrence McAfee, Michael Andersch, Mohammad Shoeybi, Bryan Catanzaro

Proceedings of the Sixth Conference on Machine Learning and Systems, 2023

Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning.

Zhuolin Yang, Wei Ping, Zihan Liu, Vijay Korthikanti, Weili Nie, De-An Huang, Linxi Fan, Zhiding Yu, Shiyi Lan, Bo Li, Mohammad Shoeybi, Ming-Yu Liu, Yuke Zhu, Bryan Catanzaro, Chaowei Xiao, Anima Anandkumar

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

2022

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model.

Shaden Smith, Mostofa Patwary, Brandon Norick, Patrick LeGresley, Samyam Rajbhandari, Jared Casper, Zhun Liu, Shrimai Prabhumoye, George Zerveas, Vijay Korthikanti, Elton Zheng, Rewon Child, Reza Yazdani Aminabadi, Julie Bernauer, Xia Song, Mohammad Shoeybi, Yuxiong He, Michael Houston, Saurabh Tiwary, Bryan Catanzaro

CoRR, 2022

2021

Efficient Large-Scale Language Model Training on GPU Clusters.

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

CoRR, 2021

Efficient large-scale language model training on GPU clusters using megatron-LM.

Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia

Proceedings of the International Conference for High Performance Computing, 2021

2011

Towards energy-performance trade-off analysis of parallel applications

Vijay Anand Korthikanti

PhD thesis, 2011

Energy-performance trade-off analysis of parallel algorithms for shared memory architectures.

Vijay Anand Korthikanti, Gul Agha

Sustain. Comput. Informatics Syst., 2011

Model Checking MDPs with a Unique Compact Invariant Set of Distributions.

Rohit Chadha, Vijay Anand Korthikanti, Mahesh Viswanathan, Gul Agha, YoungMin Kwon

Proceedings of the Eighth International Conference on Quantitative Evaluation of Systems, 2011

Synthesizing geometry constructions.

Sumit Gulwani, Vijay Anand Korthikanti, Ashish Tiwari

Proceedings of the 32nd ACM SIGPLAN Conference on Programming Language Design and Implementation, 2011

On the Energy Complexity of Parallel Algorithms.

Vijay Anand Korthikanti, Gul Agha, Mark R. Greenstreet

Proceedings of the International Conference on Parallel Processing, 2011

2010

Towards optimizing energy costs of algorithms for shared memory architectures.

Vijay Anand Korthikanti, Gul Agha

Proceedings of the SPAA 2010: Proceedings of the 22nd Annual ACM Symposium on Parallelism in Algorithms and Architectures, 2010

Reasoning about MDPs as Transformers of Probability Distributions.

Vijay Anand Korthikanti, Mahesh Viswanathan, Gul Agha, YoungMin Kwon

Proceedings of the QEST 2010, 2010

Avoiding energy wastage in parallel applications.

Vijay Anand Korthikanti, Gul Agha

Proceedings of the International Green Computing Conference 2010, 2010

2009

Analysis of Parallel Algorithms for Energy Conservation in Scalable Multicore Architectures.

Vijay Anand Korthikanti, Gul Agha

Proceedings of the ICPP 2009, 2009

2008

Fair K Mutual Exclusion Algorithm for Peer to Peer Systems.

Vijay Anand Reddy, Prateek Mittal, Indranil Gupta

Proceedings of the 28th IEEE International Conference on Distributed Computing Systems (ICDCS 2008), 2008