Alexander Borzunov

According to our database, Alexander Borzunov authored at least 8 papers between 2021 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression.

Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Distributed Inference and Fine-tuning of Large Language Models Over The Internet.

Alexander Borzunov, Max Ryabinin, Artem Chumachenko, Dmitry Baranchuk, Tim Dettmers, Younes Belkada, Pavel Samygin, Colin A. Raffel

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient.

Max Ryabinin, Tim Dettmers, Michael Diskin, Alexander Borzunov

Proceedings of the International Conference on Machine Learning, 2023

Petals: Collaborative Inference and Fine-tuning of Large Models.

Alexander Borzunov, Dmitry Baranchuk, Tim Dettmers, Maksim Riabinin, Younes Belkada, Artem Chumachenko, Pavel Samygin, Colin Raffel

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2023

2022

Petals: Collaborative Inference and Fine-tuning of Large Models.

Alexander Borzunov, Dmitry Baranchuk, Tim Dettmers, Max Ryabinin, Younes Belkada, Artem Chumachenko, Pavel Samygin, Colin Raffel

CoRR, 2022

Secure Distributed Training at Scale.

Eduard Gorbunov, Alexander Borzunov, Michael Diskin, Max Ryabinin

Proceedings of the International Conference on Machine Learning, 2022

2021

Distributed Deep Learning In Open Collaborations.

Michael Diskin, Alexey Bukhtiyarov, Max Ryabinin, Lucile Saulnier, Quentin Lhoest, Anton Sinitsin, Dmitry Popov, Dmitry V. Pyrkin, Maxim Kashirin, Alexander Borzunov, Albert Villanova del Moral, Denis Mazur, Ilia Kobelev, Yacine Jernite, Thomas Wolf, Gennady Pekhimenko

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Training Transformers Together.

Alexander Borzunov, Max Ryabinin, Tim Dettmers, Quentin Lhoest, Lucile Saulnier, Michael Diskin, Yacine Jernite, Thomas Wolf

Proceedings of the NeurIPS 2021 Competitions and Demonstrations Track, 2021