Alexei Baevski

According to our database, Alexei Baevski authored at least 44 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Scaling Speech Technology to 1, 000+ Languages.

Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli

J. Mach. Learn. Res., 2024

2023

OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNav.

Karmesh Yadav, Arjun Majumdar, Ram Ramrakhya, Naoki Yokoyama, Alexei Baevski, Zsolt Kira, Oleksandr Maksymets, Dhruv Batra

CoRR, 2023

Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language.

Alexei Baevski, Arun Babu, Wei-Ning Hsu, Michael Auli

Proceedings of the International Conference on Machine Learning, 2023

Measuring the Impact of Domain Factors in Self-Supervised Pre-Training.

Ramon Sanabria, Wei-Ning Hsu, Alexei Baevski, Michael Auli

Proceedings of the IEEE International Conference on Acoustics, 2023

Toward Joint Language Modeling for Speech Units and Text.

Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Av-Data2Vec: Self-Supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations.

Jiachen Lian, Alexei Baevski, Wei-Ning Hsu, Michael Auli

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2023

Introducing Semantics into Speech Encoders.

Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Bing Liu, Akshat Shrivastava, Shang-Wen Li, Liang-Hsuan Tseng, Guan-Ting Lin, Alexei Baevski, Hung-yi Lee, Yizhou Sun, Wei Wang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Introducing Semantics into Speech Encoders.

Derek Xu, Shuyan Dong, Changhan Wang, Suyoun Kim, Zhaojiang Lin, Akshat Shrivastava, Shang-Wen Li, Liang-Hsuan Tseng, Alexei Baevski, Guan-Ting Lin, Hung-yi Lee, Yizhou Sun, Wei Wang

CoRR, 2022

Offline Visual Representation Learning for Embodied Navigation.

Karmesh Yadav, Ram Ramrakhya, Arjun Majumdar, Vincent-Pierre Berges, Sachit Kuhar, Dhruv Batra, Alexei Baevski, Oleksandr Maksymets

CoRR, 2022

Measuring the Impact of Individual Domain Factors in Self-Supervised Pre-Training.

Ramon Sanabria, Wei-Ning Hsu, Alexei Baevski, Michael Auli

CoRR, 2022

Towards End-to-End Unsupervised Speech Recognition.

Alexander H. Liu, Wei-Ning Hsu, Michael Auli, Alexei Baevski

Proceedings of the IEEE Spoken Language Technology Workshop, 2022

Masked Autoencoders that Listen.

Po-Yao Huang, Hu Xu, Juncheng Li, Alexei Baevski, Michael Auli, Wojciech Galuba, Florian Metze, Christoph Feichtenhofer

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Simple and Effective Zero-shot Cross-lingual Phoneme Recognition.

Qiantong Xu, Alexei Baevski, Michael Auli

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

On-demand compute reduction with stochastic wav2vec 2.0.

Apoorv Vyas, Wei-Ning Hsu, Michael Auli, Alexei Baevski

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Wav2Vec-Aug: Improved self-supervised training with limited data.

Anuroop Sriram, Michael Auli, Alexei Baevski

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Simple and Effective Unsupervised Speech Synthesis.

Alexander H. Liu, Cheng-I Lai, Wei-Ning Hsu, Michael Auli, Alexei Baevski, James R. Glass

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale.

Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language.

Alexei Baevski, Wei-Ning Hsu, Qiantong Xu, Arun Babu, Jiatao Gu, Michael Auli

Proceedings of the International Conference on Machine Learning, 2022

Improved Language Identification Through Cross-Lingual Self-Supervised Learning.

Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang, Kritika Singh, Alexis Conneau, Alexei Baevski, Assaf Sela, Yatharth Saraf, Michael Auli

Proceedings of the IEEE International Conference on Acoustics, 2022

Unified Speech-Text Pre-training for Speech Translation and Recognition.

Yun Tang, Hongyu Gong, Ning Dong, Changhan Wang, Wei-Ning Hsu, Jiatao Gu, Alexei Baevski, Xian Li, Abdelrahman Mohamed, Michael Auli, Juan Miguel Pino

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

Improved Language Identification Through Cross-Lingual Self-Supervised Learning.

Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang, Kritika Singh, Alexei Baevski, Assaf Sela, Yatharth Saraf, Michael Auli

CoRR, 2021

Generative Spoken Language Modeling from Raw Audio.

Kushal Lakhotia, Evgeny Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu Anh Nguyen, Jade Copet, Alexei Baevski, Adelrahman Mohamed, Emmanuel Dupoux

CoRR, 2021

Unsupervised Speech Recognition.

Alexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael Auli

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Large-Scale Self- and Semi-Supervised Learning for Speech Translation.

Changhan Wang, Anne Wu, Juan Pino, Alexei Baevski, Michael Auli, Alexis Conneau

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training.

Wei-Ning Hsu, Anuroop Sriram, Alexei Baevski, Tatiana Likhomanenko, Qiantong Xu, Vineel Pratap, Jacob Kahn, Ann Lee, Ronan Collobert, Gabriel Synnaeve, Michael Auli

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

Unsupervised Cross-Lingual Representation Learning for Speech Recognition.

Alexis Conneau, Alexei Baevski, Ronan Collobert, Abdelrahman Mohamed, Michael Auli

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

A Comparison of Discrete Latent Variable Models for Speech Representation Learning.

Henry Zhou, Alexei Baevski, Michael Auli

Proceedings of the IEEE International Conference on Acoustics, 2021

Self-Training and Pre-Training are Complementary for Speech Recognition.

Qiantong Xu, Alexei Baevski, Tatiana Likhomanenko, Paden Tomasello, Alexis Conneau, Ronan Collobert, Gabriel Synnaeve, Michael Auli

Proceedings of the IEEE International Conference on Acoustics, 2021

Reservoir Transformers.

Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

Multilingual Speech Translation from Efficient Finetuning of Pretrained Models.

Xian Li, Changhan Wang, Yun Tang, Chau Tran, Yuqing Tang, Juan Miguel Pino, Alexei Baevski, Alexis Conneau, Michael Auli

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Reservoir Transformer.

Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela

CoRR, 2020

The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling.

Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Evgeny Kharitonov, Alexei Baevski, Ewan Dunbar, Emmanuel Dupoux

CoRR, 2020

wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations.

Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, Michael Auli

CoRR, 2020

wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations.

Alexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, Michael Auli

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations.

Alexei Baevski, Steffen Schneider, Michael Auli

Proceedings of the 8th International Conference on Learning Representations, 2020

Effectiveness of Self-Supervised Pre-Training for ASR.

Alexei Baevski, Abdelrahman Mohamed

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

2019

Effectiveness of self-supervised pre-training for speech recognition.

Alexei Baevski, Michael Auli, Abdelrahman Mohamed

CoRR, 2019

Facebook FAIR's WMT19 News Translation Task Submission.

Nathan Ng, Kyra Yee, Alexei Baevski, Myle Ott, Michael Auli, Sergey Edunov

Proceedings of the Fourth Conference on Machine Translation, 2019

fairseq: A Fast, Extensible Toolkit for Sequence Modeling.

Myle Ott, Sergey Edunov, Alexei Baevski, Angela Fan, Sam Gross, Nathan Ng, David Grangier, Michael Auli

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Pre-trained language model representations for language generation.

Sergey Edunov, Alexei Baevski, Michael Auli

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

wav2vec: Unsupervised Pre-Training for Speech Recognition.

Steffen Schneider, Alexei Baevski, Ronan Collobert, Michael Auli

Proceedings of the 20th Annual Conference of the International Speech Communication Association, 2019

Pay Less Attention with Lightweight and Dynamic Convolutions.

Felix Wu, Angela Fan, Alexei Baevski, Yann N. Dauphin, Michael Auli

Proceedings of the 7th International Conference on Learning Representations, 2019

Adaptive Input Representations for Neural Language Modeling.

Alexei Baevski, Michael Auli

Proceedings of the 7th International Conference on Learning Representations, 2019

Cloze-driven Pretraining of Self-attention Networks.

Alexei Baevski, Sergey Edunov, Yinhan Liu, Luke Zettlemoyer, Michael Auli

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019