Alexis Conneau

According to our database, Alexis Conneau authored at least 36 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Scaling Speech Technology to 1, 000+ Languages.

Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, Arun Babu, Sayani Kundu, Ali Elkahky, Zhaoheng Ni, Apoorv Vyas, Maryam Fazel-Zarandi, Alexei Baevski, Yossi Adi, Xiaohui Zhang, Wei-Ning Hsu, Alexis Conneau, Michael Auli

J. Mach. Learn. Res., 2024

GPT-4o System Card.

Aaron Hurst, Adam Lerer, Adam P. Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, Aleksander Madry, Alex Baker-Whitcomb, Alex Beutel, Alex Borzunov, Alex Carney, Alex Chow, Alex Kirillov, Alex Nichol, Alex Paino, Alex Renzin, Alex Tachard Passos, Alexander Kirillov, Alexi Christakis, Alexis Conneau, Ali Kamali, Allan Jabri, Allison Moyer, Allison Tam, Amadou Crookes, Amin Tootoonchian, Ananya Kumar, Andrea Vallone, Andrej Karpathy, Andrew Braunstein, Andrew Cann, Andrew Codispoti, Andrew Galu, Andrew Kondrich, Andrew Tulloch, Andrey Mishchenko, Angela Baek, Angela Jiang, Antoine Pelisse, Antonia Woodford, Anuj Gosalia, Arka Dhar, Ashley Pantuliano, Avi Nayak, Avital Oliver, Barret Zoph, Behrooz Ghorbani, Ben Leimberger, Ben Rossen, Ben Sokolowsky, Ben Wang, Benjamin Zweig, Beth Hoover, Blake Samic, Bob McGrew, Bobby Spero, Bogo Giertler, Bowen Cheng, Brad Lightcap, Brandon Walkin, Brendan Quinn, Brian Guarraci, Brian Hsu, Bright Kellogg, Brydon Eastman, Camillo Lugaresi, Carroll L. Wainwright, Cary Bassin, Cary Hudson, Casey Chu, Chad Nelson, Chak Li, Chan Jun Shern, Channing Conger, Charlotte Barette, Chelsea Voss, Chen Ding, Cheng Lu, Chong Zhang, Chris Beaumont, Chris Hallacy, Chris Koch, Christian Gibson, Christina Kim, Christine Choi, Christine McLeavey, Christopher Hesse, Claudia Fischer, Clemens Winter, Coley Czarnecki, Colin Jarvis, Colin Wei, Constantin Koumouzelis, Dane Sherburn

CoRR, 2024

2023

Textually Pretrained Speech Language Models.

Michael Hassid, Tal Remez, Tu Anh Nguyen, Itai Gat, Alexis Conneau, Felix Kreuk, Jade Copet, Alexandre Défossez, Gabriel Synnaeve, Emmanuel Dupoux, Roy Schwartz, Yossi Adi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Scaling Laws for Generative Mixed-Modal Language Models.

Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer

Proceedings of the International Conference on Machine Learning, 2023

Toward Joint Language Modeling for Speech Units and Text.

Ju-Chieh Chou, Chung-Ming Chien, Wei-Ning Hsu, Karen Livescu, Arun Babu, Alexis Conneau, Alexei Baevski, Michael Auli

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

2022

mSLAM: Massively multilingual joint pre-training for speech and text.

Ankur Bapna, Colin Cherry, Yu Zhang, Ye Jia, Melvin Johnson, Yong Cheng, Simran Khanuja, Jason Riesa, Alexis Conneau

CoRR, 2022

FLEURS: FEW-Shot Learning Evaluation of Universal Representations of Speech.

Alexis Conneau, Min Ma, Simran Khanuja, Yu Zhang, Vera Axelrod, Siddharth Dalmia, Jason Riesa, Clara Rivera, Ankur Bapna

Proceedings of the IEEE Spoken Language Technology Workshop, 2022

Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translation.

Ye Jia, Yifan Ding, Ankur Bapna, Colin Cherry, Yu Zhang, Alexis Conneau, Nobu Morioka

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

XTREME-S: Evaluating Cross-lingual Speech Representations.

Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale.

Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Improved Language Identification Through Cross-Lingual Self-Supervised Learning.

Andros Tjandra, Diptanu Gon Choudhury, Frank Zhang, Kritika Singh, Alexis Conneau, Alexei Baevski, Assaf Sela, Yatharth Saraf, Michael Auli

Proceedings of the IEEE International Conference on Acoustics, 2022

2021

SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training.

Ankur Bapna, Yu-An Chung, Nan Wu, Anmol Gulati, Ye Jia, Jonathan H. Clark, Melvin Johnson, Jason Riesa, Alexis Conneau, Yu Zhang

CoRR, 2021

Larger-Scale Transformers for Multilingual Masked Language Modeling.

Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau

Proceedings of the 6th Workshop on Representation Learning for NLP, 2021

Unsupervised Speech Recognition.

Alexei Baevski, Wei-Ning Hsu, Alexis Conneau, Michael Auli

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Self-training Improves Pre-training for Natural Language Understanding.

Jingfei Du, Edouard Grave, Beliz Gunel, Vishrav Chaudhary, Onur Celebi, Michael Auli, Veselin Stoyanov, Alexis Conneau

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Large-Scale Self- and Semi-Supervised Learning for Speech Translation.

Changhan Wang, Anne Wu, Juan Pino, Alexei Baevski, Michael Auli, Alexis Conneau

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

Unsupervised Cross-Lingual Representation Learning for Speech Recognition.

Alexis Conneau, Alexei Baevski, Ronan Collobert, Abdelrahman Mohamed, Michael Auli

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning.

Beliz Gunel, Jingfei Du, Alexis Conneau, Veselin Stoyanov

Proceedings of the 9th International Conference on Learning Representations, 2021

Self-Training and Pre-Training are Complementary for Speech Recognition.

Qiantong Xu, Alexei Baevski, Tatiana Likhomanenko, Paden Tomasello, Alexis Conneau, Ronan Collobert, Gabriel Synnaeve, Michael Auli

Proceedings of the IEEE International Conference on Acoustics, 2021

Multilingual Speech Translation from Efficient Finetuning of Pretrained Models.

Xian Li, Changhan Wang, Yun Tang, Chau Tran, Yuqing Tang, Juan Miguel Pino, Alexei Baevski, Alexis Conneau, Michael Auli

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data.

Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, Vishrav Chaudhary, Francisco Guzmán, Armand Joulin, Edouard Grave

Proceedings of The 12th Language Resources and Evaluation Conference, 2020

Emerging Cross-lingual Structure in Pretrained Language Models.

Alexis Conneau, Shijie Wu, Haoran Li, Luke Zettlemoyer, Veselin Stoyanov

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Unsupervised Cross-lingual Representation Learning at Scale.

Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Learning distributed representations of sentences using neural networks. (Apprentissage et applications de représentations multilingues distribuées).

Alexis Conneau

PhD thesis, 2019

Cross-lingual Language Model Pretraining.

Alexis Conneau, Guillaume Lample

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

2018

Learning Visually Grounded Sentence Representations.

Douwe Kiela, Alexis Conneau, Allan Jabri, Maximilian Nickel

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

SentEval: An Evaluation Toolkit for Universal Sentence Representations.

Alexis Conneau, Douwe Kiela

Proceedings of the Eleventh International Conference on Language Resources and Evaluation, 2018

Word translation without parallel data.

Guillaume Lample, Alexis Conneau, Marc'Aurelio Ranzato, Ludovic Denoyer, Hervé Jégou

Proceedings of the 6th International Conference on Learning Representations, 2018

Unsupervised Machine Translation Using Monolingual Corpora Only.

Guillaume Lample, Alexis Conneau, Ludovic Denoyer, Marc'Aurelio Ranzato

Proceedings of the 6th International Conference on Learning Representations, 2018

Phrase-Based & Neural Unsupervised Machine Translation.

Guillaume Lample, Myle Ott, Alexis Conneau, Ludovic Denoyer, Marc'Aurelio Ranzato

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

XNLI: Evaluating Cross-lingual Sentence Representations.

Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel R. Bowman, Holger Schwenk, Veselin Stoyanov

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

What you can cram into a single \$&!#* vector: Probing sentence embeddings for linguistic properties.

Alexis Conneau, Germán Kruszewski, Guillaume Lample, Loïc Barrault, Marco Baroni

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Supervised Learning of Universal Sentence Representations from Natural Language Inference Data.

Alexis Conneau, Douwe Kiela, Holger Schwenk, Loïc Barrault, Antoine Bordes

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017

Very Deep Convolutional Networks for Text Classification.

Alexis Conneau, Holger Schwenk, Loïc Barrault, Yann LeCun

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017

2016

Very Deep Convolutional Networks for Natural Language Processing.

Alexis Conneau, Holger Schwenk, Loïc Barrault, Yann LeCun

CoRR, 2016

Meta-Prod2Vec: Product Embeddings Using Side-Information for Recommendation.

Flavian Vasile, Elena Smirnova, Alexis Conneau

Proceedings of the 10th ACM Conference on Recommender Systems, 2016