Benjamin Muller

According to our database, Benjamin Muller authored at least 23 papers between 2018 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Byte Latent Transformer: Patches Scale Better Than Tokens.

Artidoro Pagnoni, Ram Pasunuru, Pedro Rodríguez, John Nguyen, Benjamin Muller, Margaret Li, Chunting Zhou, Lili Yu, Jason Weston, Luke Zettlemoyer, Gargi Ghosh, Mike Lewis, Ari Holtzman, Srinivasan Iyer

CoRR, 2024

Layer Swapping for Zero-Shot Cross-Lingual Transfer in Large Language Models.

Lucas Bandarkar, Benjamin Muller, Pritish Yuvraj, Rui Hou, Nayan Singhal, Hongjiang Lv, Bing Liu

CoRR, 2024

SpiRit-LM: Interleaved Spoken and Written Language Model.

Tu Anh Nguyen, Benjamin Muller, Bokai Yu, Marta R. Costa-jussà, Maha Elbayad, Sravya Popuri, Paul-Ambroise Duquenne, Robin Algayres, Ruslan Mavlyutov, Itai Gat, Gabriel Synnaeve, Juan Pino, Benoît Sagot, Emmanuel Dupoux

CoRR, 2024

The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants.

Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Donald Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, Madian Khabsa

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning.

Lili Yu, Bowen Shi, Ramakanth Pasunuru, Benjamin Muller, Olga Golovneva, Tianlu Wang, Arun Babu, Binh Tang, Brian Karrer, Shelly Sheynin, Candace Ross, Adam Polyak, Russell Howes, Vasu Sharma, Puxin Xu, Hovhannes Tamoyan, Oron Ashual, Uriel Singer, Shang-Wen Li, Susan Zhang, Richard James, Gargi Ghosh, Yaniv Taigman, Maryam Fazel-Zarandi, Asli Celikyilmaz, Luke Zettlemoyer, Armen Aghajanyan

CoRR, 2023

The Gender-GAP Pipeline: A Gender-Aware Polyglot Pipeline for Gender Characterisation in 55 Languages.

Benjamin Muller, Belen Alastruey, Prangthip Hansanti, Elahe Kalbassi, Christophe Ropers, Eric Michael Smith, Adina Williams, Luke Zettlemoyer, Pierre Andrews, Marta R. Costa-jussà

Proceedings of the Eighth Conference on Machine Translation, 2023

Evaluating and Modeling Attribution for Cross-Lingual Question Answering.

Benjamin Muller, John Wieting, Jonathan H. Clark, Tom Kwiatkowski, Sebastian Ruder, Livio Soares, Roee Aharoni, Jonathan Herzig, Xinyi Wang

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages.

Asim Ersoy, Gerson Vizcarra, Tasmiah Tahsin Mayeesha, Benjamin Muller

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

2022

How Can We Make Language Models Better at Handling the Diversity and Variability of Natural Languages ? (Comment rendre les modèles de langue meilleurs face à la grande diversité et variabilité des langues ?).

Benjamin Muller

PhD thesis, 2022

Inria-ALMAnaCH at WMT 2022: Does Transcription Help Cross-Script Machine Translation?

Jesujoba Alabi, Lydia Nishimwe, Benjamin Muller, Camille Rey, Benoît Sagot, Rachel Bawden

Proceedings of the Seventh Conference on Machine Translation, 2022

Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer.

Benjamin Muller, Deepanshu Gupta, Jean-Philippe Fauconnier, Siddharth Patwardhan, David Vandyke, Sachin Agarwal

Proceedings of the Transfer Learning for Natural Language Processing Workshop, 2022

Quand être absent de mBERT n'est que le commencement : Gérer de nouvelles langues à l'aide de modèles de langues multilingues (When Being Unseen from mBERT is just the Beginning : Handling New Languages With Multilingual Language Models).

Benjamin Muller, Antonios Anastasopoulos, Benoît Sagot, Djamé Seddah

Proceedings of the Actes de la 29e Conférence sur le Traitement Automatique des Langues Naturelles. Volume 1 : conférence principale, 2022

Cross-Lingual Open-Domain Question Answering with Answer Sentence Generation.

Benjamin Muller, Luca Soldaini, Rik Koncel-Kedziorski, Eric Lind, Alessandro Moschitti

Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, 2022

2021

Cross-Lingual GenQA: A Language-Agnostic Generative Question Answering Approach for Open-Domain Question Answering.

Benjamin Muller, Luca Soldaini, Rik Koncel-Kedziorski, Eric Lind, Alessandro Moschitti

CoRR, 2021

When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models.

Benjamin Muller, Antonios Anastasopoulos, Benoît Sagot, Djamé Seddah

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT.

Benjamin Muller, Yanai Elazar, Benoît Sagot, Djamé Seddah

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

2020

Can Multilingual Language Models Transfer to an Unseen Dialect? A Case Study on North African Arabizi.

Benjamin Muller, Benoît Sagot, Djamé Seddah

CoRR, 2020

Les modèles de langue contextuels Camembert pour le français : impact de la taille et de l'hétérogénéité des données d'entrainement (C AMEM BERT Contextual Language Models for French: Impact of Training Data Size and Heterogeneity ).

Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric Villemonte de la Clergerie, Benoît Sagot, Djamé Seddah

Proceedings of the Actes de la 6e conférence conjointe Journées d'Études sur la Parole (JEP, 2020

Establishing a New State-of-the-Art for French Named Entity Recognition.

Pedro Javier Ortiz Suárez, Yoann Dupont, Benjamin Muller, Laurent Romary, Benoît Sagot

Proceedings of The 12th Language Resources and Evaluation Conference, 2020

Building a User-Generated Content North-African Arabizi Treebank: Tackling Hell.

Djamé Seddah, Farah Essaidi, Amal Fethi, Matthieu Futeral, Benjamin Muller, Pedro Javier Ortiz Suárez, Benoît Sagot, Abhishek Srivastava

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

CamemBERT: a Tasty French Language Model.

Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric de la Clergerie, Djamé Seddah, Benoît Sagot

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Enhancing BERT for Lexical Normalization.

Benjamin Muller, Benoît Sagot, Djamé Seddah

Proceedings of the 5th Workshop on Noisy User-generated Text, 2019

2018

ELMoLex: Connecting ELMo and Lexicon Features for Dependency Parsing.

Ganesh Jawahar, Benjamin Muller, Amal Fethi, Louis Martin, Éric Villemonte de la Clergerie, Benoît Sagot, Djamé Seddah

Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, Brussels, Belgium, October 31, 2018