Naman Goyal

According to our database, Naman Goyal authored at least 48 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

A comprehensive study of on-device NLP applications - VQA, automated Form filling, Smart Replies for Linguistic Codeswitching.

Naman Goyal

CoRR, 2024

The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants.

Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Donald Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, Madian Khabsa

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Llama 2: Open Foundation and Fine-Tuned Chat Models.

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton-Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurélien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom

CoRR, 2023

A Theory on Adam Instability in Large-Scale Machine Learning.

Igor Molybog, Peter Albert, Moya Chen, Zachary DeVito, David Esiobu, Naman Goyal, Punit Singh Koura, Sharan Narang, Andrew Poulton, Ruan Silva, Binh Tang, Diana Liskovich, Puxin Xu, Yuchen Zhang, Melanie Kambadur, Stephen Roller, Susan Zhang

CoRR, 2023

LLaMA: Open and Efficient Foundation Language Models.

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurélien Rodriguez, Armand Joulin, Edouard Grave, Guillaume Lample

CoRR, 2023

Text-To-4D Dynamic Scene Generation.

Uriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, Yaniv Taigman

Proceedings of the International Conference on Machine Learning, 2023

Scaling Laws for Generative Mixed-Modal Language Models.

Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer

Proceedings of the International Conference on Machine Learning, 2023

Don't forget the nullspace! Nullspace occupancy as a mechanism for out of distribution failure.

Daksh Idnani, Vivek Madan, Naman Goyal, David J. Schwab, Ramakrishna Vedantam

Proceedings of the Eleventh International Conference on Learning Representations, 2023

XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models.

Davis Liang, Hila Gonen, Yuning Mao, Rui Hou, Naman Goyal, Marjan Ghazvininejad, Luke Zettlemoyer, Madian Khabsa

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation.

Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Krishnan, Marc'Aurelio Ranzato, Francisco Guzmán, Angela Fan

Trans. Assoc. Comput. Linguistics, 2022

Multilingual Autoregressive Entity Linking.

Nicola De Cao, Ledell Wu, Kashyap Popat, Mikel Artetxe, Naman Goyal, Mikhail Plekhanov, Luke Zettlemoyer, Nicola Cancedda, Sebastian Riedel, Fabio Petroni

Trans. Assoc. Comput. Linguistics, 2022

A survey on Self Supervised learning approaches for improving Multimodal representation learning.

Naman Goyal

CoRR, 2022

BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage.

Kurt Shuster, Jing Xu, Mojtaba Komeili, Da Ju, Eric Michael Smith, Stephen Roller, Megan Ung, Moya Chen, Kushal Arora, Joshua Lane, Morteza Behrooz, William Ngan, Spencer Poff, Naman Goyal, Arthur Szlam, Y-Lan Boureau, Melanie Kambadur, Jason Weston

CoRR, 2022

OPT: Open Pre-trained Transformer Language Models.

Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona T. Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer

CoRR, 2022

Graph Neural Networks for Image Classification and Reinforcement Learning using Graph representations.

Naman Goyal, David Steiner

CoRR, 2022

CM3: A Causal Masked Multimodal Model of the Internet.

Armen Aghajanyan, Bernie Huang, Candace Ross, Vladimir Karpukhin, Hu Xu, Naman Goyal, Dmytro Okhonko, Mandar Joshi, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer

CoRR, 2022

Lifting the Curse of Multilinguality by Pre-training Modular Transformers.

Jonas Pfeiffer, Naman Goyal, Xi Victoria Lin, Xian Li, James Cross, Sebastian Riedel, Mikel Artetxe

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale.

Arun Babu, Changhan Wang, Andros Tjandra, Kushal Lakhotia, Qiantong Xu, Naman Goyal, Kritika Singh, Patrick von Platen, Yatharth Saraf, Juan Pino, Alexei Baevski, Alexis Conneau, Michael Auli

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Few-shot Learning with Multilingual Generative Language Models.

Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

On the Role of Bidirectionality in Language Model Pre-Training.

Mikel Artetxe, Jingfei Du, Naman Goyal, Luke Zettlemoyer, Veselin Stoyanov

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Efficient Large Scale Language Modeling with Mixtures of Experts.

Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giridharan Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeffrey Wang, Luke Zettlemoyer, Mona T. Diab, Zornitsa Kozareva, Veselin Stoyanov

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training?

Shiyue Zhang, Vishrav Chaudhary, Naman Goyal, James Cross, Guillaume Wenzek, Mohit Bansal, Francisco Guzmán

Proceedings of the 15th biennial conference of the Association for Machine Translation in the Americas (Volume 1: Research Track), 2022

2021

Beyond English-Centric Multilingual Machine Translation.

Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky, Sergey Edunov, Michael Auli, Armand Joulin

J. Mach. Learn. Res., 2021

Efficient Large Scale Language Modeling with Mixtures of Experts.

Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Mona T. Diab, Zornitsa Kozareva, Ves Stoyanov

CoRR, 2021

Few-shot Learning with Multilingual Language Models.

Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona T. Diab, Veselin Stoyanov, Xian Li

CoRR, 2021

Findings of the WMT 2021 Shared Task on Large-Scale Multilingual Machine Translation.

Guillaume Wenzek, Vishrav Chaudhary, Angela Fan, Sahir Gomez, Naman Goyal, Somya Jain, Douwe Kiela, Tristan Thrush, Francisco Guzmán

Proceedings of the Sixth Conference on Machine Translation, 2021

Larger-Scale Transformers for Multilingual Masked Language Modeling.

Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau

Proceedings of the 6th Workshop on Representation Learning for NLP, 2021

FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task.

Yun Tang, Hongyu Gong, Xian Li, Changhan Wang, Juan Miguel Pino, Holger Schwenk, Naman Goyal

Proceedings of the 18th International Conference on Spoken Language Translation, 2021

BASE Layers: Simplifying Training of Large, Sparse Models.

Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer

Proceedings of the 38th International Conference on Machine Learning, 2021

Better Fine-Tuning by Reducing Representational Collapse.

Armen Aghajanyan, Akshat Shrivastava, Anchit Gupta, Naman Goyal, Luke Zettlemoyer, Sonal Gupta

Proceedings of the 9th International Conference on Learning Representations, 2021

Recipes for Building an Open-Domain Chatbot.

Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Eric Michael Smith, Y-Lan Boureau, Jason Weston

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

Multilingual Translation from Denoising Pre-Training.

Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

Adapting High-resource NMT Models to Translate Low-resource Related Languages without Parallel Data.

Wei-Jen Ko, Ahmed El-Kishky, Adithya Renduchintala, Vishrav Chaudhary, Naman Goyal, Francisco Guzmán, Pascale Fung, Philipp Koehn, Mona T. Diab

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Multilingual Denoising Pre-training for Neural Machine Translation.

Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, Luke Zettlemoyer

Trans. Assoc. Comput. Linguistics, 2020

Beyond English-Centric Multilingual Machine Translation.

Angela Fan, Shruti Bhosale, Holger Schwenk, Zhiyi Ma, Ahmed El-Kishky, Siddharth Goyal, Mandeep Baines, Onur Celebi, Guillaume Wenzek, Vishrav Chaudhary, Naman Goyal, Tom Birch, Vitaliy Liptchinsky, Sergey Edunov, Edouard Grave, Michael Auli, Armand Joulin

CoRR, 2020

Multilingual Translation with Extensible Multilingual Pretraining and Finetuning.

Yuqing Tang, Chau Tran, Xian Li, Peng-Jen Chen, Naman Goyal, Vishrav Chaudhary, Jiatao Gu, Angela Fan

CoRR, 2020

Recipes for building an open-domain chatbot.

Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Kurt Shuster, Eric Michael Smith, Y-Lan Boureau, Jason Weston

CoRR, 2020

Findings of the WMT 2020 Shared Task on Parallel Corpus Filtering and Alignment.

Philipp Koehn, Vishrav Chaudhary, Ahmed El-Kishky, Naman Goyal, Peng-Jen Chen, Francisco Guzmán

Proceedings of the Fifth Conference on Machine Translation, 2020

Facebook AI's WMT20 News Translation Task Submission.

Peng-Jen Chen, Ann Lee, Changhan Wang, Naman Goyal, Angela Fan, Mary Williamson, Jiatao Gu

Proceedings of the Fifth Conference on Machine Translation, 2020

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks.

Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, Douwe Kiela

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension.

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, Luke Zettlemoyer

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Unsupervised Cross-lingual Representation Learning at Scale.

Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

RoBERTa: A Robustly Optimized BERT Pretraining Approach.

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, Veselin Stoyanov

CoRR, 2019

2017

LearningToQuestion at SemEval 2017 Task 3: Ranking Similar Questions by Learning to Rank Using Rich Features.

Naman Goyal

Proceedings of the 11th International Workshop on Semantic Evaluation, 2017

2016

The Social Dynamics of Language Change in Online Networks.

Rahul Goel, Sandeep Soni, Naman Goyal, John Paparrizos, Hanna M. Wallach, Fernando Diaz, Jacob Eisenstein

Proceedings of the Social Informatics - 8th International Conference, 2016

Poster: Understanding the Routine Activities of Students in Campus using Smartphone Sensors.

Sonia Soubam, Naman Goyal, Nishant Adhikari, Vinayak S. Naik

Proceedings of the 14th Annual International Conference on Mobile Systems, 2016

Active Learning in Multi-objective Evolutionary Algorithms for Sustainable Building Design.

Siamak Safarzadegan Gilan, Naman Goyal, Bistra Dilkina

Proceedings of the 2016 on Genetic and Evolutionary Computation Conference, Denver, CO, USA, July 20, 2016

A Joint Model of Rhetorical Discourse Structure and Summarization.

Naman Goyal, Jacob Eisenstein

Proceedings of the Workshop on Structured Prediction for NLP@EMNLP 2016, 2016