Orhan Firat

According to our database, Orhan Firat authored at least 118 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queries.

Kiran Vodrahalli, Santiago Ontanon, Nilesh Tripuraneni, Kelvin Xu, Sanil Jain, Rakesh Shivanna, Jeffrey Hui, Nishanth Dikkala, Mehran Kazemi, Bahare Fatemi, Rohan Anil, Ethan Dyer, Siamak Shakeri, Roopali Vij, Harsh Mehta, Vinay V. Ramasesh, Quoc Le, Ed H. Chi, Yifeng Lu, Orhan Firat, Angeliki Lazaridou, Jean-Baptiste Lespiau, Nithya Attaluri, Kate Olszewska

CoRR, 2024

Scaling Sign Language Translation.

Biao Zhang, Garrett Tanzer, Orhan Firat

CoRR, 2024

Long-Span Question-Answering: Automatic Question Generation and QA-System Ranking via Side-by-Side Evaluation.

Bernd Bohnet, Kevin Swersky, Rosanne Liu, Pranjal Awasthi, Azade Nova, Javier Snaider, Hanie Sedghi, Aaron T. Parisi, Michael Collins, Angeliki Lazaridou, Orhan Firat, Noah Fiedel

CoRR, 2024

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.

Machel Reid, Nikolay Savinov, Denis Teplyashin, Dmitry Lepikhin, Timothy P. Lillicrap, Jean-Baptiste Alayrac, Radu Soricut, Angeliki Lazaridou, Orhan Firat, Julian Schrittwieser, Ioannis Antonoglou, Rohan Anil, Sebastian Borgeaud, Andrew M. Dai, Katie Millican, Ethan Dyer, Mia Glaese, Thibault Sottiaux, Benjamin Lee, Fabio Viola, Malcolm Reynolds, Yuanzhong Xu, James Molloy, Jilin Chen, Michael Isard, Paul Barham, Tom Hennigan, Ross McIlroy, Melvin Johnson, Johan Schalkwyk, Eli Collins, Eliza Rutherford, Erica Moreira, Kareem Ayoub, Megha Goel, Clemens Meyer, Gregory Thornton, Zhen Yang, Henryk Michalewski, Zaheer Abbas, Nathan Schucher, Ankesh Anand, Richard Ives, James Keeling, Karel Lenc, Salem Haykal, Siamak Shakeri, Pranav Shyam, Aakanksha Chowdhery, Roman Ring, Stephen Spencer, Eren Sezener, et al.

CoRR, 2024

When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method.

Biao Zhang, Zhongtao Liu, Colin Cherry, Orhan Firat

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation.

Parker Riley, Timothy Dozat, Jan A. Botha, Xavier Garcia, Dan Garrette, Jason Riesa, Orhan Firat, Noah Constant

Trans. Assoc. Comput. Linguistics, 2023

PaLM: Scaling Language Modeling with Pathways.

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel

J. Mach. Learn. Res., 2023

Gemini: A Family of Highly Capable Multimodal Models.

Rohan Anil, Sebastian Borgeaud, Yonghui Wu, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Slav Petrov, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy P. Lillicrap, Angeliki Lazaridou, Orhan Firat, James Molloy, Michael Isard, Paul Ronald Barham, Tom Hennigan, Benjamin Lee, Fabio Viola, Malcolm Reynolds, Yuanzhong Xu, Ryan Doherty, Eli Collins, Clemens Meyer, Eliza Rutherford, Erica Moreira, Kareem Ayoub, Megha Goel, George Tucker, Enrique Piqueras, Maxim Krikun, Iain Barr, Nikolay Savinov, Ivo Danihelka, Becca Roelofs, Anaïs White, Anders Andreassen, Tamara von Glehn, Lakshman Yagati, Mehran Kazemi, Lucas Gonzalez, Misha Khalman, Jakub Sygnowski, et al.

CoRR, 2023

MADLAD-400: A Multilingual And Document-Level Large Audited Dataset.

Sneha Kudugunta, Isaac Caswell, Biao Zhang, Xavier Garcia, Christopher A. Choquette-Choo, Katherine Lee, Derrick Xin, Aditya Kusupati, Romi Stella, Ankur Bapna, Orhan Firat

CoRR, 2023

Reinforced Self-Training (ReST) for Language Modeling.

Çaglar Gülçehre, Tom Le Paine, Srivatsan Srinivasan, Ksenia Konyushkova, Lotte Weerts, Abhishek Sharma, Aditya Siddhant, Alex Ahern, Miaosen Wang, Chenjie Gu, Wolfgang Macherey, Arnaud Doucet, Orhan Firat, Nando de Freitas

CoRR, 2023

The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation.

Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André F. T. Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat

CoRR, 2023

Block-State Transformer.

Mahan Fathi, Jonathan Pilault, Pierre-Luc Bacon, Christopher Pal, Orhan Firat, Ross Goroshin

CoRR, 2023

Cross-Lingual Supervision improves Large Language Models Pre-training.

Andrea Schioppa, Xavier Garcia, Orhan Firat

CoRR, 2023

PaLM 2 Technical Report.

Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.

CoRR, 2023

Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translation.

Alexander Jones, Isaac Caswell, Ishank Saxena, Orhan Firat

CoRR, 2023

The unreasonable effectiveness of few-shot learning for machine translation.

Xavier Garcia, Yamini Bansal, Colin Cherry, George F. Foster, Maxim Krikun, Fangxiaoyu Feng, Melvin Johnson, Orhan Firat

CoRR, 2023

The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation.

Patrick Fernandes, Daniel Deutsch, Mara Finkelstein, Parker Riley, André Martins, Graham Neubig, Ankush Garg, Jonathan H. Clark, Markus Freitag, Orhan Firat

Proceedings of the Eighth Conference on Machine Translation, 2023

Block-State Transformers.

Jonathan Pilault, Mahan Fathi, Orhan Firat, Chris Pal, Pierre-Luc Bacon, Ross Goroshin

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

MADLAD-400: A Multilingual And Document-Level Large Audited Dataset.

Sneha Kudugunta, Isaac Caswell, Biao Zhang, Xavier Garcia, Derrick Xin, Aditya Kusupati, Romi Stella, Ankur Bapna, Orhan Firat

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Order Matters in the Presence of Dataset Imbalance for Multilingual Learning.

Dami Choi, Derrick Xin, Hamid Dadkhahi, Justin Gilmer, Ankush Garg, Orhan Firat, Chih-Kuan Yeh, Andrew M. Dai, Behrooz Ghorbani

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Binarized Neural Machine Translation.

Yichi Zhang, Ankush Garg, Yuan Cao, Lukasz Lew, Behrooz Ghorbani, Zhiru Zhang, Orhan Firat

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction.

Jonathan Pilault, Xavier Garcia, Arthur Brazinskas, Orhan Firat

Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics, 2023

The Unreasonable Effectiveness of Few-shot Learning for Machine Translation.

Xavier Garcia, Yamini Bansal, Colin Cherry, George F. Foster, Maxim Krikun, Melvin Johnson, Orhan Firat

Proceedings of the International Conference on Machine Learning, 2023

Scaling Laws for Multilingual Neural Machine Translation.

Patrick Fernandes, Behrooz Ghorbani, Xavier Garcia, Markus Freitag, Orhan Firat

Proceedings of the International Conference on Machine Learning, 2023

UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining.

Hyung Won Chung, Xavier Garcia, Adam Roberts, Yi Tay, Orhan Firat, Sharan Narang, Noah Constant

Proceedings of the Eleventh International Conference on Learning Representations, 2023

GATITOS: Using a New Multilingual Lexicon for Low-resource Machine Translation.

Alexander Jones, Isaac Caswell, Orhan Firat, Ishank Saxena

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets.

Julia Kreutzer, Isaac Caswell, Lisa Wang, Ahsan Wahab, Daan van Esch, Nasanbayar Ulzii-Orshikh, Allahsera Tapo, Nishant Subramani, Artem Sokolov, Claytone Sikasote, Monang Setyawan, Supheakmungkol Sarin, Sokhar Samb, Benoît Sagot, Clara Rivera, Annette Rios, Isabel Papadimitriou, Salomey Osei, Pedro Javier Ortiz Suárez, Iroro Orife, Kelechi Ogueji, Andre Niyongabo Rubungo, Toan Q. Nguyen, Mathias Müller, André Müller, Shamsuddeen Hassan Muhammad, Nanda Muhammad, Ayanda Mnyakeni, Jamshidbek Mirzakhalov, Tapiwanashe Matangira, Colin Leong, Nze Lawson, Sneha Kudugunta, Yacine Jernite, Mathias Jenny, Orhan Firat, Bonaventure F. P. Dossou, Sakhile Dlamini, Nisansa de Silva, Sakine Çabuk Balli, Stella Biderman, Alessia Battisti, Ahmed Baruwa, Ankur Bapna, Pallavi Baljekar, Israel Abebe Azime, Ayodele Awokoya, Duygu Ataman, Orevaoghene Ahia, Oghenefego Ahia, Sweta Agrawal, Mofetoluwa Adeyemi

Trans. Assoc. Comput. Linguistics, 2022

Building Machine Translation Systems for the Next Thousand Languages.

Ankur Bapna, Isaac Caswell, Julia Kreutzer, Orhan Firat, Daan van Esch, Aditya Siddhant, Mengmeng Niu, Pallavi Baljekar, Xavier Garcia, Wolfgang Macherey, Theresa Breiner, Vera Axelrod, Jason Riesa, Yuan Cao, Mia Xu Chen, Klaus Macherey, Maxim Krikun, Pidong Wang, Alexander Gutkin, Apurva Shah, Yanping Huang, Zhifeng Chen, Yonghui Wu, Macduff Hughes

CoRR, 2022

Using natural language prompts for machine translation.

Xavier Garcia, Orhan Firat

CoRR, 2022

Data Scaling Laws in NMT: The Effect of Noise and Architecture.

Yamini Bansal, Behrooz Ghorbani, Ankush Garg, Biao Zhang, Maxim Krikun, Colin Cherry, Behnam Neyshabur, Orhan Firat

CoRR, 2022

Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning.

Aditya Siddhant, Ankur Bapna, Orhan Firat, Yuan Cao, Mia Xu Chen, Isaac Caswell, Xavier Garcia

CoRR, 2022

Do Current Multi-Task Optimization Methods in Deep Learning Even Help?

Derrick Xin, Behrooz Ghorbani, Justin Gilmer, Ankush Garg, Orhan Firat

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

XTREME-S: Evaluating Cross-lingual Speech Representations.

Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Examining Scaling and Transfer of Language Model Architectures for Machine Translation.

Biao Zhang, Behrooz Ghorbani, Ankur Bapna, Yong Cheng, Xavier Garcia, Jonathan Shen, Orhan Firat

Proceedings of the International Conference on Machine Learning, 2022

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts.

Nan Du, Yanping Huang, Andrew M. Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, Barret Zoph, Liam Fedus, Maarten P. Bosma, Zongwei Zhou, Tao Wang, Yu Emma Wang, Kellie Webster, Marie Pellat, Kevin Robinson, Kathleen S. Meier-Hellstern, Toju Duke, Lucas Dixon, Kun Zhang, Quoc V. Le, Yonghui Wu, Zhifeng Chen, Claire Cui

Proceedings of the International Conference on Machine Learning, 2022

Data Scaling Laws in NMT: The Effect of Noise and Architecture.

Yamini Bansal, Behrooz Ghorbani, Ankush Garg, Biao Zhang, Colin Cherry, Behnam Neyshabur, Orhan Firat

Proceedings of the International Conference on Machine Learning, 2022

A Loss Curvature Perspective on Training Instabilities of Deep Learning Models.

Justin Gilmer, Behrooz Ghorbani, Ankush Garg, Sneha Kudugunta, Behnam Neyshabur, David Cardoze, George Edward Dahl, Zachary Nado, Orhan Firat

Proceedings of the Tenth International Conference on Learning Representations, 2022

Scaling Laws for Neural Machine Translation.

Behrooz Ghorbani, Orhan Firat, Markus Freitag, Ankur Bapna, Maxim Krikun, Xavier Garcia, Ciprian Chelba, Colin Cherry

Proceedings of the Tenth International Conference on Learning Representations, 2022

Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents.

Biao Zhang, Ankur Bapna, Melvin Johnson, Ali Dabirmoghaddam, Naveen Arivazhagan, Orhan Firat

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation.

Yong Cheng, Ankur Bapna, Orhan Firat, Yuan Cao, Pidong Wang, Wolfgang Macherey

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

A Loss Curvature Perspective on Training Instability in Deep Learning.

Justin Gilmer, Behrooz Ghorbani, Ankush Garg, Sneha Kudugunta, Behnam Neyshabur, David Cardoze, George E. Dahl, Zachary Nado, Orhan Firat

CoRR, 2021

Towards Zero-Label Language Learning.

Zirui Wang, Adams Wei Yu, Orhan Firat, Yuan Cao

CoRR, 2021

Evaluating Multiway Multilingual NMT in the Turkic Languages.

Jamshidbek Mirzakhalov, Anoop Babu, Aigiz Kunafin, Ahsan Wahab, Behzod Moydinboyev, Sardana Ivanova, Mokhiyakhon Uzokova, Shaxnoza Pulatova, Duygu Ataman, Julia Kreutzer, Francis M. Tyers, Orhan Firat, John Licato, Sriram Chellappan

CoRR, 2021

Towards Universality in Multilingual Text Rewriting.

Xavier Garcia, Noah Constant, Mandy Guo, Orhan Firat

CoRR, 2021

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation.

Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson

CoRR, 2021

Gradient-guided Loss Masking for Neural Machine Translation.

Xinyi Wang, Ankur Bapna, Melvin Johnson, Orhan Firat

CoRR, 2021

Evaluating Multiway Multilingual NMT in the Turkic Languages.

Jamshidbek Mirzakhalov, Anoop Babu, Aigiz Kunafin, Ahsan Wahab, Behzodbek Moydinboyev, Sardana Ivanova, Mokhiyakhon Uzokova, Shaxnoza Pulatova, Duygu Ataman, Julia Kreutzer, Francis M. Tyers, Orhan Firat, John Licato, Sriram Chellappan

Proceedings of the Sixth Conference on Machine Translation, 2021

Explicit Alignment Objectives for Multilingual Bidirectional Encoders.

Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages.

Xavier Garcia, Aditya Siddhant, Orhan Firat, Ankur P. Parikh

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution.

Xavier Garcia, Noah Constant, Ankur P. Parikh, Orhan Firat

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation.

Biao Zhang, Ankur Bapna, Rico Sennrich, Orhan Firat

Proceedings of the 9th International Conference on Learning Representations, 2021

Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models.

Zirui Wang, Yulia Tsvetkov, Orhan Firat, Yuan Cao

Proceedings of the 9th International Conference on Learning Representations, 2021

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding.

Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, Zhifeng Chen

Proceedings of the 9th International Conference on Learning Representations, 2021

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation.

Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Dan Garrette, Graham Neubig, Melvin Johnson

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

A Large-Scale Study of Machine Translation in Turkic Languages.

Jamshidbek Mirzakhalov, Anoop Babu, Duygu Ataman, Sherzod Kariev, Francis M. Tyers, Otabek Abduraufov, Mammad Hajili, Sardana Ivanova, Abror Khaytbaev, Antonio Laverghetta Jr., Behzodbek Moydinboyev, Esra Onal, Shaxnoza Pulatova, Ahsan Wahab, Orhan Firat, Sriram Chellappan

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference.

Sneha Kudugunta, Yanping Huang, Ankur Bapna, Maxim Krikun, Dmitry Lepikhin, Minh-Thang Luong, Orhan Firat

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

2020

Rapid Domain Adaptation for Machine Translation with Monolingual Data.

Mahdis Mahdieh, Mia Xu Chen, Yuan Cao, Orhan Firat

CoRR, 2020

Towards End-to-End In-Image Neural Machine Translation.

Elman Mansimov, Mitchell Stern, Mia Xu Chen, Orhan Firat, Jakob Uszkoreit, Puneet Jain

CoRR, 2020

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization.

Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson

CoRR, 2020

Controlling Computation versus Quality for Neural Sequence Models.

Ankur Bapna, Naveen Arivazhagan, Orhan Firat

CoRR, 2020

Complete Multilingual Neural Machine Translation.

Markus Freitag, Orhan Firat

Proceedings of the Fifth Conference on Machine Translation, 2020

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation.

Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson

Proceedings of the 37th International Conference on Machine Learning, 2020

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation.

Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Xu Chen, Sneha Reddy Kudugunta, Naveen Arivazhagan, Yonghui Wu

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

On the Discrepancy between Density Estimation and Sequence Generation.

Jason Lee, Dustin Tran, Orhan Firat, Kyunghyun Cho

Proceedings of the Fourth Workshop on Structured Prediction for NLP@EMNLP 2020, 2020

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation.

Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Ari, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019

Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation.

Sébastien Jean, Ankur Bapna, Orhan Firat

CoRR, 2019

Simple, Scalable Adaptation for Neural Machine Translation.

Ankur Bapna, Naveen Arivazhagan, Orhan Firat

CoRR, 2019

Adaptive Scheduling for Multi-Task Learning.

Sébastien Jean, Orhan Firat, Melvin Johnson

CoRR, 2019

Investigating Multilingual NMT Representations at Scale.

Sneha Reddy Kudugunta, Ankur Bapna, Isaac Caswell, Naveen Arivazhagan, Orhan Firat

CoRR, 2019

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation.

Aditya Siddhant, Melvin Johnson, Henry Tsai, Naveen Arivazhagan, Jason Riesa, Ankur Bapna, Orhan Firat, Karthik Raman

CoRR, 2019

Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges.

Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Dmitry Lepikhin, Melvin Johnson, Maxim Krikun, Mia Xu Chen, Yuan Cao, George F. Foster, Colin Cherry, Wolfgang Macherey, Zhifeng Chen, Yonghui Wu

CoRR, 2019

The Missing Ingredient in Zero-Shot Neural Machine Translation.

Naveen Arivazhagan, Ankur Bapna, Orhan Firat, Roee Aharoni, Melvin Johnson, Wolfgang Macherey

CoRR, 2019

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling.

Jonathan Shen, Patrick Nguyen, Yonghui Wu, Zhifeng Chen, Mia Xu Chen, Ye Jia, Anjuli Kannan, Tara N. Sainath, Yuan Cao, Chung-Cheng Chiu, Yanzhang He, Jan Chorowski, Smit Hinsu, Stella Laurenzo, James Qin, Orhan Firat, Wolfgang Macherey, Suyog Gupta, Ankur Bapna, Shuyuan Zhang, Ruoming Pang, Ron J. Weiss, Rohit Prabhavalkar, Qiao Liang, Benoit Jacob, Bowen Liang, HyoukJoong Lee, Ciprian Chelba, Sébastien Jean, Bo Li, Melvin Johnson, Rohan Anil, Rajat Tibrewal, Xiaobing Liu, Akiko Eriguchi, Navdeep Jaitly, Naveen Ari, Colin Cherry, Parisa Haghani, Otavio Good, Youlong Cheng, Raziel Alvarez, Isaac Caswell, Wei-Ning Hsu, Zongheng Yang, Kuan-Chieh Wang, Ekaterina Gonina, Katrin Tomanek, Ben Vanik, Zelin Wu, Llion Jones, Mike Schuster, Yanping Huang, Dehao Chen, Kazuki Irie, George F. Foster, John Richardson, Klaus Macherey, Antoine Bruguier, Heiga Zen, Colin Raffel, Shankar Kumar, Kanishka Rao, David Rybach, Matthew Murray, Vijayaditya Peddinti, Maxim Krikun, Michiel Bacchiani, Thomas B. Jablin, Robert Suderman, Ian Williams, Benjamin Lee, Deepti Bhatia, Justin Carlson, Semih Yavuz, Yu Zhang, Ian McGraw, Max Galkin, Qi Ge, Golan Pundak, Chad Whipkey, Todd Wang, Uri Alon, Dmitry Lepikhin, Ye Tian, Sara Sabour, William Chan, Shubham Toshniwal, Baohua Liao, Michael Nirschl, Pat Rondon

CoRR, 2019

Findings of the First Shared Task on Machine Translation Robustness.

Xian Li, Paul Michel, Antonios Anastasopoulos, Yonatan Belinkov, Nadir Durrani, Orhan Firat, Philipp Koehn, Graham Neubig, Juan Miguel Pino, Hassan Sajjad

Proceedings of the Fourth Conference on Machine Translation, 2019

GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism.

Yanping Huang, Youlong Cheng, Ankur Bapna, Orhan Firat, Dehao Chen, Mia Xu Chen, HyoukJoong Lee, Jiquan Ngiam, Quoc V. Le, Yonghui Wu, Zhifeng Chen

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Non-Parametric Adaptation for Neural Machine Translation.

Ankur Bapna, Orhan Firat

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Massively Multilingual Neural Machine Translation.

Roee Aharoni, Melvin Johnson, Orhan Firat

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Investigating Multilingual NMT Representations at Scale.

Sneha Reddy Kudugunta, Ankur Bapna, Isaac Caswell, Orhan Firat

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Simple, Scalable Adaptation for Neural Machine Translation.

Ankur Bapna, Orhan Firat

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

On the Importance of Word Boundaries in Character-level Neural Machine Translation.

Duygu Ataman, Orhan Firat, Mattia Antonino Di Gangi, Marcello Federico, Alexandra Birch

Proceedings of the 3rd Workshop on Neural Generation and Translation@EMNLP-IJCNLP 2019, 2019

2018

Zero-Shot Cross-lingual Classification Using Multilingual Neural Machine Translation.

Akiko Eriguchi, Melvin Johnson, Orhan Firat, Hideto Kazawa, Wolfgang Macherey

CoRR, 2018

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation.

Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Niki Parmar, Mike Schuster, Zhifeng Chen, Yonghui Wu, Macduff Hughes

CoRR, 2018

Revisiting Character-Based Neural Machine Translation with Capacity and Compression.

Colin Cherry, George F. Foster, Ankur Bapna, Orhan Firat, Wolfgang Macherey

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Training Deeper Neural Machine Translation Models with Transparent Attention.

Ankur Bapna, Mia Xu Chen, Orhan Firat, Yuan Cao, Yonghui Wu

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation.

Mia Xu Chen, Orhan Firat, Ankur Bapna, Melvin Johnson, Wolfgang Macherey, George F. Foster, Llion Jones, Mike Schuster, Noam Shazeer, Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Lukasz Kaiser, Zhifeng Chen, Yonghui Wu, Macduff Hughes

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Connectionist multi-sequence modelling and applications to multilingual neural machine translation ; Bağlantıcı çoklu dizi modelleme ve çok dilli nöral makina çevirisi uygulamaları.

Orhan Firat

PhD thesis, 2017

On integrating a language model into neural machine translation.

Çaglar Gülçehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Yoshua Bengio

Comput. Speech Lang., 2017

Multi-way, multilingual neural machine translation.

Orhan Firat, Kyunghyun Cho, Baskaran Sankaran, Fatos T. Yarman-Vural, Yoshua Bengio

Comput. Speech Lang., 2017

Learning Joint Multilingual Sentence Representations with Neural Machine Translation.

Holger Schwenk, Ke M. Tran, Orhan Firat, Matthijs Douze

CoRR, 2017

Does Neural Machine Translation Benefit from Larger Context?

Sébastien Jean, Stanislas Lauly, Orhan Firat, Kyunghyun Cho

CoRR, 2017

Nematus: a Toolkit for Neural Machine Translation.

Rico Sennrich, Orhan Firat, Kyunghyun Cho, Alexandra Birch, Barry Haddow, Julian Hitschler, Marcin Junczys-Dowmunt, Samuel Läubli, Antonio Valerio Miceli Barone, Jozef Mokry, Maria Nadejde

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017

Neural Machine Translation for Cross-Lingual Pronoun Prediction.

Sébastien Jean, Stanislas Lauly, Orhan Firat, Kyunghyun Cho

Proceedings of the Third Workshop on Discourse in Machine Translation, 2017

2016

Theano: A Python framework for fast computation of mathematical expressions.

Rami Al-Rfou, Guillaume Alain, Amjad Almahairi, Christof Angermüller, Dzmitry Bahdanau, Nicolas Ballas, Frédéric Bastien, Justin Bayer, Anatoly Belikov, Alexander Belopolsky, Yoshua Bengio, Arnaud Bergeron, James Bergstra, Valentin Bisson, Josh Bleecher Snyder, Nicolas Bouchard, Nicolas Boulanger-Lewandowski, Xavier Bouthillier, Alexandre de Brébisson, Olivier Breuleux, Pierre Luc Carrier, Kyunghyun Cho, Jan Chorowski, Paul F. Christiano, Tim Cooijmans, Marc-Alexandre Côté, Myriam Côté, Aaron C. Courville, Yann N. Dauphin, Olivier Delalleau, Julien Demouth, Guillaume Desjardins, Sander Dieleman, Laurent Dinh, Melanie Ducoffe, Vincent Dumoulin, Samira Ebrahimi Kahou, Dumitru Erhan, Ziye Fan, Orhan Firat, Mathieu Germain, Xavier Glorot, Ian J. Goodfellow, Matthew Graham, Çaglar Gülçehre, Philippe Hamel, Iban Harlouchet, Jean-Philippe Heng, Balázs Hidasi, Sina Honari, Arjun Jain, Sébastien Jean, Kai Jia, Mikhail Korobov, Vivek Kulkarni, Alex Lamb, Pascal Lamblin, Eric Larsen, César Laurent, Sean Lee, Simon Lefrançois, Simon Lemieux, Nicholas Léonard, Zhouhan Lin, Jesse A. Livezey, Cory Lorenz, Jeremiah Lowin, Qianli Ma, Pierre-Antoine Manzagol, Olivier Mastropietro, Robert McGibbon, Roland Memisevic, Bart van Merriënboer, Vincent Michalski, Mehdi Mirza, Alberto Orlandi, Christopher Joseph Pal, Razvan Pascanu, Mohammad Pezeshki, Colin Raffel, Daniel Renshaw, Matthew Rocklin, Adriana Romero, Markus Roth, Peter Sadowski, John Salvatier, François Savard, Jan Schlüter, John Schulman, Gabriel Schwartz, Iulian Vlad Serban, Dmitriy Serdyuk, Samira Shabanian, Étienne Simon, Sigurd Spieckermann, S. Ramana Subramanyam, Jakub Sygnowski, Jérémie Tanguay, Gijs van Tulder, Joseph P. Turian, Sebastian Urban, Pascal Vincent, Francesco Visin, Harm de Vries, David Warde-Farley, Dustin J. Webb, Matthew Willson, Kelvin Xu, Lijun Xue, Li Yao, Saizheng Zhang, Ying Zhang

CoRR, 2016

Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism.

Orhan Firat, Kyunghyun Cho, Yoshua Bengio

Proceedings of the NAACL HLT 2016, 2016

Zero-Resource Translation with Multi-Lingual Neural Machine Translation.

Orhan Firat, Baskaran Sankaran, Yaser Al-Onaizan, Fatos T. Yarman-Vural, Kyunghyun Cho

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

2015

On Using Monolingual Corpora in Neural Machine Translation.

Çaglar Gülçehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Loïc Barrault, Huei-Chi Lin, Fethi Bougares, Holger Schwenk, Yoshua Bengio

CoRR, 2015

Montreal Neural Machine Translation Systems for WMT'15.

Sébastien Jean, Orhan Firat, Kyunghyun Cho, Roland Memisevic, Yoshua Bengio

Proceedings of the Tenth Workshop on Statistical Machine Translation, 2015

Bilişsel durum analizi i~in beyin Aği modeli.

Itir Onal, Emre Aksan, Burak Velioglu, Orhan Firat, Mete Ozay, Fatos T. Yarman-Vural

Proceedings of the 2015 23nd Signal Processing and Communications Applications Conference (SIU), 2015

Learning Deep Temporal Representations for fMRI Brain Decoding.

Orhan Firat, Emre Aksan, Ilke Öztekin, Fatos T. Yarman-Vural

Proceedings of the Machine Learning Meets Medical Imaging - First International Workshop, 2015

2014

Estimating brain connectivity for pattern analysis.

Itir Önal, Emre Aksan, Burak Velioglu, Orhan Firat, Mete Ozay, Like Oztekin, Fatos T. Yarman-Vural

Proceedings of the 2014 22nd Signal Processing and Communications Applications Conference (SIU), 2014

Modeling the Brain Connectivity for Pattern Analysis.

Itir Onal, Emre Aksan, Burak Velioglu, Orhan Firat, Mete Ozay, Ilke Öztekin, Fatos T. Yarman-Vural

Proceedings of the 22nd International Conference on Pattern Recognition, 2014

Representation Learning for Contextual Object and Region Detection in Remote Sensing.

Orhan Firat, Gulcan Can, Fatos T. Yarman-Vural

Proceedings of the 22nd International Conference on Pattern Recognition, 2014

Deep learning for brain decoding.

Orhan Firat, Like Oztekin, Fatos T. Yarman-Vural

Proceedings of the 2014 IEEE International Conference on Image Processing, 2014

Functional networks of anatomic brain regions.

Burak Velioglu, Emre Aksan, Itir Onal, Orhan Firat, Mete Ozay, Fatos T. Yarman-Vural

Proceedings of the IEEE 13th International Conference on Cognitive Informatics and Cognitive Computing, 2014

2013

Enhancing Local Linear Models Using Functional Connectivity for Brain State Decoding.

Orhan Firat, Mete Özay, Itir Önal, Ilke Öztekin, Fatos T. Yarman-Vural

Int. J. Cogn. Informatics Nat. Intell., 2013

Information distribution analysis in the fMRI measurements with degree of locality estimation.

Itir Önal, Mete Ozay, Orhan Firat, Ilke Öztekin, Fatos T. Yarman-Vural

Proceedings of the 21st Signal Processing and Communications Applications Conference, 2013

Representation learning with convolutional sparse autoencoders for remote sensing.

Orhan Firat, Fatos T. Yarman-Vural

Proceedings of the 21st Signal Processing and Communications Applications Conference, 2013

Cognitive process representation with minimum spanning tree of local meshes.

Orhan Firat, Mete Ozay, Itir Önal, Ilke Öztekin, Fatos T. Yarman-Vural

Proceedings of the 21st Signal Processing and Communications Applications Conference, 2013

Contextual object recoğnition with conditional random fields.

Gulcan Can, Orhan Firat, Fatos T. Yarman-Vural

Proceedings of the 21st Signal Processing and Communications Applications Conference, 2013

Dry dock detection in satellite images with representation learning.

Ümit Rusen Aktas, Orhan Firat, Fatos T. Yarman-Vural

Proceedings of the 21st Signal Processing and Communications Applications Conference, 2013

Mesh learning for object classification using fMRI measurements.

Omer Ekmekci, Orhan Firat, Mete Ozay, Ilke Öztekin, Fatos T. Yarman-Vural, Uygar Öztekin

Proceedings of the IEEE International Conference on Image Processing, 2013

Analyzing the information distribution in the fMRI measurements by estimating the degree of locality.

Itir Onal, Mete Ozay, Orhan Firat, Ilke Öztekin, Fatos Tünay Yarman Vural

Proceedings of the 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2013

Representation of cognitive processes using the minimum spanning tree of local meshes.

Orhan Firat, Mete Ozay, Itir Onal, Ilke Öztekin, Fatos Tünay Yarman Vural

Proceedings of the 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2013

An information theoretic approach to classify cognitive states using fMRI.

Itir Onal, Mete Ozay, Orhan Firat, Ilke Öztekin, Fatos T. Yarman-Vural

Proceedings of the 13th IEEE International Conference on BioInformatics and BioEngineering, 2013

Functional Mesh Learning for pattern analysis of cognitive processes.

Orhan Firat, Mete Ozay, Itir Onal, Ilke Öztekin, Fatos T. Yarman-Vural

Proceedings of the IEEE 12th International Conference on Cognitive Informatics and Cognitive Computing, 2013

2012

Conditional Random Fields for Land Use/Land Cover Classification and Complex Region Detection.

Gulcan Can, Orhan Firat, Fatos Tünay Yarman Vural

Proceedings of the Structural, Syntactic, and Statistical Pattern Recognition, 2012

Application of context invariants in airport region of interest detection for multi-spectral satellite imagery.

Orhan Firat, Okan Tarhan Tursun, Fatos T. Yarman-Vural

Proceedings of the 20th Signal Processing and Communications Applications Conference, 2012

Mesh learning approach for brain data modeling.

Orhan Firat, Mete Ozay, Itir Önal, Ilke Öztekin, Fatos T. Yarman-Vural

Proceedings of the 20th Signal Processing and Communications Applications Conference, 2012