Jacob Devlin

According to our database, Jacob Devlin authored at least 40 papers between 2011 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Scaling Instruction-Finetuned Language Models.

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei

J. Mach. Learn. Res., 2024

2023

PaLM: Scaling Language Modeling with Pathways.

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel

J. Mach. Learn. Res., 2023

PaLM 2 Technical Report.

Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.

CoRR, 2023

Efficiently Scaling Transformer Inference.

Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Jonathan Heek, Kefan Xiao, Shivani Agrawal, Jeff Dean

Proceedings of the Sixth Conference on Machine Learning and Systems, 2023

QueryForm: A Simple Zero-shot Form Entity Query Framework.

Zifeng Wang, Zizhao Zhang, Jacob Devlin, Chen-Yu Lee, Guolong Su, Hao Zhang, Jennifer G. Dy, Vincent Perot, Tomas Pfister

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

Efficiently Scaling Transformer Inference.

Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Anselm Levskaya, Jonathan Heek, Kefan Xiao, Shivani Agrawal, Jeff Dean

CoRR, 2022

Scaling Instruction-Finetuned Language Models.

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei

CoRR, 2022

2021

Multi-Vector Attention Models for Deep Re-ranking.

Giulio Zhou, Jacob Devlin

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

2019

Natural Questions: a Benchmark for Question Answering Research.

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur P. Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, Slav Petrov

Trans. Assoc. Comput. Linguistics, 2019

Language Model Pre-training for Hierarchical Document Representations.

Ming-Wei Chang, Kristina Toutanova, Kenton Lee, Jacob Devlin

CoRR, 2019

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.

Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Zero-Shot Entity Linking by Reading Entity Descriptions.

Lajanugen Logeswaran, Ming-Wei Chang, Kenton Lee, Kristina Toutanova, Jacob Devlin, Honglak Lee

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

Synthetic QA Corpora Generation with Roundtrip Consistency.

Chris Alberti, Daniel Andor, Emily Pitler, Jacob Devlin, Michael Collins

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Universal Neural Machine Translation for Extremely Low Resource Languages.

Jiatao Gu, Hany Hassan, Jacob Devlin, Victor O. K. Li

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis.

Rudy Bunel, Matthew J. Hausknecht, Jacob Devlin, Rishabh Singh, Pushmeet Kohli

Proceedings of the 6th International Conference on Learning Representations, 2018

2017

Semantic Code Repair using Neuro-Symbolic Transformation Networks.

Jacob Devlin, Jonathan Uesato, Rishabh Singh, Pushmeet Kohli

CoRR, 2017

Neural Program Meta-Induction.

Jacob Devlin, Rudy Bunel, Rishabh Singh, Matthew J. Hausknecht, Pushmeet Kohli

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

RobustFill: Neural Program Learning under Noisy I/O.

Jacob Devlin, Jonathan Uesato, Surya Bhupatiraju, Rishabh Singh, Abdel-rahman Mohamed, Pushmeet Kohli

Proceedings of the 34th International Conference on Machine Learning, 2017

Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU.

Jacob Devlin

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017

2016

Generating Natural Questions About an Image.

Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Larry Zitnick, Margaret Mitchell, Xiaodong He, Lucy Vanderwende

CoRR, 2016

Visual Storytelling.

Ting-Hao (Kenneth) Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra, Aishwarya Agrawal, Jacob Devlin, Ross B. Girshick, Xiaodong He, Pushmeet Kohli, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh, Lucy Vanderwende, Michel Galley, Margaret Mitchell

Proceedings of the NAACL HLT 2016, 2016

Generating Natural Questions About an Image.

Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, 2016

2015

On Available Corpora for Empirical Methods in Vision & Language.

Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao (Kenneth) Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell

CoRR, 2015

Exploring Nearest Neighbor Approaches for Image Captioning.

Jacob Devlin, Saurabh Gupta, Ross B. Girshick, Margaret Mitchell, C. Lawrence Zitnick

CoRR, 2015

Detecting Interrogative Utterances with Recurrent Neural Networks.

Junyoung Chung, Jacob Devlin, Hany Hassan Awadalla

CoRR, 2015

A Survey of Current Datasets for Vision and Language Research.

Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao (Kenneth) Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015

Pre-Computable Multi-Layer Neural Network Language Models.

Jacob Devlin, Chris Quirk, Arul Menezes

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015

Statistical Machine Translation Features with Multitask Tensor Networks.

Hendra Setiawan, Zhongqiang Huang, Jacob Devlin, Thomas Lamar, Rabih Zbib, Richard M. Schwartz, John Makhoul

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

Language Models for Image Captioning: The Quirks and What Works.

Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta, Li Deng, Xiaodong He, Geoffrey Zweig, Margaret Mitchell

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

2014

Fast and Robust Neural Network Joint Models for Statistical Machine Translation.

Jacob Devlin, Rabih Zbib, Zhongqiang Huang, Thomas Lamar, Richard M. Schwartz, John Makhoul

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

2013

BBN TransTalk: Robust multilingual two-way speech-to-speech translation for mobile platforms.

Rohit Prasad, Prem Natarajan, David Stallard, Shirin Saleem, Shankar Ananthakrishnan, Stavros Tsakalidis, Chia-Lin Kao, Fred Choi, Ralf Meermeier, Mark Rawls, Jacob Devlin, Kriste Krstovski, Aaron Challenner

Comput. Speech Lang., 2013

BBN's Systems for the Chinese-English Sub-task of the NTCIR-10 PatentMT Evaluation.

Zhongqiang Huang, Jacob Devlin, Spyros Matsoukas

Proceedings of the 10th NTCIR Conference on Evaluation of Information Access Technologies, 2013

Factored Soft Source Syntactic Constraints for Hierarchical Machine Translation.

Zhongqiang Huang, Jacob Devlin, Rabih Zbib

Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013

2012

Machine Translation of Arabic Dialects.

Rabih Zbib, Erika Malchiodi, Jacob Devlin, David Stallard, Spyros Matsoukas, Richard M. Schwartz, John Makhoul, Omar Zaidan, Chris Callison-Burch

Proceedings of the Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, 2012

Trait-Based Hypothesis Selection For Machine Translation.

Jacob Devlin, Spyros Matsoukas

Proceedings of the Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, 2012

Document recognition and translation system for unconstrained Arabic documents.

Huaigu Cao, Jinying Chen, Jacob Devlin, Rohit Prasad, Prem Natarajan

Proceedings of the 21st International Conference on Pattern Recognition, 2012

Statistical Machine Translation as a Language Model for Handwriting Recognition.

Jacob Devlin, Matin Kamali, Krishna Subramanian, Rohit Prasad, Prem Natarajan

Proceedings of the 2012 International Conference on Frontiers in Handwriting Recognition, 2012

Automatic Tune Set Generation for Machine Translation with Limited Indomain Data.

Jinying Chen, Jacob Devlin, Huaigu Cao, Rohit Prasad, Premkumar Natarajan

Proceedings of the 16th Annual conference of the European Association for Machine Translation, 2012

Unsupervised Morphology Rivals Supervised Morphology for Arabic MT.

David Stallard, Jacob Devlin, Michael Kayser, Yoong Keok Lee, Regina Barzilay

Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, July 8-14, 2012, Jeju Island, Korea, 2012

2011

System Combination Using Discriminative Cross-Adaptation.

Jacob Devlin, Antti-Veikko I. Rosti, Sankaranarayanan Ananthakrishnan, Spyros Matsoukas

Proceedings of the Fifth International Joint Conference on Natural Language Processing, 2011