Jacob Devlin

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
2019Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)48K citations Open access
OpenAlex
PaLM: Scaling Language Modeling with Pathways
Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma +63 more
2022arXiv (Cornell University)2,555 citations Open access
OpenAlex
Natural Questions: A Benchmark for Question Answering Research
Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins +14 more
2019Transactions of the Association for Computational Linguistics2,068 citations Open access
OpenAlex
Scaling Instruction-Finetuned Language Models
Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph +31 more
2022arXiv (Cornell University)1,440 citations Open access
OpenAlex
Gemini: A Family of Highly Capable Multimodal Models
Gemini Robotics Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac +96 more
2023arXiv (Cornell University)988 citations Open access
OpenAlex
Fast and Robust Neural Network Joint Models for Statistical Machine Translation
Jacob Devlin, Rabih M. Zbib, Zhongqiang Huang, Thomas Lamar +2 more
2014Annual Meeting of the Association for Computational Linguistics (ACL)481 citations Open access
OpenAlex
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Gemini Robotics Team, Petko Georgiev, Ving Ian Lei, Ryan Burnell +96 more
2024arXiv (Cornell University)302 citations Open access
OpenAlex
Generating Natural Questions About an Image
Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell +2 more
2016Annual Meeting of the Association for Computational Linguistics (ACL)271 citations Open access
OpenAlex
Visual Storytelling
Ting-Hao Huang, Francis Ferraro, Nasrin Mostafazadeh, Ishan Misra +11 more
2016Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)254 citations Open access
OpenAlex
Zero-Shot Entity Linking by Reading Entity Descriptions
Lajanugen Logeswaran, Ming-Wei Chang, Kenton Lee, Kristina Toutanova +2 more
2019Annual Meeting of the Association for Computational Linguistics (ACL)247 citations Open access
OpenAlex
Universal Neural Machine Translation for Extremely Low Resource Languages
Jiatao Gu, Hany Hassan, Jacob Devlin, Victor O. K. Li
2018Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)231 citations Open access
OpenAlex
Synthetic QA Corpora Generation with Roundtrip Consistency
Chris Alberti, Daniel Andor, Emily Pitler, Jacob Devlin +1 more
2019Annual Meeting of the Association for Computational Linguistics (ACL)210 citations Open access
OpenAlex
Language Models for Image Captioning: The Quirks and What Works
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta +4 more
2015207 citations Open access
OpenAlex
Machine Translation of Arabic Dialects
Rabih M. Zbib, Erika Malchiodi, Jacob Devlin, David G. Stallard +5 more
2012179 citations
OpenAlex
PaLM 2 Technical Report
Rohan Anil, Andrew M. Dai, Orhan Fırat, Melvin Johnson +96 more
2023arXiv (Cornell University)158 citations Open access
OpenAlex
Exploring Nearest Neighbor Approaches for Image Captioning
Jacob Devlin, Saurabh Gupta, Ross Girshick, Margaret Mitchell +1 more
2015arXiv (Cornell University)148 citations Open access
OpenAlex
RobustFill: Neural Program Learning under Noisy I/O
Jacob Devlin, Jonathan Uesato, Surya Bhupatiraju, Rishabh Singh +2 more
2017arXiv (Cornell University)127 citations Open access
OpenAlex
Efficiently Scaling Transformer Inference
Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin +6 more
2022arXiv (Cornell University)113 citations Open access
OpenAlex
Language Models for Image Captioning: The Quirks and What Works
Jacob Devlin, Hao Cheng, Hao Fang, Saurabh Gupta +4 more
2015arXiv (Cornell University)98 citations Open access
OpenAlex
Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis
Rudy Bunel, Matthew Hausknecht, Jacob Devlin, Rishabh Singh +1 more
2018arXiv (Cornell University)94 citations Open access
OpenAlex
Visual Storytelling
Ting-Hao, Huang, Francis Ferraro, Nasrin Mostafazadeh +12 more
2016arXiv (Cornell University)89 citations Open access
OpenAlex
A Survey of Current Datasets for Vision and Language Research
Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao, Lucy Vanderwende +3 more
2015Conference on Empirical Methods in Natural Language Processing (EMNLP)68 citations Open access
OpenAlex
Universal Neural Machine Translation for Extremely Low Resource Languages
Jiatao Gu, Hany Hassan, Jacob Devlin, Victor O. K. Li
2018arXiv (Cornell University)38 citations Open access
OpenAlex
Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU
Jacob Devlin
2017Conference on Empirical Methods in Natural Language Processing (EMNLP)30 citations Open access
OpenAlex
Semantic Code Repair using Neuro-Symbolic Transformation Networks
Jacob Devlin, Jonathan Uesato, Rishabh Singh, Pushmeet Kohli
2017arXiv (Cornell University)28 citations Open access
OpenAlex
Unsupervised Morphology Rivals Supervised Morphology for Arabic MT
David G. Stallard, Jacob Devlin, Michael Kayser, Yoong Keok Lee +1 more
201219 citations
OpenAlex
Language Model Pre-training for Hierarchical Document Representations
Chang, Ming-Wei, Kristina Toutanova, Kenton Lee, Jacob Devlin
2019arXiv (Cornell University)15 citations Open access
OpenAlex
Statistical Machine Translation Features with Multitask Tensor Networks
Hendra Setiawan, Zhongqiang Huang, Jacob Devlin, Thomas Lamar +3 more
201515 citations Open access
OpenAlex
Trait-Based Hypothesis Selection For Machine Translation
Jacob Devlin, Spyros Matsoukas
201215 citations
OpenAlex
Lexical Features for Statistical Machine Translation
Jacob Devlin
2009University Libraries (University of Maryland)15 citations
OpenAlex
Neural Program Meta-Induction
Jacob Devlin, Rudy Bunel, Rishabh Singh, Matthew Hausknecht +1 more
2017arXiv (Cornell University)14 citations Open access
OpenAlex
Synthetic QA Corpora Generation with Roundtrip Consistency
Chris Alberti, Daniel Andor, Emily Pitler, Jacob Devlin +1 more
2019arXiv (Cornell University)13 citations Open access
OpenAlex
Factored Soft Source Syntactic Constraints for Hierarchical Machine Translation
Zhongqiang Huang, Jacob Devlin, Rabih M. Zbib
2013Conference on Empirical Methods in Natural Language Processing (EMNLP)13 citations Open access
OpenAlex
BBN's Systems for the Chinese-English Sub-task of the NTCIR-10 PatentMT Evaluation.
Zhongqiang Huang, Jacob Devlin, Spyros Matsoukas
201113 citations
OpenAlex
Multi-Vector Attention Models for Deep Re-ranking
Giulio Zhou, Jacob Devlin
2021Conference on Empirical Methods in Natural Language Processing (EMNLP)12 citations Open access
OpenAlex
BBN TransTalk: Robust multilingual two-way speech-to-speech translation for mobile platforms
Rohit Prasad, Prem Natarajan, David G. Stallard, Shirin Saleem +9 more
2011Computer Speech & Language12 citations
OpenAlex
Statistical Machine Translation as a Language Model for Handwriting Recognition
Jacob Devlin, Matin Kamali, Krishna Subramanian, Rohit Prasad +1 more
2012International Conference on Frontiers in Handwriting Recognition11 citations
OpenAlex
QueryForm: A Simple Zero-shot Form Entity Query Framework
Zifeng Wang, Zizhao Zhang, Jacob Devlin, Chen‐Yu Lee +5 more
20234 citations Open access
OpenAlex
Pre-Computable Multi-Layer Neural Network Language Models
Jacob Devlin, Chris Quirk, Arul Menezes
2015Conference on Empirical Methods in Natural Language Processing (EMNLP)3 citations Open access
OpenAlex
System Combination Using Discriminative Cross-Adaptation
Jacob Devlin, Antti-Veikko I. Rosti, Sankaranarayanan Ananthakrishnan, Spyros Matsoukas
20112 citations
OpenAlex
On Available Corpora for Empirical Methods in Vision & Language.
Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao Huang, Lucy Vanderwende +3 more
2015arXiv (Cornell University)1 citations Open access
OpenAlex
Detecting Interrogative Utterances with Recurrent Neural Networks
Chung, Junyoung, Jacob Devlin, Hany Hassan Awadalla
2015arXiv (Cornell University)0 citations Open access
OpenAlex
Automatic Tune Set Generation for Machine Translation with Limited Indomain Data
Jinying Chen, Jacob Devlin, Huaigu Cao, Rohit Prasad +1 more
20120 citations
OpenAlex

Most-cited papers