Ashish Vaswani

Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit +4 more
202578K citations Open access
OpenAlex
Self-Attention with Relative Position Representations
Peter Martin Shaw, Jakob Uszkoreit, Ashish Vaswani
2018Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)2,500 citations Open access
OpenAlex
Relational inductive biases, deep learning, and graph networks
Peter Battaglia, Hamrick, Jessica B., Victor Bapst, Álvaro Sánchez‐González +23 more
2018arXiv (Cornell University)2,240 citations Open access
OpenAlex
Bottleneck Transformers for Visual Recognition
Aravind Srinivas, Tsung-Yi Lin, Niki Parmar, Jonathon Shlens +2 more
2021IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings1,384 citations Open access
OpenAlex
Attention Augmented Convolutional Networks
Irwan Bello, Barret Zoph, Quoc Viet Le, Ashish Vaswani +1 more
2019IEEE/CVF International Conference on Computer Vision (ICCV)1,321 citations Open access
OpenAlex
Image Transformer
Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Łukasz Kaiser +3 more
2018arXiv (Cornell University)1,085 citations Open access
OpenAlex
Stand-Alone Self-Attention in Vision Models
Prajit Ramachandran, Niki Parmar, Ashish Vaswani, Irwan Bello +2 more
2019arXiv (Cornell University)977 citations Open access
OpenAlex
Efficient Content-Based Sparse Attention with Routing Transformers
Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier
2021Transactions of the Association for Computational Linguistics506 citations Open access
OpenAlex
Scaling Local Self-Attention for Parameter Efficient Visual Backbones
Ashish Vaswani, Prajit Ramachandran, Aravind Srinivas, Niki Parmar +2 more
2021IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings482 citations Open access
OpenAlex
Music Transformer: Generating Music with Long-Term Structure
Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer +6 more
2019International Conference on Learning Representations330 citations
OpenAlex
Learning Whom to Trust with MACE
Dirk Hovy, Taylor Berg-Kirkpatrick, Ashish Vaswani, Eduard H. Hovy
2013Archivio istituzionale della Ricerca - Bocconi276 citations Open access
OpenAlex
One Model To Learn Them All
Łukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani +3 more
2017arXiv (Cornell University)253 citations Open access
OpenAlex
Mesh-TensorFlow: Deep Learning for Supercomputers
Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran +8 more
2018arXiv (Cornell University)234 citations Open access
OpenAlex
Decoding with Large-Scale Neural Language Models Improves Translation
Ashish Vaswani, Yinggong Zhao, Victoria Fossum, David Chiang
2013Conference on Empirical Methods in Natural Language Processing (EMNLP)215 citations Open access
OpenAlex
Tensor2Tensor for Neural Machine Translation
Ashish Vaswani, Samy Bengio, Eugene Brevdo, Chollet, Francois +9 more
2018arXiv (Cornell University)205 citations Open access
OpenAlex
Fast Decoding in Sequence Models using Discrete Latent Variables
Łukasz Kaiser, Aurko Roy, Ashish Vaswani, Niki Parmar +3 more
2018arXiv (Cornell University)169 citations Open access
OpenAlex
Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation
Vihan Jain, Gabriel Magalhaes, Alexander Ku, Ashish Vaswani +2 more
2019Annual Meeting of the Association for Computational Linguistics (ACL)159 citations Open access
OpenAlex
DeepConsensus improves the accuracy of sequences with a gap-aware sequence transformer
Gunjan Baid, Daniel E. Cook, Kishwar Shafin, Taedong Yun +15 more
2022Nature Biotechnology150 citations
OpenAlex
Music Transformer
Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer +6 more
2018arXiv (Cornell University)144 citations Open access
OpenAlex
Aligning context-based statistical models of language with brain activity during reading
Leila Wehbe, Ashish Vaswani, Kevin K. Knight, Tom M. Mitchell
2014Conference on Empirical Methods in Natural Language Processing (EMNLP)95 citations Open access
OpenAlex
Decoding the neural representation of story meanings across languages
Morteza Dehghani, Reihane Boghrati, Kingson Man, Joe Hoover +7 more
2017Human Brain Mapping78 citations Open access
OpenAlex
Supertagging With LSTMs
Ashish Vaswani, Yonatan Bisk, Kenji Sagae, Ryan Musa
2016Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)73 citations Open access
OpenAlex
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus +6 more
2021arXiv (Cornell University)63 citations Open access
OpenAlex
Unsupervised Neural Hidden Markov Models
Ke M. Tran, Yonatan Bisk, Ashish Vaswani, Daniel Marcu +1 more
201656 citations Open access
OpenAlex
An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation
Cheng-Zhi Anna Huang, Ashish Vaswani, Jakob Uszkoreit, Noam Shazeer +4 more
2018arXiv (Cornell University)54 citations Open access
OpenAlex
Theory and Experiments on Vector Quantized Autoencoders
Aurko Roy, Ashish Vaswani, Arvind Neelakantan, Niki Parmar
2018arXiv (Cornell University)50 citations Open access
OpenAlex
The Efficiency Misnomer
Mostafa Dehghani, Anurag Arnab, Lucas Beyer, Ashish Vaswani +1 more
2021arXiv (Cornell University)41 citations Open access
OpenAlex
Hassan: A Virtual Human for Tactical Questioning
David R. Traum, Antonio Roque, Anton Leuski, Panayiotis Georgiou +5 more
2007SIGdial Workshop on Discourse and Dialogue (SIGDIAL)38 citations Open access
OpenAlex
Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies
Barret Zoph, Ashish Vaswani, Jonathan May, Kevin K. Knight
2016Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)34 citations Open access
OpenAlex
Name Tagging for Low-resource Incident Languages based on Expectation-driven Learning
Boliang Zhang, Xiaoman Pan, Tianlu Wang, Ashish Vaswani +3 more
2016Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)32 citations Open access
OpenAlex
Smaller Alignment Models for Better Translations: Unsupervised Word Alignment with the l0-norm
Ashish Vaswani, Liang Huang, David Chiang
201224 citations
OpenAlex
Unifying Bayesian Inference and Vector Space Models for Improved Decipherment
Qing Dou, Ashish Vaswani, Kevin K. Knight, Chris Dyer
201520 citations Open access
OpenAlex
Radiobot-CFF: a spoken dialogue system for military training
Antonio Roque, Anton Leuski, Vivek Rangarajan, Susan M. Robinson +3 more
2006Interspeech (USB)20 citations
OpenAlex
Beyond Parallel Data: Joint Word Alignment and Decipherment Improves Machine Translation
Qing Dou, Ashish Vaswani, Kevin K. Knight
2014Conference on Empirical Methods in Natural Language Processing (EMNLP)18 citations Open access
OpenAlex
Rule Markov Models for Fast Tree-to-String Translation
Ashish Vaswani, Haitao Mi, Liang Huang, David Chiang
201115 citations
OpenAlex
Model Invertibility Regularization: Sequence Alignment With or Without Parallel Data
Tomer Levinboim, Ashish Vaswani, David Chiang
2015Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)14 citations Open access
OpenAlex
Models and Training for Unsupervised Preposition Sense Disambiguation
Dirk Hovy, Ashish Vaswani, Stephen Tratz, David Chiang +1 more
201112 citations
OpenAlex
Towards a better understanding of Vector Quantized Autoencoders
Aurko Roy, Ashish Vaswani, Niki Parmar, Arvind Neelakantan
201811 citations
OpenAlex
Efficient Structured Inference for Transition-Based Parsing with Neural Networks and Error States
Ashish Vaswani, Kenji Sagae
2016Transactions of the Association for Computational Linguistics11 citations Open access
OpenAlex
Decoding the Neural Representation of Story Meanings across Languages
Morteza Dehghani, Reihane Boghrati, Kingson Man, Joe Hoover +7 more
201710 citations Open access
OpenAlex
Fast, Greedy Model Minimization for Unsupervised Tagging
Sujith Ravi, Ashish Vaswani, Kevin K. Knight, David Chiang
201010 citations
OpenAlex
Evaluation of a Spoken Dialogue System for Virtual Reality Call for Fire Training
Susan M. Robinson, Antonio Roque, Ashish Vaswani, David R. Traum +2 more
200710 citations
OpenAlex
Efficient Optimization of an MDL-Inspired Objective Function for Unsupervised Part-Of-Speech Tagging
Ashish Vaswani, Adam Pauls, David Chiang
20109 citations
OpenAlex
A Virtual Human for Tactical Questioning
Bilyana Martinovski, David R. Traum, Antônio C. Roque, Anton Leuski +5 more
2007Borås Academic Digital Archive (University of Borås)9 citations
OpenAlex
DeepConsensus: Gap-Aware Sequence Transformers for Sequence Correction
Gunjan Baid, Daniel E. Cook, Kishwar Shafin, Taedong Yun +14 more
2021bioRxiv (Cold Spring Harbor Laboratory)8 citations Open access
OpenAlex
Guest Editorial Introduction to the Special Section on Transformer Models in Vision
Salman Hameed Khan, Fahad Shahbaz Khan, Ashish Vaswani, Niki Parmar +2 more
2023IEEE Transactions on Pattern Analysis and Machine Intelligence6 citations Open access
OpenAlex
The International Workshop on Language Preservation: An Experiment in Text Collection and Language Technology
Steven Bird, David Chiang, Friedel Martin Frowein, Andrea L. Berez-Kroeker +5 more
2013OLAC - Open Language Archives Community6 citations Open access
OpenAlex
Simple and Efficient ways to Improve REALM
Vidhisha Balachandran, Ashish Vaswani, Yulia Tsvetkov, Niki Parmar
20214 citations Open access
OpenAlex
Studying Stand-Alone Self-Attention in Vision Models
Prajit Ramachandran, Niki Parmar, Ashish Vaswani, Irwan Bello +2 more
20193 citations
OpenAlex
Visualizing Music Self-Attention
Anna Huang, Monica Dinculescu, Ashish Vaswani, Douglas Eck C
20182 citations
OpenAlex

Most-cited papers