J. Uszkoreit

Most-cited papers

1. Attention is All you Need

   Ashish Vaswani, Noam Shazeer, N. Parmar, J. Uszkoreit +4 more

   2017Neural Information Processing Systems198K citations

   Semantic Scholar

   Save

2. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

   A. Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn +8 more

   2020International Conference on Learning Representations72K citations

   Semantic Scholar

   Save

3. Natural Questions: A Benchmark for Question Answering Research

   T. Kwiatkowski, J. Palomaki, Olivia Redfield, Michael Collins +14 more

   2019Transactions of the Association for Computational Linguistics5,381 citations Open access

   Semantic Scholar

   Save

4. MLP-Mixer: An all-MLP Architecture for Vision

   I. Tolstikhin, N. Houlsby, Alexander Kolesnikov, Lucas Beyer +8 more

   2021Neural Information Processing Systems3,899 citations

   Semantic Scholar

   Save

5. Self-Attention with Relative Position Representations

   Peter Shaw, J. Uszkoreit, Ashish Vaswani

   2018North American Chapter of the Association for Computational Linguistics2,995 citations Open access

   Semantic Scholar

   Save

6. Image Transformer

   N. Parmar, Ashish Vaswani, J. Uszkoreit, Lukasz Kaiser +3 more

   2018International Conference on Machine Learning1,964 citations

   Semantic Scholar

   Save

7. A Decomposable Attention Model for Natural Language Inference

   Ankur P. Parikh, Oscar Täckström, Dipanjan Das, J. Uszkoreit

   2016Conference on Empirical Methods in Natural Language Processing1,433 citations Open access

   Semantic Scholar

   Save

8. Object-Centric Learning with Slot Attention

   Francesco Locatello, Dirk Weissenborn, T. Unterthiner, Aravindh Mahendran +4 more

   2020Neural Information Processing Systems1,302 citations

   Semantic Scholar

   Save

9. Universal Transformers

   Mostafa Dehghani, S. Gouws, O. Vinyals, J. Uszkoreit +1 more

   2018International Conference on Learning Representations1,157 citations

   Semantic Scholar

   Save

10. How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers

    A. Steiner, Alexander Kolesnikov, Xiao-Hua Zhai, Ross Wightman +2 more

    2021Trans. Mach. Learn. Res.917 citations

    Semantic Scholar

    Save

11. Music Transformer: Generating Music with Long-Term Structure

    C. Huang, Ashish Vaswani, J. Uszkoreit, Noam Shazeer +6 more

    2018International Conference on Learning Representations629 citations

    Semantic Scholar

    Save

12. Tensor2Tensor for Neural Machine Translation

    Ashish Vaswani, Samy Bengio, E. Brevdo, François Chollet +9 more

    2018Conference of the Association for Machine Translation in the Americas556 citations

    Semantic Scholar

    Save

13. The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation

    Mia Chen, O. Firat, Ankur Bapna, Melvin Johnson +12 more

    2018Annual Meeting of the Association for Computational Linguistics482 citations Open access

    Semantic Scholar

    Save

14. Blockwise Parallel Decoding for Deep Autoregressive Models

    Mitchell Stern, Noam Shazeer, J. Uszkoreit

    2018Neural Information Processing Systems454 citations

    Semantic Scholar

    Save

15. Lattice-based Minimum Error Rate Training for Statistical Machine Translation

    Wolfgang Macherey, F. Och, I. Thayer, J. Uszkoreit

    2008Conference on Empirical Methods in Natural Language Processing359 citations Open access

    Semantic Scholar

    Save

16. One Model To Learn Them All

    Lukasz Kaiser, Aidan N. Gomez, Noam Shazeer, Ashish Vaswani +3 more

    2017arXiv.org353 citations

    Semantic Scholar

    Save

17. Transforming machine translation: a deep learning system reaches news translation quality comparable to human professionals

    M. Popel, M. Tomkova, J. Tomek, Łukasz Kaiser +3 more

    2020Nature Communications339 citations Open access

    Semantic Scholar

    Save

18. Insertion Transformer: Flexible Sequence Generation via Insertion Operations

    Mitchell Stern, William Chan, J. Kiros, J. Uszkoreit

    2019International Conference on Machine Learning296 citations

    Semantic Scholar

    Save

19. Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations

    Mehdi S. M. Sajjadi, H. Meyer, Etienne Pot, Urs M. Bergmann +9 more

    2021Computer Vision and Pattern Recognition279 citations Open access

    Semantic Scholar

    Save

20. Scaling Autoregressive Video Models

    Dirk Weissenborn, Oscar Täckström, J. Uszkoreit

    2019International Conference on Learning Representations261 citations

    Semantic Scholar

    Save

21. Fast Decoding in Sequence Models using Discrete Latent Variables

    Łukasz Kaiser, Aurko Roy, Ashish Vaswani, N. Parmar +3 more

    2018International Conference on Machine Learning260 citations

    Semantic Scholar

    Save

22. Cross-lingual Word Clusters for Direct Transfer of Linguistic Structure

    Oscar Täckström, Ryan T. McDonald, J. Uszkoreit

    2012North American Chapter of the Association for Computational Linguistics252 citations

    Semantic Scholar

    Save

23. Coarse-to-Fine Question Answering for Long Documents

    Eunsol Choi, Daniel Hewlett, J. Uszkoreit, I. Polosukhin +2 more

    2016Annual Meeting of the Association for Computational Linguistics170 citations Open access

    Semantic Scholar

    Save

24. Large Scale Parallel Document Mining for Machine Translation

    J. Uszkoreit, J. Ponte, Ashok Popat, Moshe Dubiner

    2010International Conference on Computational Linguistics166 citations

    Semantic Scholar

    Save

25. Differentiable Patch Selection for Image Recognition

    Jean-Baptiste Cordonnier, Aravindh Mahendran, A. Dosovitskiy, Dirk Weissenborn +2 more

    2021Computer Vision and Pattern Recognition129 citations Open access

    Semantic Scholar

    Save

26. Distributed Word Clustering for Large Scale Class-Based Language Modeling in Machine Translation

    J. Uszkoreit, T. Brants

    2008Annual Meeting of the Association for Computational Linguistics128 citations

    Semantic Scholar

    Save

27. “Poetic” Statistical Machine Translation: Rhyme and Meter

    Dmitriy Genzel, J. Uszkoreit, F. Och

    2010Conference on Empirical Methods in Natural Language Processing90 citations

    Semantic Scholar

    Save

28. An Improved Relative Self-Attention Mechanism for Transformer with Application to Music Generation

    C. Huang, Ashish Vaswani, J. Uszkoreit, Noam Shazeer +4 more

    2018arXiv.org83 citations

    Semantic Scholar

    Save

29. Neural Paraphrase Identification of Questions with Noisy Pretraining

    Gaurav Singh Tomar, Thyago Duque, Oscar Täckström, J. Uszkoreit +1 more

    2017SWCN@EMNLP82 citations Open access

    Semantic Scholar

    Save

30. KERMIT: Generative Insertion-Based Modeling for Sequences

    William Chan, Nikita Kitaev, Kelvin Guu, Mitchell Stern +1 more

    2019arXiv.org68 citations

    Semantic Scholar

    Save

31. Watermarking the Outputs of Structured Prediction with an application in Statistical Machine Translation.

    Ashish Venugopal, J. Uszkoreit, David Talbot, F. Och +1 more

    2011Conference on Empirical Methods in Natural Language Processing68 citations

    Semantic Scholar

    Save

32. Automated nuclear segmentation in the determination of the Ki-67 labeling index in meningiomas.

    Y.-J. Kim, B. Romeike, J. Uszkoreit, W. Feiden

    2006Clinical Neuropathology62 citations

    Semantic Scholar

    Save

33. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations

    Sebastian Gehrmann, H. Strobelt, Alexander M. Rush, Fabio Kepler +496 more

    201955 citations Open access

    Semantic Scholar

    Save

34. Inducing Sentence Structure from Parallel Corpora for Reordering

    John DeNero, J. Uszkoreit

    2011Conference on Empirical Methods in Natural Language Processing55 citations

    Semantic Scholar

    Save

35. Towards End-to-End In-Image Neural Machine Translation

    Elman Mansimov, Mitchell Stern, Mia Chen, O. Firat +2 more

    2020NLPBT36 citations Open access

    Semantic Scholar

    Save

36. Proceedings of the Fifth Workshop on Computational Approaches to Linguistic Code-Switching

    Kalika Bali, Pushpak Bhattacharyya, M. Fomicheva, Philipp Koehn +496 more

    202126 citations Open access

    Semantic Scholar

    Save

37. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Tutorial Abstracts

    Roy Bar-Haim, L. Ein-Dor, Matan Orbach, Elad Venezian +496 more

    202126 citations Open access

    Semantic Scholar

    Save

38. Language-Independent Discriminative Parsing of Temporal Expressions

    Gabor Angeli, J. Uszkoreit

    2013Annual Meeting of the Association for Computational Linguistics26 citations

    Semantic Scholar

    Save

39. Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications

    B. Klebanov, C. Bryant, Andrew Caines, M. Felice +496 more

    202020 citations Open access

    Semantic Scholar

    Save

40. Hierarchical Question Answering for Long Documents

    Eunsol Choi, Daniel Hewlett, Alexandre Lacoste, I. Polosukhin +2 more

    2016arXiv.org20 citations

    Semantic Scholar

    Save

41. Proceedings of the 4th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2021)

    Ali Hrriyetoglu, H. Tanev, Vanni Zavarella, Osman Mutlu +496 more

    202115 citations Open access

    Semantic Scholar

    Save

42. Proceedings of the First Workshop on Gender Bias in Natural Language Processing

    Marta R. Costa-juss, Christian Hardmeier, Will Radford, Kellie Webster +496 more

    201914 citations Open access

    Semantic Scholar

    Save

43. A Feature-Rich Constituent Context Model for Grammar Induction

    D. Golland, John DeNero, J. Uszkoreit

    2012Annual Meeting of the Association for Computational Linguistics14 citations

    Semantic Scholar

    Save

44. Proceedings of the Fourth Conference on Machine Translation (Volume 1: Research Papers)

    O. Bojar, Rajen Chatterjee, C. Federmann, Mark Fishel +496 more

    201912 citations Open access

    Semantic Scholar

    Save

45. Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021)

    A. Bertie, Lambert Douwe, Aida Mostafazadeh Davani, D. Kiela +496 more

    202111 citations Open access

    Semantic Scholar

    Save

46. Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2)

    O. Bojar, Rajen Chatterjee, C. Federmann, Mark Fishel +496 more

    201911 citations Open access

    Semantic Scholar

    Save

47. Proceedings of the Sixth Social Media Mining for Health (#SMM4H) Workshop and Shared Task

    M. Ali, Karen, Elena Davy, Juan Abeed +496 more

    202110 citations Open access

    Semantic Scholar

    Save

48. An Empirical Study of Generation Order for Machine Translation

    William Chan, Mitchell Stern, J. Kiros, J. Uszkoreit

    2019Conference on Empirical Methods in Natural Language Processing10 citations Open access

    Semantic Scholar

    Save

49. Proceedings of the Fourth Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda

    Antonis Maronikolakis, Hinrich Schütze, Mark Stevenson, T. Brown +496 more

    20219 citations Open access

    Semantic Scholar

    Save

50. Proceedings of the 2nd Workshop on Natural Language Processing for Conversational AI

    Tsung-Hsien Wen, Asli Celikyilmaz, Zhou Yu, U. Davis +496 more

    20209 citations Open access

    Semantic Scholar

    Save