Skip to content

Home Search Authors Pakistan News Saved

SciRah

SciRah does not host or store research papers. Results come live from free, official scholarly APIs, and every paper links back to its original source.

Data sources

OpenAlex
Semantic Scholar
Crossref
CORE
arXiv
PubMed

Privacy policy Terms of service

Noam Shazeer · SciRah

Researcher profile · Semantic Scholar

Noam Shazeer

Google

Share profile

Noam Shazeer — researcher profile on SciRah

h-index: 40
Works: 179
Citations: 275K

Most-cited papers

PaLM: Scaling Language Modeling with Pathways
A. Chowdhery, Sharan Narang, J. Devlin, Maarten Bosma +63 more
2022Journal of machine learning research8,512 citations
Semantic Scholar
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
W. Fedus, Barret Zoph, Noam Shazeer
2021Journal of machine learning research5,154 citations
Semantic Scholar
Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
Gheorghe Comanici, E. Bieber, Mike Schaekermann, Ice Pasupat +496 more
2025arXiv.org4,448 citations
Semantic Scholar
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
Dmitry Lepikhin, HyoukJoong Lee, Yuan-Zhong Xu, Dehao Chen +5 more
2020International Conference on Learning Representations2,507 citations
Semantic Scholar
GLU Variants Improve Transformer
Noam Shazeer
2020arXiv.org2,388 citations
Semantic Scholar
Gemma 3 Technical Report
Gemma Team Aishwarya Kamath, Johan Ferret, Shreya Pathak, Nino Vieillard +206 more
2025arXiv.org2,119 citations
Semantic Scholar
LaMDA: Language Models for Dialog Applications
R. Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer +56 more
2022arXiv.org1,930 citations
Semantic Scholar
How Much Knowledge Can You Pack into the Parameters of a Language Model?
Adam Roberts, Colin A. Raffel, Noam Shazeer
2020Conference on Empirical Methods in Natural Language Processing1,139 citations Open access
Semantic Scholar
ST-MoE: Designing Stable and Transferable Sparse Expert Models
Barret Zoph, Irwan Bello, Sameer Kumar, Nan Du +4 more
2022488 citations
Semantic Scholar
Primer: Searching for Efficient Transformers for Language Modeling
David R. So, Wojciech Ma'nke, Hanxiao Liu, Zi-Hang Dai +2 more
2021Neural Information Processing Systems236 citations
Semantic Scholar
Scaling Up Models and Data with t5x and seqio
Adam Roberts, Hyung Won Chung, Gaurav Mishra, Anselm Levskaya +41 more
2022Journal of machine learning research228 citations Open access
Semantic Scholar
GSPMD: General and Scalable Parallelization for ML Computation Graphs
Yuan-Zhong Xu, HyoukJoong Lee, Dehao Chen, Blake A. Hechtman +12 more
2021arXiv.org203 citations
Semantic Scholar
Do Transformer Modifications Transfer Across Implementations and Applications?
Sharan Narang, Hyung Won Chung, Yi Tay, L. Fedus +12 more
2021Conference on Empirical Methods in Natural Language Processing143 citations Open access
Semantic Scholar
Designing Effective Sparse Expert Models
Barret Zoph, Irwan Bello, Sameer Kumar, Nan Du +4 more
2022IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum123 citations
Semantic Scholar
Talking-Heads Attention
Noam Shazeer, Zhen-Zhong Lan, You-Long Cheng, Nan Ding +1 more
2020arXiv.org118 citations
Semantic Scholar
Proceedings of the Fifth Workshop on Computational Approaches to Linguistic Code-Switching
Kalika Bali, Pushpak Bhattacharyya, M. Fomicheva, Philipp Koehn +496 more
202126 citations Open access
Semantic Scholar
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Tutorial Abstracts
Roy Bar-Haim, L. Ein-Dor, Matan Orbach, Elad Venezian +496 more
202126 citations Open access
Semantic Scholar
Faster Transformer Decoding: N-gram Masked Self-Attention
Ciprian Chelba, Mia Chen, Ankur Bapna, Noam Shazeer
2020arXiv.org21 citations
Semantic Scholar
Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications
B. Klebanov, C. Bryant, Andrew Caines, M. Felice +496 more
202020 citations Open access
Semantic Scholar
Proceedings of the 4th Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2021)
Ali Hrriyetoglu, H. Tanev, Vanni Zavarella, Osman Mutlu +496 more
202115 citations Open access
Semantic Scholar
Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021)
A. Bertie, Lambert Douwe, Aida Mostafazadeh Davani, D. Kiela +496 more
202111 citations Open access
Semantic Scholar
Proceedings of the Sixth Social Media Mining for Health (#SMM4H) Workshop and Shared Task
M. Ali, Karen, Elena Davy, Juan Abeed +496 more
202110 citations Open access
Semantic Scholar
Proceedings of the Fourth Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda
Antonis Maronikolakis, Hinrich Schütze, Mark Stevenson, T. Brown +496 more
20219 citations Open access
Semantic Scholar
Proceedings of the 2nd Workshop on Natural Language Processing for Conversational AI
Tsung-Hsien Wen, Asli Celikyilmaz, Zhou Yu, U. Davis +496 more
20209 citations Open access
Semantic Scholar
Proceedings of the 3rd Workshop on Gender Bias in Natural Language Processing
E. Vanmassenhove, J. Monti, Mei-Chun Jiao, Ziyang Luo +496 more
20217 citations Open access
Semantic Scholar
Proceedings of the Fifteenth Workshop on Graph-Based Methods for Natural Language Processing (TextGraphs-15)
Laura Dietz, A. Panchenko, Fragkiskos D. Malliaros, V. Logacheva +496 more
20216 citations Open access
Semantic Scholar
Freezing the Pivot for Triangular Machine Translation
S. Gross, Nathan Ng, D. Grangier, Rico Sennrich +6 more
20215 citations
Semantic Scholar
Proceedings of the Fifth Workshop on Teaching NLP
David Jurgens, V. Kolhatkar, Lucy Li, Margot Mieskes +496 more
20215 citations Open access
Semantic Scholar
Proceedings of the 1st Workshop on Natural Language Processing for Programming (NLP4Prog 2021)
R. Lachmy, Ziyu Yao, Greg Durrett, Milos Gligoric +496 more
20214 citations Open access
Semantic Scholar
Proceedings of the 5th Workshop on Structured Prediction for NLP (SPNLP 2021)
Zornitsa Kozareva, Sujith Ravi, Slicex Ai, Priyanka Agrawal +496 more
20213 citations Open access
Semantic Scholar
Commonsense Reasoning for Conversational AI: A Survey of Recent Datasets and Benchmarks
Alon Albalak, Varun R. Embar, Yi-Lin Tuan, L. Getoor +68 more
20222 citations
Semantic Scholar
Proceedings of the 17th International Conference on Parsing Technologies and the IWPT 2021 Shared Task on Parsing into Enhanced Universal Dependencies (IWPT 2021)
Christoph Bloomberg, Antoine Venant, Aditya Bhargava, Gerald Penn +496 more
20212 citations Open access
Semantic Scholar
Multi-Granularity Contrastive Knowledge Distillation for Multimodal Named Entity Recognition
Kevin Durant, Shu-Guang Chen, Gustavo Aguilar, Leonardo Neves +48 more
20212 citations
Semantic Scholar
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorials
Andrew Yates, Rodrigo Nogueira, Jimmy Lin, T. Brown +354 more
20212 citations Open access
Semantic Scholar
Proceedings of the Third Workshop on Multimodal Artificial Intelligence
Isaac Rodrguez-Bribiesca, A. P. Lpez-Monroy, Manuel Montes-Y-Gmez, Yen-Chun Chen +496 more
20212 citations Open access
Semantic Scholar
Proceedings of the Second Workshop on Natural Language Processing for Medical Conversations
S. Mousavi, Alessandra Cervone, Morena Danieli, G. Riccardi +496 more
20212 citations Open access
Semantic Scholar
EncT5: Fine-tuning T5 Encoder for Discriminative Tasks
A. Vaswani, Noam Shazeer, N. Parmar, Thomas Wolf +28 more
20211 citations
Semantic Scholar
Proceedings of the 1st Workshop on Understanding Implicit and Underspecified Language
Murathan Kurfali, Robert Östling, Marie Bexte, Andrea Horbach +358 more
20211 citations Open access
Semantic Scholar
Robust and Effective Grammatical Error Correction with Simple Cycle Self-Augmenting
S. Granger, Matthias Hagen, M. Potthast, Marcel Gohsen +43 more
20211 citations
Semantic Scholar
Proceedings of the Second Workshop on Automatic Simultaneous Translation
Shaolei Zhang, Yang Feng, Meng-Ge Liu, Shuo-Ying Chen +262 more
20211 citations Open access
Semantic Scholar
Proceedings of the First Workshop on Automatic Simultaneous Translation
Hua Wu, Colin Cherry, Jordan L. Boyd-Graber, Qun Liu +309 more
20201 citations Open access
Semantic Scholar
Transformer-Based Code Generation: Automating Software Development with AI
S. Kamatala, X. Chen, L. Wang, A. Shen +59 more
2025IARJSET0 citations Open access
Semantic Scholar
Timeline Deliberation for Fine-grained Temporal Ordering
Taylor Cassidy, Bill McDowell, Nathanael Chambers, Kun-Long Chen +33 more
20230 citations
Semantic Scholar
Low-resource Data-to-Text Generation Using Pretrained Language Models
T. Hamilton, Academical F. C., Zhiyu Chen, H. Eavani +51 more
20220 citations
Semantic Scholar
Entity Cloze By Date: Understanding what LMs know about unseen entities
M. Lewis, Nicola Yazdani, James De Cao, Thorne +34 more
20220 citations
Semantic Scholar
S 2 ynRE: Two-stage Self-training with Synthetic data for Low-resource Relation Extraction
Ateret Anaby-Tavor, Boaz Carmeli, Esther Goldbraich, I. Beltagy +97 more
20220 citations
Semantic Scholar
The KITMUS Test for Knowledge Integration from Multiple Sources
Tom B. Brown, B. Mann, N. Ryder, Melanie Subbiah +65 more
20220 citations
Semantic Scholar
Pivot-based Transfer Learning on Pre-trained Sequence-Sequence Models for Low-Resource Neural Machine Translation
Colin A. Raffel, Noam Shazeer, Adam Roberts, Sharan Lee +15 more
20220 citations
Semantic Scholar
TaHiD: Tackling Data Hiding in Fake News Detection with News Propagation Networks
Adrien Benamira, Benjamin Devillers, Etienne Lesot, Ayush K. Ray +24 more
20220 citations
Semantic Scholar
How Multilingual are English Pretrained Models?
Z. Li, Kevin Parnow, Hai Zhao, Zhuosheng Zhang +33 more
20220 citations
Semantic Scholar

Frequent co-authors

Invite them to SciRah by sharing their profile.

N. Parmar×28
Invite
N. Parmar — researcher profile on SciRah
M. Chang×21
Invite
M. Chang — researcher profile on SciRah
A. Vaswani×19
Invite
A. Vaswani — researcher profile on SciRah
J. Uszkoreit×18
Invite
J. Uszkoreit — researcher profile on SciRah

×18

Invite

J. Devlin — researcher profile on SciRah

I. Sutskever×18

Invite

I. Sutskever — researcher profile on SciRah

K. Toutanova×17

Invite

K. Toutanova — researcher profile on SciRah

Invite

Kenton Lee — researcher profile on SciRah

I. Polosukhin×14

Invite

I. Polosukhin — researcher profile on SciRah

Invite

R. Child — researcher profile on SciRah

Lysandre Debut×12

Invite

Lysandre Debut — researcher profile on SciRah

Invite

Q. Le — researcher profile on SciRah