Skip to content

Home Search Authors Pakistan News Saved

SciRah

SciRah does not host or store research papers. Results come live from free, official scholarly APIs, and every paper links back to its original source.

Data sources

OpenAlex
Semantic Scholar
Crossref
CORE
arXiv
PubMed

Privacy policy Terms of service

Rohan Anil · SciRah

Researcher profile · Semantic Scholar

Rohan Anil

Google Brain

Share profile

Rohan Anil — researcher profile on SciRah

h-index: 22
Works: 49
Citations: 20K

Most-cited papers

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
Gheorghe Comanici, E. Bieber, Mike Schaekermann, Ice Pasupat +496 more
2025arXiv.org4,448 citations
Semantic Scholar
Wide & Deep Learning for Recommender Systems
Heng-Tze Cheng, Levent Koç, Jeremiah Harmsen, Tal Shaked +12 more
2016DLRS@RecSys4,345 citations Open access
Semantic Scholar
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Machel Reid, N. Savinov, Denis Teplyashin, Dmitry Lepikhin +496 more
2024arXiv.org4,129 citations
Semantic Scholar
Gemma 3 Technical Report
Gemma Team Aishwarya Kamath, Johan Ferret, Shreya Pathak, Nino Vieillard +206 more
2025arXiv.org2,119 citations
Semantic Scholar
PaLM 2 Technical Report
Rohan Anil, Andrew M. Dai, O. Firat, Melvin Johnson +124 more
2023arXiv.org1,569 citations
Semantic Scholar
Gemma: Open Models Based on Gemini Research and Technology
Gemma Team Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju +103 more
2024arXiv.org1,299 citations
Semantic Scholar
Large scale distributed neural network training through online distillation
Rohan Anil, Gabriel Pereyra, A. Passos, Róbert Ormándi +2 more
2018International Conference on Learning Representations463 citations
Semantic Scholar
Knowledge distillation: A good teacher is patient and consistent
Lucas Beyer, Xiao-Hua Zhai, A. Royer, L. Markeeva +2 more
2021Computer Vision and Pattern Recognition424 citations Open access
Semantic Scholar
Efficiently Identifying Task Groupings for Multi-Task Learning
C. Fifty, Ehsan Amid, Zhe Zhao, Tian-He Yu +2 more
2021Neural Information Processing Systems361 citations
Semantic Scholar
Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
Jonathan Shen, P. Nguyen, Yong-Hui Wu, Z. Chen +88 more
2019arXiv.org215 citations
Semantic Scholar
Large-Scale Differentially Private BERT
Rohan Anil, Badih Ghazi, Vineet Gupta, Ravi Kumar +1 more
2021Conference on Empirical Methods in Natural Language Processing167 citations Open access
Semantic Scholar
Robust Bi-Tempered Logistic Loss Based on Bregman Divergences
Ehsan Amid, Manfred K. Warmuth, Rohan Anil, Tomer Koren
2019Neural Information Processing Systems151 citations
Semantic Scholar
Multi-task Learning
C. Fifty, Ehsan Amid, Zhe Zhao, Tian-He Yu +2 more
2020Transfer Learning147 citations
Semantic Scholar
TF-Ranking: Scalable TensorFlow Library for Learning-to-Rank
Rama Kumar Pasumarthi, Sebastian Bruch, Xuanhui Wang, Cheng Li +6 more
2018Knowledge Discovery and Data Mining146 citations Open access
Semantic Scholar
Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queries
Kiran Vodrahalli, Santiago Ontañón, Nilesh Tripuraneni, Kelvin Xu +20 more
2024arXiv.org98 citations
Semantic Scholar
Benchmarking Neural Network Training Algorithms
G. Dahl, Frank Schneider, Zachary Nado, Naman Agarwal +21 more
2023arXiv.org60 citations Open access
Semantic Scholar
On the Factory Floor: ML Engineering for Industrial-Scale Ads Recommendation Models
Rohan Anil, S. Gadanho, Danya Huang, Nijith Jacob +8 more
2022ORSUM@RecSys54 citations Open access
Semantic Scholar
Disentangling Adaptive Gradient Methods from Learning Rates
Naman Agarwal, Rohan Anil, Elad Hazan, Tomer Koren +1 more
2020arXiv.org52 citations
Semantic Scholar
Memory-Efficient Adaptive Optimization for Large-Scale Learning
Rohan Anil, Vineet Gupta, Tomer Koren, Y. Singer
2019Neural Information Processing Systems50 citations
Semantic Scholar
A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes
Zachary Nado, J. Gilmer, Christopher J. Shallue, Rohan Anil +1 more
2021arXiv.org31 citations
Semantic Scholar
Second Order Optimization Made Practical
Rohan Anil, Vineet Gupta, Tomer Koren, Kevin Regan +1 more
2020arXiv.org31 citations
Semantic Scholar
LocoProp: Enhancing BackProp via Local Loss Optimization
Ehsan Amid, Rohan Anil, Manfred K. Warmuth
2021International Conference on Artificial Intelligence and Statistics23 citations
Semantic Scholar
Sketchy: Memory-efficient Adaptive Regularization with Frequent Directions
Vladimir Feinberg, Xinyi Chen, Y. Sun, Rohan Anil +1 more
2023Neural Information Processing Systems22 citations Open access
Semantic Scholar
Combining Axes Preconditioners through Kronecker Approximation for Deep Learning
Sai Surya Duvvuri, Devvrit, Rohan Anil, Cho-Jui Hsieh +1 more
2024International Conference on Learning Representations20 citations
Semantic Scholar
Learning from Randomly Initialized Neural Network Features
Ehsan Amid, Rohan Anil, W. Kotłowski, Manfred K. Warmuth
2022arXiv.org20 citations
Semantic Scholar
A Little Help Goes a Long Way: Efficient LLM Training by Leveraging Small LMs
A. Rawat, Veeranjaneyulu Sadhanala, A. Rostamizadeh, Ayan Chakrabarti +11 more
2024arXiv.org18 citations
Semantic Scholar
N-Grammer: Augmenting Transformers with latent n-grams
Aurko Roy, Rohan Anil, Guangda Lai, Benjamin Lee +11 more
2022arXiv.org17 citations Open access
Semantic Scholar
Measuring and Harnessing Transference in Multi-Task Learning
C. Fifty, Ehsan Amid, Zhe Zhao, Tian-He Yu +2 more
2020arXiv.org16 citations
Semantic Scholar
Stochastic Optimization with Laggard Data Pipelines
Naman Agarwal, Rohan Anil, Tomer Koren, Kunal Talwar +1 more
2020Neural Information Processing Systems14 citations
Semantic Scholar
Large Language Models as a Normalizer for Transliteration and Dialectal Translation
Md Mahfuz, Ibn Alam, Antonios Anastasopoulos, Maria Ryskina +173 more
2025COLING Workshops11 citations
Semantic Scholar
Step-size Adaptation Using Exponentiated Gradient Updates
Ehsan Amid, Rohan Anil, C. Fifty, Manfred K. Warmuth
2022arXiv.org11 citations
Semantic Scholar
Fast and Simplex: 2-Simplicial Attention in Triton
Au-rko Roy, Timothy Chou, Sai Surya Duvvuri, Sijia Chen +4 more
2025arXiv.org10 citations
Semantic Scholar
Learning from straggler clients in federated learning
Andrew Straiton Hard, Antonious M. Girgis, Ehsan Amid, Sean Augenstein +3 more
2024arXiv.org10 citations
Semantic Scholar
Revisiting the Generalization of Adaptive Gradient Methods
Naman Agarwal, Rohan Anil, Elad Hazan, Tomer Koren +1 more
20195 citations
Semantic Scholar
Layerwise Bregman Representation Learning of Neural Networks with Applications to Knowledge Distillation
Ehsan Amid, Rohan Anil, C. Fifty, Manfred K. Warmuth
2023Trans. Mach. Learn. Res.3 citations
Semantic Scholar
Layerwise Bregman Representation Learning with Applications to Knowledge Distillation
Ehsan Amid, Rohan Anil, C. Fifty, Manfred K. Warmuth
2022arXiv.org3 citations Open access
Semantic Scholar
CSE 252 : Bird ’ s eye view : Detecting and Recognizing Birds using the BIRDS 200 dataset
Rohan Anil
20113 citations
Semantic Scholar
A Computationally Efficient Sparsified Online Newton Method
Rohan Anil, Fnu Devvrit, I. Dhillon, Sai Surya Duvvuri +2 more
2023Neural Information Processing Systems1 citations
Semantic Scholar
Proceedings of The 3rd Workshop on e-Commerce and NLP
Han-Chu Zhang, Leonhard Hennig, Christoph Alt, Chang-Jian Hu +496 more
20201 citations Open access
Semantic Scholar
Full Matrix Preconditioning Made Practical
Rohan Anil, Vineet Gupta, Tomer Koren, Kevin Regan +1 more
20191 citations
Semantic Scholar
LLMReﬁne: Pinpointing and Reﬁning Large Language Models via Fine-Grained Actionable Feedback
Wenda Xu, Daniel Deutsch, Mara Finkelstein, Juraj Juraska +173 more
1 citations
Semantic Scholar
M3S CI QA: A Multi-Modal Multi-Document Scientiﬁc QA Benchmark for Evaluating Foundation Models
Chu-Han Li, Ziyao Shangguan, Yilun Zhao, Deyuan Li +179 more
1 citations
Semantic Scholar
Heterogeneous Federated Learning Using Knowledge Codistillation
Jared Lichtarge, Ehsan Amid, Shankar Kumar, Tien-Ju Yang +2 more
2023arXiv.org0 citations Open access
Semantic Scholar
Local Differential Privacy for Privacy-Preserving NLP Tasks
M. Abadi, Andy Chu, Ian Goodfellow, Brendan McMahan +18 more
20210 citations
Semantic Scholar
LLMs meet Bloom’s Taxonomy: A Cognitive View on Large Language Model Evaluations
T. Huber, C. Niklaus, A. Conneau, Kartikay Khan-delwal +496 more
0 citations
Semantic Scholar
ELTEX: A Framework for Domain-Driven Synthetic Data Generation
Arina Razmyslovich, Kseniia Murasheva, Sofia Sedlova, Julien Capitaine +158 more
0 citations
Semantic Scholar
CANVAS: Continuity-Aware Narrative Generation via Visual Agentic Storyboarding . Findings of Empirical Methods in Natural Language Processing , 2026.
J. Boyd-Graber, I. Mondal, Mihir Parmar, Google Research +69 more
0 citations
Semantic Scholar
SQL-CRAFT: Advancing Text-to-SQL Capabilities through Interactive Refinement and Enhanced Reasoning
Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin John-219 +67 more
0 citations
Semantic Scholar
H2R: A Human-to-Robot Data Augmentation for Robot Pre-training from Videos
Figure 1. H2R, Rohan Anil, Andrew M. Dai, Orhan Firat +496 more
0 citations
Semantic Scholar

Frequent co-authors

Invite them to SciRah by sharing their profile.

Ehsan Amid×12
Invite
Ehsan Amid — researcher profile on SciRah
Vladimir Feinberg×11
Invite
Vladimir Feinberg — researcher profile on SciRah
Siamak Shakeri×8
Invite
Siamak Shakeri — researcher profile on SciRah
A. Chowdhery×8
Invite
A. Chowdhery — researcher profile on SciRah

Sebastian Borgeaud

×7

Invite

Sebastian Borgeaud — researcher profile on SciRah

Ambrose Slone×7

Invite

Ambrose Slone — researcher profile on SciRah

Invite

C. Fifty — researcher profile on SciRah

Invite

Tomer Koren — researcher profile on SciRah

Invite

Eric Ni — researcher profile on SciRah

Surya Bhupatiraju×6

Invite

Surya Bhupatiraju — researcher profile on SciRah

Clément Farabet×6

Invite

Clément Farabet — researcher profile on SciRah

George Tucker×6

Invite

George Tucker — researcher profile on SciRah