M. Zaheer

Most-cited papers

Big Bird: Transformers for Longer Sequences
M. Zaheer, Guru Guruganesh, Kumar Avinava Dubey, Joshua Ainslie +7 more
2020Neural Information Processing Systems3,205 citations
Semantic Scholar
Adaptive Federated Optimization
Sashank J. Reddi, Zachary B. Charles, M. Zaheer, Zachary Garrett +4 more
2020International Conference on Learning Representations2,214 citations
Semantic Scholar
A Field Guide to Federated Optimization
Jianyu Wang, Zachary B. Charles, Zheng Xu, Gauri Joshi +49 more
2021arXiv.org497 citations
Semantic Scholar
Modifying Memories in Transformer Models
Chen Zhu, A. Rawat, M. Zaheer, Srinadh Bhojanapalli +3 more
2020arXiv.org295 citations
Semantic Scholar
Large Language Models with Controllable Working Memory
Daliang Li, A. Rawat, M. Zaheer, Xin Wang +4 more
2022Annual Meeting of the Association for Computational Linguistics237 citations Open access
Semantic Scholar
Case-based Reasoning for Natural Language Queries over Knowledge Bases
Rajarshi Das, M. Zaheer, Dung Ngoc Thai, Ameya Godbole +5 more
2021Conference on Empirical Methods in Natural Language Processing216 citations Open access
Semantic Scholar
StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models
Adam Liska, Tomás Kociský, E. Gribovskaya, Tayfun Terzi +10 more
2022International Conference on Machine Learning162 citations
Semantic Scholar
Randomized Exploration in Generalized Linear Bandits
Branislav Kveton, M. Zaheer, Csaba Szepesvari, Lihong Li +2 more
2019International Conference on Artificial Intelligence and Statistics115 citations
Semantic Scholar
The Art of Scaling Reinforcement Learning Compute for LLMs
Devvrit Khatri, Lovish Madaan, Rishabh Tiwari, Rachit Bansal +5 more
2025arXiv.org106 citations
Semantic Scholar
ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent
Renat Aksitov, Sobhan Miryoosefi, Zong-xiao Li, Daliang Li +9 more
2023arXiv.org94 citations
Semantic Scholar
Gradient-based Hierarchical Clustering using Continuous Representations of Trees in Hyperbolic Space
Nicholas Monath, M. Zaheer, Daniel Silva, Andrew Mccallum +1 more
2019Knowledge Discovery and Data Mining92 citations Open access
Semantic Scholar
Functional Interpolation for Relative Positions Improves Long Context Transformers
Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie +6 more
2024International Conference on Learning Representations91 citations
Semantic Scholar
Differentiable Reasoning over a Virtual Knowledge Base
Bhuwan Dhingra, M. Zaheer, Vidhisha Balachandran, Graham Neubig +2 more
2020International Conference on Learning Representations91 citations
Semantic Scholar
Meta-Thompson Sampling
Branislav Kveton, Mikhail Konobeev, M. Zaheer, Chih-Wei Hsu +3 more
2021International Conference on Machine Learning80 citations
Semantic Scholar
Federated Composite Optimization
Hong-Lin Yuan, M. Zaheer, Sashank J. Reddi
2020International Conference on Machine Learning74 citations
Semantic Scholar
Questions Are All You Need to Train a Dense Passage Retriever
Devendra Singh Sachan, M. Lewis, Dani Yogatama, Luke Zettlemoyer +2 more
2022Transactions of the Association for Computational Linguistics73 citations Open access
Semantic Scholar
Knowledge Base Question Answering by Case-based Reasoning over Subgraphs
Rajarshi Das, Ameya Godbole, Ankita Rajaram Naik, Elliot Tower +4 more
2022International Conference on Machine Learning72 citations
Semantic Scholar
Scalable Hierarchical Agglomerative Clustering
Nicholas Monath, Kumar Avinava Dubey, Guru Guruganesh, M. Zaheer +8 more
2020Knowledge Discovery and Data Mining66 citations Open access
Semantic Scholar
Latent Bandits Revisited
Joey Hong, Branislav Kveton, M. Zaheer, Yinlam Chow +2 more
2020Neural Information Processing Systems56 citations
Semantic Scholar
Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answering
Rajarshi Das, Ameya Godbole, D. Kavarthapu, Z. Gong +7 more
2019Conference on Empirical Methods in Natural Language Processing56 citations Open access
Semantic Scholar
Can Public Large Language Models Help Private Cross-device Federated Learning?
Boxin Wang, J. Y. Zhang, Yuan Cao, Bo Li +4 more
2023NAACL-HLT53 citations Open access
Semantic Scholar
Private Adaptive Optimization with Side Information
Tian Li, M. Zaheer, Sashank J. Reddi, Virginia Smith
2022International Conference on Machine Learning53 citations
Semantic Scholar
A Context-Integrated Transformer-Based Neural Network for Auction Design
Zhijian Duan, Jin-Lin Tang, Yutong Yin, Zhe Feng +3 more
2022International Conference on Machine Learning51 citations
Semantic Scholar
Hierarchical Bayesian Bandits
Joey Hong, Branislav Kveton, M. Zaheer, M. Ghavamzadeh
2021International Conference on Artificial Intelligence and Statistics51 citations
Semantic Scholar
Differentiable Open-Ended Commonsense Reasoning
Bill Yuchen Lin, Haitian Sun, Bhuwan Dhingra, M. Zaheer +2 more
2020North American Chapter of the Association for Computational Linguistics45 citations Open access
Semantic Scholar
No Regrets for Learning the Prior in Bandits
S. Basu, Branislav Kveton, M. Zaheer, Csaba Szepesvari
2021Neural Information Processing Systems40 citations
Semantic Scholar
Robust Training of Neural Networks using Scale Invariant Architectures
Zhiyuan Li, Srinadh Bhojanapalli, M. Zaheer, Sashank J. Reddi +1 more
2022International Conference on Machine Learning37 citations
Semantic Scholar
Robust Large-Margin Learning in Hyperbolic Space
Melanie Weber, M. Zaheer, A. Rawat, A. Menon +1 more
2020Neural Information Processing Systems36 citations
Semantic Scholar
PLLay: Efficient Topological Layer based on Persistent Landscapes
Kwangho Kim, Jisu Kim, M. Zaheer, Joon-Sik Kim +2 more
2020Neural Information Processing Systems34 citations
Semantic Scholar
CIMemories: A Compositional Benchmark for Contextual Integrity of Persistent Memory in LLMs
Niloofar Mireshghallah, Neal Mangaokar, Narine Kokhlikyan, A. Zharmagambetov +3 more
2025arXiv.org29 citations
Semantic Scholar
Natural Language Outlines for Code: Literate Programming in the LLM Era
Kensen Shi, Deniz Altınbüken, Saswat Anand, Mihai Christodorescu +16 more
2024SIGSOFT FSE Companion29 citations Open access
Semantic Scholar
PLLay: Efficient Topological Layer based on Persistence Landscapes
Kwangho Kim, Jisu Kim, M. Zaheer, Joon Sik Kim +2 more
202028 citations
Semantic Scholar
Latent Programmer: Discrete Latent Codes for Program Synthesis
Joey Hong, David Dohan, Rishabh Singh, Charles Sutton +1 more
2020International Conference on Machine Learning27 citations
Semantic Scholar
Unsupervised Abstractive Dialogue Summarization for Tete-a-Tetes
Xinyuan Zhang, Rui-Yi Zhang, M. Zaheer, Amr Ahmed
2020AAAI Conference on Artificial Intelligence27 citations Open access
Semantic Scholar
Deep Hierarchy in Bandits
Joey Hong, Branislav Kveton, S. Katariya, M. Zaheer +1 more
2022International Conference on Machine Learning25 citations
Semantic Scholar
A Simple Approach to Case-Based Reasoning in Knowledge Bases
Rajarshi Das, Ameya Godbole, S. Dhuliawala, M. Zaheer +1 more
2020Conference on Automated Knowledge Base Construction24 citations
Semantic Scholar
ExeDec: Execution Decomposition for Compositional Generalization in Neural Program Synthesis
Kensen Shi, Joey Hong, Yin-Lin Deng, Pengcheng Yin +2 more
2023International Conference on Learning Representations23 citations Open access
Semantic Scholar
Differentially Private Adaptive Optimization with Delayed Preconditioners
Tian Li, M. Zaheer, Ken Ziyu Liu, Sashank J. Reddi +2 more
2022International Conference on Learning Representations23 citations Open access
Semantic Scholar
Differentiable Meta-Learning of Bandit Policies
Craig Boutilier, Chih-Wei Hsu, Branislav Kveton, M. Mladenov +2 more
2020Neural Information Processing Systems23 citations
Semantic Scholar
Rethinking Thinking Tokens: LLMs as Improvement Operators
Lovish Madaan, A. Didolkar, Suchin Gururangan, John Quan +5 more
2025arXiv.org20 citations
Semantic Scholar
Scaling Within Document Coreference to Long Texts
Raghuveer Thirukovalluru, Nicholas Monath, Kumar Shridhar, M. Zaheer +2 more
2021Findings20 citations Open access
Semantic Scholar
Thompson Sampling with a Mixture Prior
Joey Hong, Branislav Kveton, M. Zaheer, M. Ghavamzadeh +1 more
2021International Conference on Artificial Intelligence and Statistics19 citations
Semantic Scholar
EmbedDistill: A Geometric Knowledge Distillation for Information Retrieval
Seungyeon Kim, A. Rawat, M. Zaheer, Sadeep Jayasumana +5 more
2023arXiv.org17 citations Open access
Semantic Scholar
Non-Stationary Latent Bandits
Joey Hong, Branislav Kveton, M. Zaheer, Yinlam Chow +3 more
2020arXiv.org17 citations
Semantic Scholar
Efficient Nearest Neighbor Search for Cross-Encoder Models using Matrix Factorization
Nishant Yadav, Nicholas Monath, Rico Angell, M. Zaheer +1 more
2022Conference on Empirical Methods in Natural Language Processing16 citations Open access
Semantic Scholar
Anchor & Transform: Learning Sparse Embeddings for Large Vocabularies
P. Liang, M. Zaheer, Yuan Wang, Amr Ahmed
2020International Conference on Learning Representations16 citations
Semantic Scholar
Functional Interpolation for Relative Positions Improves Long Context Transformers
Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie +6 more
202315 citations
Semantic Scholar
Scaling Test-Time Compute for Agentic Coding
Joongwon Kim, Wannan Yang, Kelvin Niu, Hong-Ming Zhang +12 more
2026arXiv.org14 citations
Semantic Scholar
ResMem: Learn what you can and memorize the rest
Zitong Yang, Michal Lukasik, Vaishnavh Nagarajan, Zong-xiao Li +4 more
2023Neural Information Processing Systems14 citations Open access
Semantic Scholar
Probabilistic Case-based Reasoning in Knowledge Bases
Rajarshi Das, Ameya Godbole, Nicholas Monath, M. Zaheer +1 more
2020Findings14 citations Open access
Semantic Scholar