Jonathan Berant

Most-cited papers

CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge
Alon Talmor, Jonathan Herzig, Nicholas Lourie, Jonathan Berant
2019North American Chapter of the Association for Computational Linguistics2,767 citations Open access
Semantic Scholar
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb +446 more
2022arXiv.org2,702 citations
Semantic Scholar
Transformer Feed-Forward Layers Are Key-Value Memories
Mor Geva, R. Schuster, Jonathan Berant, Omer Levy
2020Conference on Empirical Methods in Natural Language Processing1,780 citations Open access
Semantic Scholar
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies
Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot +2 more
2021Transactions of the Association for Computational Linguistics1,236 citations Open access
Semantic Scholar
Learning To Retrieve Prompts for In-Context Learning
Ohad Rubin, Jonathan Herzig, Jonathan Berant
2021North American Chapter of the Association for Computational Linguistics1,017 citations Open access
Semantic Scholar
Diagonal State Spaces are as Effective as Structured State Spaces
Ankit Gupta, Jonathan Berant
2022Neural Information Processing Systems556 citations Open access
Semantic Scholar
Evaluating Models’ Local Decision Boundaries via Contrast Sets
Matt Gardner, Yoav Artzi, Victoria Basmov, Jonathan Berant +22 more
2020Findings548 citations Open access
Semantic Scholar
Making Retrieval-Augmented Language Models Robust to Irrelevant Context
Ori Yoran, Tomer Wolfson, Ori Ram, Jonathan Berant
2023International Conference on Learning Representations511 citations Open access
Semantic Scholar
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets
Mor Geva, Yoav Goldberg, Jonathan Berant
2019Conference on Empirical Methods in Natural Language Processing368 citations Open access
Semantic Scholar
oLMpics-On What Language Model Pre-training Captures
Alon Talmor, Yanai Elazar, Yoav Goldberg, Jonathan Berant
2019Transactions of the Association for Computational Linguistics318 citations Open access
Semantic Scholar
Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoning
Amrith Rajagopal Setlur, Chirag Nagpal, Adam Fisch, Xin-Yang Geng +5 more
2024International Conference on Learning Representations313 citations
Semantic Scholar
MultiModalQA: Complex Question Answering over Text, Tables and Images
Alon Talmor, Ori Yoran, Amnon Catav, Dan Lahav +5 more
2021International Conference on Learning Representations284 citations
Semantic Scholar
Injecting Numerical Reasoning Skills into Language Models
Mor Geva, Ankit Gupta, Jonathan Berant
2020Annual Meeting of the Association for Computational Linguistics249 citations Open access
Semantic Scholar
Break It Down: A Question Understanding Benchmark
Tomer Wolfson, Mor Geva, Ankit Gupta, Matt Gardner +3 more
2020Transactions of the Association for Computational Linguistics240 citations Open access
Semantic Scholar
Representing Schema Structure with Graph Neural Networks for Text-to-SQL Parsing
Ben Bogin, Jonathan Berant, Matt Gardner
2019Annual Meeting of the Association for Computational Linguistics227 citations Open access
Semantic Scholar
ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding
Uri Shaham, Maor Ivgi, Avia Efrat, Jonathan Berant +1 more
2023Conference on Empirical Methods in Natural Language Processing221 citations Open access
Semantic Scholar
Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking
Jacob Eisenstein, Chirag Nagpal, Alekh Agarwal, Ahmad Beirami +8 more
2023arXiv.org218 citations
Semantic Scholar
Diverse Demonstrations Improve In-context Compositional Generalization
Itay Levy, Ben Bogin, Jonathan Berant
2022Annual Meeting of the Association for Computational Linguistics211 citations Open access
Semantic Scholar
SmBoP: Semi-autoregressive Bottom-up Semantic Parsing
Ohad Rubin, Jonathan Berant
2020North American Chapter of the Association for Computational Linguistics202 citations Open access
Semantic Scholar
SCROLLS: Standardized CompaRison Over Long Language Sequences
Uri Shaham, Elad Segal, Maor Ivgi, Avia Efrat +7 more
2022Conference on Empirical Methods in Natural Language Processing198 citations Open access
Semantic Scholar
CommonsenseQA 2.0: Exposing the Limits of AI through Gamification
Alon Talmor, Ori Yoran, Ronan Le Bras, C. Bhagavatula +3 more
2021NeurIPS Datasets and Benchmarks183 citations
Semantic Scholar
Evaluating the Evaluation of Diversity in Natural Language Generation
Guy Tevet, Jonathan Berant
2020Conference of the European Chapter of the Association for Computational Linguistics182 citations Open access
Semantic Scholar
AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?
Ori Yoran, S. Amouyal, Chaitanya Malaviya, Ben Bogin +2 more
2024Conference on Empirical Methods in Natural Language Processing180 citations
Semantic Scholar
MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension
Alon Talmor, Jonathan Berant
2019Annual Meeting of the Association for Computational Linguistics176 citations Open access
Semantic Scholar
In-Context Learning with Long-Context Models: An In-Depth Exploration
Amanda Bertsch, Maor Ivgi, Emily Xiao, Uri Alon +3 more
2024North American Chapter of the Association for Computational Linguistics163 citations
Semantic Scholar
Analyzing Transformers in Embedding Space
Guy Dar, Mor Geva, Ankit Gupta, Jonathan Berant
2022Annual Meeting of the Association for Computational Linguistics158 citations Open access
Semantic Scholar
Answering Questions by Meta-Reasoning over Multiple Chains of Thought
Ori Yoran, Tomer Wolfson, Ben Bogin, Uri Katz +2 more
2023Conference on Empirical Methods in Natural Language Processing143 citations Open access
Semantic Scholar
Theoretical guarantees on the best-of-n alignment policy
Ahmad Beirami, Alekh Agarwal, Jonathan Berant, A. D'Amour +3 more
2024International Conference on Machine Learning142 citations
Semantic Scholar
BERTese: Learning to Speak to BERT
Adi Haviv, Jonathan Berant, A. Globerson
2021Conference of the European Chapter of the Association for Computational Linguistics141 citations Open access
Semantic Scholar
Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge
Alon Talmor, O. Tafjord, Peter Clark, Yoav Goldberg +1 more
2020Neural Information Processing Systems120 citations
Semantic Scholar
Crawling The Internal Knowledge-Base of Language Models
Roi Cohen, Mor Geva, Jonathan Berant, A. Globerson
2023Findings119 citations Open access
Semantic Scholar
Memory-efficient Transformers via Top-k Attention
Ankit Gupta, Guy Dar, Shaya Goodman, David Ciprut +1 more
2021SUSTAINLP117 citations Open access
Semantic Scholar
Efficient Long-Text Understanding with Short-Text Models
Maor Ivgi, Uri Shaham, Jonathan Berant
2022Transactions of the Association for Computational Linguistics115 citations Open access
Semantic Scholar
Span-based Semantic Parsing for Compositional Generalization
Jonathan Herzig, Jonathan Berant
2020Annual Meeting of the Association for Computational Linguistics106 citations Open access
Semantic Scholar
Few-Shot Question Answering by Pretraining Span Selection
Ori Ram, Yuval Kirstain, Jonathan Berant, A. Globerson +1 more
2021Annual Meeting of the Association for Computational Linguistics104 citations Open access
Semantic Scholar
From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces
Jonathan Berant, James Cohan, Hexiang Hu, Mandar Joshi +5 more
2023Neural Information Processing Systems89 citations Open access
Semantic Scholar
Evaluating NLP Models via Contrast Sets
Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant +22 more
2020arXiv.org86 citations
Semantic Scholar
Robust Preference Optimization through Reward Model Distillation
Adam Fisch, Jacob Eisenstein, Vicky Zayats, Alekh Agarwal +4 more
2024Trans. Mach. Learn. Res.76 citations
Semantic Scholar
Learning to Retrieve Passages without Supervision
Ori Ram, Gal Shachaf, Omer Levy, Jonathan Berant +1 more
2021North American Chapter of the Association for Computational Linguistics73 citations Open access
Semantic Scholar
Improving Compositional Generalization in Semantic Parsing
I. Oren, Jonathan Herzig, Nitish Gupta, Matt Gardner +1 more
2020Findings66 citations Open access
Semantic Scholar
Grammar-based Neural Text-to-SQL Generation
Kevin Lin, Ben Bogin, Mark Neumann, Jonathan Berant +1 more
2019arXiv.org65 citations
Semantic Scholar
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills
Ori Yoran, Alon Talmor, Jonathan Berant
2021Annual Meeting of the Association for Computational Linguistics60 citations Open access
Semantic Scholar
Question Answering is a Format; When is it Useful?
Matt Gardner, Jonathan Berant, Hannaneh Hajishirzi, Alon Talmor +1 more
2019arXiv.org58 citations
Semantic Scholar
White-to-Black: Efficient Distillation of Black-Box Adversarial Attacks
Yotam Gil, Yoav Chai, O. Gorodissky, Jonathan Berant
2019North American Chapter of the Association for Computational Linguistics56 citations Open access
Semantic Scholar
DiscoFuse: A Large-Scale Dataset for Discourse-Based Sentence Fusion
Mor Geva, Eric Malmi, I. Szpektor, Jonathan Berant
2019North American Chapter of the Association for Computational Linguistics56 citations Open access
Semantic Scholar
QAMPARI: A Benchmark for Open-domain Questions with Many Answers
S. Amouyal, Tomer Wolfson, Ohad Rubin, Ori Yoran +2 more
2022IEEE Games Entertainment Media Conference55 citations
Semantic Scholar
GMAT: Global Memory Augmentation for Transformers
Ankit Gupta, Jonathan Berant
2020arXiv.org55 citations
Semantic Scholar
Explaining Question Answering Models through Text Generation
Veronica Latcinnik, Jonathan Berant
2020arXiv.org53 citations
Semantic Scholar
What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary
Ori Ram, L. Bezalel, Adi Zicher, Yonatan Belinkov +2 more
2022Annual Meeting of the Association for Computational Linguistics49 citations Open access
Semantic Scholar
Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors
Ido Amos, Jonathan Berant, Ankit Gupta
2023International Conference on Learning Representations46 citations Open access
Semantic Scholar