Jonathan Berant

Affiliations:
  • Allen Institute for Artificial Intelligence, Tel Aviv, Israel
  • Tel-Aviv University, Israel
  • Stanford University, USA (former)


According to our database1, Jonathan Berant authored at least 137 papers between 2008 and 2024.

Collaborative distances:
  • Dijkstra number2 of three.
  • Erdős number3 of two.

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
Retrieval-Pretrained Transformer: Long-range Language Modeling with Self-retrieval.
Trans. Assoc. Comput. Linguistics, 2024

ALTA: Compiler-Based Analysis of Transformers.
CoRR, 2024

Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoning.
CoRR, 2024

From Loops to Oops: Fallback Behaviors of Language Models Under Uncertainty.
CoRR, 2024

Robust Preference Optimization through Reward Model Distillation.
CoRR, 2024

DOLOMITES: Domain-Specific Long-Form Methodical Tasks.
CoRR, 2024

In-Context Learning with Long-Context Models: An In-Depth Exploration.
CoRR, 2024

Theoretical guarantees on the best-of-n alignment policy.
CoRR, 2024

Classification of depression tendency from gaze patterns during sentence reading.
Biomed. Signal Process. Control., 2024

SEMQA: Semi-Extractive Multi-Source Question Answering.
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Transforming and Combining Rewards for Aligning Large Language Models.
Proceedings of the Forty-first International Conference on Machine Learning, 2024

Making Retrieval-Augmented Language Models Robust to Irrelevant Context.
Proceedings of the Twelfth International Conference on Learning Representations, 2024

Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priors.
Proceedings of the Twelfth International Conference on Learning Representations, 2024

AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Large Language Models for Psycholinguistic Plausibility Pretesting.
Proceedings of the Findings of the Association for Computational Linguistics: EACL 2024, 2024

2023
Latent Trees for Compositional Generalization.
Proceedings of the Compendium of Neurosymbolic Artificial Intelligence, 2023

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models.
, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,
Trans. Mach. Learn. Res., 2023

Efficient Long-Text Understanding with Short-Text Models.
Trans. Assoc. Comput. Linguistics, 2023

Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking.
CoRR, 2023

Long-range Language Modeling with Self-retrieval.
CoRR, 2023

From Pixels to UI Actions: Learning to Follow Instructions via Graphical User Interfaces.
Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Answering Questions by Meta-Reasoning over Multiple Chains of Thought.
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

ZeroSCROLLS: A Zero-Shot Benchmark for Long Text Understanding.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Crawling The Internal Knowledge-Base of Language Models.
Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

What Are You Token About? Dense Retrieval as Distributions Over the Vocabulary.
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Diverse Demonstrations Improve In-context Compositional Generalization.
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Analyzing Transformers in Embedding Space.
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022
Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question Decomposition.
Trans. Assoc. Comput. Linguistics, 2022

Simplifying and Understanding State Space Models with Diagonal Linear RNNs.
CoRR, 2022

QAMPARI: : An Open-domain Question Answering Benchmark for Questions with Many Answers from Multiple Paragraphs.
CoRR, 2022

Inferring Implicit Relations with Language Models.
CoRR, 2022

Diagonal State Spaces are as Effective as Structured State Spaces.
Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Weakly Supervised Text-to-SQL Parsing through Question Decomposition.
Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2022, 2022

Learning To Retrieve Prompts for In-Context Learning.
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Learning to Retrieve Passages without Supervision.
Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Inferring Implicit Relations in Complex Questions with Language Models.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Scaling Laws Under the Microscope: Predicting Transformer Performance from Small Scale Experiments.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Unobserved Local Structures Make Compositional Generalization Hard.
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

SCROLLS: Standardized CompaRison Over Long Language Sequences.
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Training Vision-Language Models with Less Bimodal Supervision.
Proceedings of the 4th Conference on Automated Knowledge Base Construction, 2022

Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills.
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021
Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies.
Trans. Assoc. Comput. Linguistics, 2021

Latent Compositional Representations Improve Systematic Generalization in Grounded Question Answering.
Trans. Assoc. Comput. Linguistics, 2021

Weakly Supervised Mapping of Natural Language to SQL through Question Decomposition.
CoRR, 2021

CommonsenseQA 2.0: Exposing the Limits of AI through Gamification.
Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

SmBoP: Semi-autoregressive Bottom-up Semantic Parsing.
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

MultiModalQA: complex question answering over text, tables and images.
Proceedings of the 9th International Conference on Learning Representations, 2021

Scene Graph tO Image Generation with Contextualized Object Layout Refinement.
Proceedings of the 2021 IEEE International Conference on Image Processing, 2021

Finding needles in a haystack: Sampling Structurally-diverse Training Sets from Synthetic Data for Compositional Generalization.
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Achieving Model Robustness through Discrete Adversarial Training.
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Memory-efficient Transformers via Top-k Attention.
Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing, 2021

Value-aware Approximate Attention.
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Transformer Feed-Forward Layers Are Key-Value Memories.
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

What's in Your Head? Emergent Behaviour in Multi-Task Transformer Models.
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

COVR: A Test-Bed for Visually Grounded Compositional Generalization with Real Images.
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Evaluating the Evaluation of Diversity in Natural Language Generation.
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

BERTese: Learning to Speak to BERT.
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

Question Decomposition with Dependency Graphs.
Proceedings of the 3rd Conference on Automated Knowledge Base Construction, 2021

Few-Shot Question Answering by Pretraining Span Selection.
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

Span-based Semantic Parsing for Compositional Generalization.
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020
Break It Down: A Question Understanding Benchmark.
Trans. Assoc. Comput. Linguistics, 2020

oLMpics - On what Language Model Pre-training Captures.
Trans. Assoc. Comput. Linguistics, 2020

Learning Object Detection from Captions via Textual Scene Attributes.
CoRR, 2020

A Simple Global Neural Discourse Parser.
CoRR, 2020

Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge.
CoRR, 2020

GMAT: Global Memory Augmentation for Transformers.
CoRR, 2020

Explaining Question Answering Models through Text Generation.
CoRR, 2020

Evaluating NLP Models via Contrast Sets.
CoRR, 2020

Differentiable Scene Graphs.
Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 2020

Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit Knowledge.
Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

A Simple and Effective Model for Answering Multi-span Questions.
Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Improving Compositional Generalization in Semantic Parsing.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020


Obtaining Faithful Interpretations from Compositional Neural Networks.
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Injecting Numerical Reasoning Skills into Language Models.
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019
Question Answering is a Format; When is it Useful?
CoRR, 2019

Grammar-based Neural Text-to-SQL Generation.
CoRR, 2019

Learning Latent Scene-Graph Representations for Referring Relationships.
CoRR, 2019

Evaluating Text GANs as Language Models.
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge.
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Value-based Search in Execution Space for Mapping Instructions to Programs.
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

White-to-Black: Efficient Distillation of Black-Box Adversarial Attacks.
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

DiscoFuse: A Large-Scale Dataset for Discourse-Based Sentence Fusion.
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Neural network gradient-based learning of black-box function interfaces.
Proceedings of the 7th International Conference on Learning Representations, 2019

Explaining Queries Over Web Tables to Non-experts.
Proceedings of the 35th IEEE International Conference on Data Engineering, 2019

Don't paraphrase, detect! Rapid and Effective Data Collection for Semantic Parsing.
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets.
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Global Reasoning over Database Structures for Text-to-SQL Parsing.
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

On the Limits of Learning to Actively Learn Semantic Representations.
Proceedings of the 23rd Conference on Computational Natural Language Learning, 2019

MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension.
Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

Representing Schema Structure with Graph Neural Networks for Text-to-SQL Parsing.
Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

On Making Reading Comprehension More Comprehensive.
Proceedings of the 2nd Workshop on Machine Reading for Question Answering, 2019

2018
Emergence of Communication in an Interactive World with Consistent Speakers.
CoRR, 2018

Repartitioning of the ComplexWebQuestions Dataset.
CoRR, 2018

Memory Augmented Policy Optimization for Program Synthesis with Generalization.
CoRR, 2018

Memory Augmented Policy Optimization for Program Synthesis and Semantic Parsing.
Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Mapping Images to Scene Graphs with Permutation-Invariant Structured Prediction.
Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

The Web as a Knowledge-Base for Answering Complex Questions.
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Contextualized Word Representations for Reading Comprehension.
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Polyglot Semantic Parsing in APIs.
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Text Segmentation as a Supervised Learning Task.
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018

Decoupling Structure and Lexicon for Zero-Shot Semantic Parsing.
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Learning to Search in Long Documents Using Document Structure.
Proceedings of the 27th International Conference on Computational Linguistics, 2018

Weakly Supervised Semantic Parsing with Abstract Examples.
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017
Weakly-supervised Semantic Parsing with Abstract Examples.
CoRR, 2017

Inducing Regular Grammars Using Recurrent Neural Networks.
CoRR, 2017

Language Generation with Recurrent Generative Adversarial Networks without Pre-training.
CoRR, 2017

Evaluating Semantic Parsing against a Simple Web-based Question Answering Model.
Proceedings of the 6th Joint Conference on Lexical and Computational Semantics, 2017

Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision.
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017

Neural Semantic Parsing over Multiple Knowledge-bases.
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017

Coarse-to-Fine Question Answering for Long Documents.
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017

2016
Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision (Short Version).
CoRR, 2016

Hierarchical Question Answering for Long Documents.
CoRR, 2016

Learning to generalize to new compositions in image understanding.
CoRR, 2016

2015
Imitation Learning of Agenda-based Semantic Parsers.
Trans. Assoc. Comput. Linguistics, 2015

Knowledge-Based Textual Inference via Parse-Tree Transformations.
J. Artif. Intell. Res., 2015

Efficient Global Learning of Entailment Graphs.
Comput. Linguistics, 2015

Building a Semantic Parser Overnight.
Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

2014
Modeling Biological Processes for Reading Comprehension.
Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 2014

Semantic Parsing via Paraphrasing.
Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

2013
Learning Biological Processes with Global Constraints.
Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013

Semantic Parsing on Freebase from Question-Answer Pairs.
Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013

A Two Level Model for Context Sensitive Inference Rules.
Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 2013

2012
Global learning of textual entailment graphs
PhD thesis, 2012

Learning Entailment Relations by Global Graph Structure Optimization.
Comput. Linguistics, 2012

Learning Verb Inference Rules from Linguistically-Motivated Evidence.
Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 2012

Crowdsourcing Inference-Rule Evaluation.
Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, July 8-14, 2012, Jeju Island, Korea, 2012

Efficient Tree-based Approximation for Entailment Graph Learning.
Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, July 8-14, 2012, Jeju Island, Korea, 2012

Entailment-based Text Exploration with Application to the Health-care Domain.
Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, 2012

2011
Knowledge and Tree-Edits in Learnable Entailment Proofs.
Proceedings of the Fourth Text Analysis Conference, 2011

Global Learning of Typed Entailment Rules.
Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, 2011

2010
Rule Chaining and Approximate Match in textual inference.
Proceedings of the Third Text Analysis Conference, 2010

Recognising Entailment within Discourse.
Proceedings of the COLING 2010, 2010

Global Learning of Focused Entailment Graphs.
Proceedings of the ACL 2010, 2010

2009
Addressing Discourse and Document Structure in the RTE Search Task.
Proceedings of the Second Text Analysis Conference, 2009

A Compact Forest for Scalable Inference over Entailment and Paraphrase Rules.
Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, 2009

2008
Efficient Semantic Deduction and Approximate Matching over Compact Parse Forests.
Proceedings of the First Text Analysis Conference, 2008


  Loading...