2025
Cancer Type, Stage and Prognosis Assessment from Pathology Reports using LLMs.
CoRR, March, 2025
Imitation Learning from a Single Temporally Misaligned Video.
CoRR, February, 2025
2024
A Joint Study of Phrase Grounding and Task Performance in Vision and Language Models.
Trans. Mach. Learn. Res., 2024
Retrospective Learning from Interactions.
CoRR, 2024
LLMs Are In-Context Reinforcement Learners.
CoRR, 2024
Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs.
CoRR, 2024
A Surprising Failure? Multimodal LLMs and the NLVR Challenge.
CoRR, 2024
CoGen: Learning from Feedback with Coupled Comprehension and Generation.
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024
2023
Continual Learning for Instruction Following from Realtime Feedback.
Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023
IncDSI: Incrementally Updatable Document Retrieval.
Proceedings of the International Conference on Machine Learning, 2023
Wav2Seq: Pre-Training Speech-to-Text Encoder-Decoder Models Using Pseudo Languages.
Proceedings of the IEEE International Conference on Acoustics, 2023
Continually Improving Extractive QA via Human Feedback.
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023
Semantic uncertainty guides the extension of conventions to new referents.
Proceedings of the 45th Annual Meeting of the Cognitive Science Society, 2023
lilGym: Natural Language Visual Reasoning with Reinforcement Learning.
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023
CB2: Collaborative Natural Language Interaction Research Platform.
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2023
2022
Spoken language interaction with robots: Recommendations for future research.
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
Comput. Speech Lang., 2022
Performance-Efficiency Trade-Offs in Unsupervised Pre-Training for Speech Recognition.
Proceedings of the IEEE International Conference on Acoustics, 2022
SLUE: New Benchmark Tasks For Spoken Language Understanding Evaluation on Natural Speech.
Proceedings of the IEEE International Conference on Acoustics, 2022
Abstract Visual Reasoning with Tangram Shapes.
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022
Simulating Bandit Learning from User Feedback for Extractive Question Answering.
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022
2021
Continual Learning for Grounded Instruction Generation by Observing Human Following Behavior.
Trans. Assoc. Comput. Linguistics, 2021
Revisiting Few-sample BERT Fine-tuning.
Proceedings of the 9th International Conference on Learning Representations, 2021
Who's Waldo? Linking People Across Text and Images.
Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021
When in Doubt: Improving Classification Performance with Alternating Normalization.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021
Analysis of Language Change in Collaborative Instruction Following.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021
A Persistent Spatial Semantic Representation for High-level Natural Language Instruction Execution.
Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021
2020
Evaluating NLP Models via Contrast Sets.
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
CoRR, 2020
Retouchdown: Adding Touchdown to StreetLearn as a Shareable Resource for Language Grounding Tasks in Street View.
CoRR, 2020
BERTScore: Evaluating Text Generation with BERT.
Proceedings of the 8th International Conference on Learning Representations, 2020
Evaluating Models' Local Decision Boundaries via Contrast Sets.
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020
Few-shot Object Grounding and Mapping for Natural Language Robot Instruction Following.
Proceedings of the 4th Conference on Robot Learning, 2020
Interactive Classification by Asking Informative Questions.
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020
What is Learned in Visually Grounded Neural Syntax Acquisition.
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020
2019
NLVR2 Visual Bias Analysis.
CoRR, 2019
Understanding Reader Backtracking Behavior in Online News Articles.
Proceedings of the World Wide Web Conference, 2019
EARLY FUSION for Goal Directed Robotic Vision.
Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019
Executing Instructions in Situated Collaborative Interactions.
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019
TOUCHDOWN: Natural Language Navigation and Spatial Reasoning in Visual Street Environments.
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019
Learning to Map Natural Language Instructions to Physical Quadcopter Control using Simulated Flight.
Proceedings of the 3rd Annual Conference on Robot Learning, 2019
A Corpus for Reasoning about Natural Language Grounded in Photographs.
Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019
2018
A Corpus for Reasoning About Natural Language Grounded in Photographs.
CoRR, 2018
CHALET: Cornell House Agent Learning Environment.
CoRR, 2018
Evaluating Visual Reasoning through Grounded Language Understanding.
AI Mag., 2018
Following High-level Navigation Instructions on a Simulated Quadcopter with Imitation Learning.
Proceedings of the Robotics: Science and Systems XIV, 2018
Learning to Map Context-Dependent Sentences to Executable Formal Queries.
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018
Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategies.
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2018
Mapping Instructions to Actions in 3D Environments with Visual Goal Prediction.
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018
Simple Recurrent Units for Highly Parallelizable Recurrence.
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018
Mapping Navigation Instructions to Continuous Control Actions with Position-Visitation Prediction.
Proceedings of the 2nd Annual Conference on Robot Learning, 2018
Situated Mapping of Sequential Instructions to Actions with Single-step Reward Observation.
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018
2017
Visual Reasoning with Natural Language.
CoRR, 2017
Training RNNs as Fast as CNNs.
CoRR, 2017
Mapping Instructions and Visual Observations to Actions with Reinforcement Learning.
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017
Modeling Sub-Document Attention Using Viewport Time.
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017
A Corpus of Natural Language for Visual Reasoning.
Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017
2016
Neural Shift-Reduce CCG Semantic Parsing.
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016
2015
Situated Learning and Understanding of Natural Language.
PhD thesis, 2015
Event Detection and Factuality Assessment with Non-Expert Supervision.
Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015
Broad-coverage CCG Semantic Parsing with AMR.
Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015
2014
Learning Compact Lexicons for CCG Semantic Parsing.
Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, 2014
Context-dependent Semantic Parsing for Time Expressions.
Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014
Learning to Automatically Solve Algebra Word Problems.
Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014
Programming by Demonstration with Situated Semantic Parsing.
Proceedings of the 2014 AAAI Fall Symposia, Arlington, Virginia, USA, November 13-15, 2014, 2014
2013
Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to Actions.
Trans. Assoc. Comput. Linguistics, 2013
UW SPF: The University of Washington Semantic Parsing Framework.
CoRR, 2013
Scaling Semantic Parsers with On-the-Fly Ontology Matching.
Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013
Learning Distributions over Logical Forms for Referring Expression Generation.
Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, 2013
Semantic Parsing with Combinatory Categorial Grammars.
Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, 2013
2012
Predicting Responses to Microblog Posts.
Proceedings of the Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, 2012
2011
Bootstrapping Semantic Parsers from Conversations.
Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, 2011