Jesse Thomason

According to our database, Jesse Thomason authored at least 70 papers between 2014 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Generating Contextually-Relevant Navigation Instructions for Blind and Low Vision People.

Zain Merchant, Abrar Anwar, Emily Wang, Souti Chattopadhyay, Jesse Thomason

CoRR, 2024

Contrast Sets for Evaluating Language-Guided Robot Policies.

Abrar Anwar, Rohan Gupta, Jesse Thomason

CoRR, 2024

Language Models can Infer Action Semantics for Classical Planners from Environment Feedback.

Wang Zhu, Ishika Singh, Robin Jia, Jesse Thomason

CoRR, 2024

TwoStep: Multi-agent Task Planning using Classical Planners and Large Language Models.

Ishika Singh, David Traum, Jesse Thomason

CoRR, 2024

ViSaRL: Visual Reinforcement Learning Guided by Human Saliency.

Anthony Liang, Jesse Thomason, Erdem Biyik

CoRR, 2024

WinoViz: Probing Visual Properties of Objects Under Different States.

Woojeong Jin, Tejas Srinivasan, Jesse Thomason, Xiang Ren

CoRR, 2024

THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation.

Wilbert Pumacay, Ishika Singh, Jiafei Duan, Ranjay Krishna, Jesse Thomason, Dieter Fox

CoRR, 2024

Which One? Leveraging Context Between Objects and Multiple Views for Language Grounding.

Chancharik Mitra, Abrar Anwar, Rodolfo Corona, Dan Klein, Trevor Darrell, Jesse Thomason

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Do Localization Methods Actually Localize Memorized Data in LLMs? A Tale of Two Benchmarks.

Ting-Yun Chang, Jesse Thomason, Robin Jia

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Efficient End-to-End Visual Document Understanding with Rationale Distillation.

Wang Zhu, Alekh Agarwal, Mandar Joshi, Robin Jia, Jesse Thomason, Kristina Toutanova

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

When Parts Are Greater Than Sums: Individual LLM Components Can Outperform Full Models.

Ting-Yun Chang, Jesse Thomason, Robin Jia

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning.

Tejas Srinivasan, Jack Hessel, Tanmay Gupta, Bill Yuchen Lin, Yejin Choi, Jesse Thomason, Khyathi Raghavi Chandu

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

ProgPrompt: program generation for situated robot task planning using large language models.

Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, Animesh Garg

Auton. Robots, December, 2023

Multimodal embodied attribute learning by robots for object-centric action policies.

Xiaohan Zhang, Saeid Amiri, Jivko Sinapov, Jesse Thomason, Peter Stone, Shiqi Zhang

Auton. Robots, June, 2023

Does VLN Pretraining Work with Nonsensical or Irrelevant Instructions?

Wang Zhu, Ishika Singh, Yuan Huang, Robin Jia, Jesse Thomason

CoRR, 2023

Do Localization Methods Actually Localize Memorized Data in LLMs?

Ting-Yun Chang, Jesse Thomason, Robin Jia

CoRR, 2023

Comparative Multi-View Language Grounding.

Chancharik Mitra, Abrar Anwar, Rodolfo Corona, Dan Klein, Trevor Darrell, Jesse Thomason

CoRR, 2023

The Sem-Lex Benchmark: Modeling ASL Signs and Their Phonemes.

Lee Kezar, Elana Pontecorvo, Adele Daniels, Connor Baer, Ruth Ferster, Lauren Berger, Jesse Thomason, Zed Sevcikova Sehyr, Naomi Caselli

CoRR, 2023

Geolocated Social Media Posts are Happier: Understanding the Characteristics of Check-in Posts on Twitter.

Julie Jiang, Jesse Thomason, Francesco Barbieri, Emilio Ferrara

Proceedings of the 15th ACM Web Science Conference 2023, 2023

RREx-BoT: Remote Referring Expressions with a Bag of Tricks.

Gunnar A. Sigurdsson, Jesse Thomason, Gaurav S. Sukhatme, Robinson Piramuthu

IROS, 2023

Multimodal Speech Recognition for Language-Guided Embodied Agents.

Allen Chang, Xiaoyuan Zhu, Aarav Monga, Seoho Ahn, Tejas Srinivasan, Jesse Thomason

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

ProgPrompt: Generating Situated Robot Task Plans using Large Language Models.

Ishika Singh, Valts Blukis, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Jesse Thomason, Animesh Garg

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

Exploring Strategies for Modeling Sign Language Phonology.

Lee Kezar, Tejas Srinivasan, Riley Carlin, Jesse Thomason, Zed Sevcikova Sehyr, Naomi Caselli

Proceedings of the 31st European Symposium on Artificial Neural Networks, 2023

Task-Attentive Transformer Architecture for Continual Learning of Vision-and-Language Tasks Using Knowledge Distillation.

Yuliang Cai, Jesse Thomason, Mohammad Rostami

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Chain-of-Questions Training with Latent Answers for Robust Multistep Question Answering.

Wang Zhu, Jesse Thomason, Robin Jia

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Improving Sign Recognition with Phonology.

Lee Kezar, Jesse Thomason, Zed Sevcikova Sehyr

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

Curriculum Learning for Data-Efficient Vision-Language Alignment.

Tejas Srinivasan, Xiang Ren, Jesse Thomason

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Iterative Vision-and-Language Navigation.

Jacob Krantz, Shurjo Banerjee, Wang Zhu, Jason J. Corso, Peter Anderson, Stefan Lee, Jesse Thomason

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

I2I: Initializing Adapters with Improvised Knowledge.

Tejas Srinivasan, Furong Jia, Mohammad Rostami, Jesse Thomason

Proceedings of the Conference on Lifelong Learning Agents, 2023

The Sem-Lex Benchmark: Modeling ASL Signs and their Phonemes.

Lee Kezar, Jesse Thomason, Naomi Caselli, Zed Sevcikova Sehyr, Elana Pontecorvo

Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility, 2023

2022

CLIP-Nav: Using CLIP for Zero-Shot Vision-and-Language Navigation.

Vishnu Sashank Dorbala, Gunnar A. Sigurdsson, Robinson Piramuthu, Jesse Thomason, Gaurav S. Sukhatme

CoRR, 2022

Retrospectives on the Embodied AI Workshop.

Matt Deitke, Dhruv Batra, Yonatan Bisk, Tommaso Campari, Angel X. Chang, Devendra Singh Chaplot, Changan Chen, Claudia Pérez-D'Arpino, Kiana Ehsani, Ali Farhadi, Li Fei-Fei, Anthony G. Francis, Chuang Gan, Kristen Grauman, David Hall, Winson Han, Unnat Jain, Aniruddha Kembhavi, Jacob Krantz, Stefan Lee, Chengshu Li, Sagnik Majumder, Oleksandr Maksymets, Roberto Martín-Martín, Roozbeh Mottaghi, Sonia Raychaudhuri, Mike Roberts, Silvio Savarese, Manolis Savva, Mohit Shridhar, Niko Sünderhauf, Andrew Szot, Ben Talbot, Joshua B. Tenenbaum, Jesse Thomason, Alexander Toshev, Joanne Truong, Luca Weihs, Jiajun Wu

CoRR, 2022

VAuLT: Augmenting the Vision-and-Language Transformer with the Propagation of Deep Language Representations.

Georgios Chochlakis, Tejas Srinivasan, Jesse Thomason, Shrikanth Narayanan

CoRR, 2022

Interactive Learning from Natural Language and Demonstrations using Signal Temporal Logic.

Sara Mohammadinejad, Jesse Thomason, Jyotirmoy V. Deshmukh

CoRR, 2022

CLiMB: A Continual Learning Benchmark for Vision-and-Language Tasks.

Tejas Srinivasan, Ting-Yun Chang, Leticia Leonor Pinto Alva, Georgios Chochlakis, Mohammad Rostami, Jesse Thomason

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

SSL Enables Learning from Sparse Rewards in Image-Goal Navigation.

Arjun Majumdar, Gunnar A. Sigurdsson, Robinson Piramuthu, Jesse Thomason, Dhruv Batra, Gaurav S. Sukhatme

Proceedings of the International Conference on Machine Learning, 2022

ALFRED-L: Investigating the Role of Language for Action Learning in Interactive Visual Environments.

Arjun R. Akula, Spandana Gella, Aishwarya Padmakumar, Mahdi Namazifar, Mohit Bansal, Jesse Thomason, Dilek Hakkani-Tur

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Generalization Differences between End-to-End and Neuro-Symbolic Vision-Language Reasoning Systems.

Wang Zhu, Jesse Thomason, Robin Jia

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions.

Jing Gu, Eliana Stefani, Qi Wu, Jesse Thomason, Xin Wang

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

TEACh: Task-Driven Embodied Agents That Chat.

Aishwarya Padmakumar, Jesse Thomason, Ayush Shrivastava, Patrick Lange, Anjali Narayan-Chen, Spandana Gella, Robinson Piramuthu, Gökhan Tür, Dilek Hakkani-Tür

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

LUMINOUS: Indoor Scene Generation for Embodied AI Challenges.

Yizhou Zhao, Kaixiang Lin, Zhiwei Jia, Qiaozi Gao, Govind Thattai, Jesse Thomason, Gaurav S. Sukhatme

CoRR, 2021

Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion.

Alessandro Suglia, Qiaozi Gao, Jesse Thomason, Govind Thattai, Gaurav S. Sukhatme

CoRR, 2021

Language Grounding with 3D Objects.

Jesse Thomason, Mohit Shridhar, Yonatan Bisk, Chris Paxton, Luke Zettlemoyer

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

2020

Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog.

Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Justin W. Hart, Peter Stone, Raymond J. Mooney

J. Artif. Intell. Res., 2020

Interpreting Black Box Models via Hypothesis Testing.

Collin Burns, Jesse Thomason, Wesley Tansey

Proceedings of the FODS '20: ACM-IMS Foundations of Data Science Conference, 2020

RMM: A Recursive Mental Model for Dialog Navigation.

Homero Roman Roman, Yonatan Bisk, Jesse Thomason, Asli Celikyilmaz, Jianfeng Gao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

Experience Grounds Language.

Yonatan Bisk, Ari Holtzman, Jesse Thomason, Jacob Andreas, Yoshua Bengio, Joyce Chai, Mirella Lapata, Angeliki Lazaridou, Jonathan May, Aleksandr Nisnevich, Nicolas Pinto, Joseph P. Turian

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks.

Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, Dieter Fox

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

The RobotSlang Benchmark: Dialog-guided Robot Localization and Navigation.

Shurjo Banerjee, Jesse Thomason, Jason J. Corso

Proceedings of the 4th Conference on Robot Learning, 2020

2019

Interpreting Black Box Models with Statistical Guarantees.

Collin Burns, Jesse Thomason, Wesley Tansey

CoRR, 2019

Shifting the Baseline: Single Modality Performance on Visual Navigation & QA.

Jesse Thomason, Daniel Gordon, Yonatan Bisk

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Improving Robot Success Detection using Static Object Data.

Rosario Scalise, Jesse Thomason, Yonatan Bisk, Siddhartha S. Srinivasa

Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019

Augmenting Knowledge through Statistical, Goal-oriented Human-Robot Dialog.

Saeid Amiri, Sujay Bajracharya, Cihangir Goktolga, Jesse Thomason, Shiqi Zhang

Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019

Improving Grounded Natural Language Understanding through Human-Robot Dialog.

Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Justin W. Hart, Peter Stone, Raymond J. Mooney

Proceedings of the International Conference on Robotics and Automation, 2019

Prospection: Interpretable plans from language by predicting the future.

Chris Paxton, Yonatan Bisk, Jesse Thomason, Arunkumar Byravan, Dieter Fox

Proceedings of the International Conference on Robotics and Automation, 2019

Vision-and-Dialog Navigation.

Jesse Thomason, Michael Murray, Maya Cakmak, Luke Zettlemoyer

Proceedings of the 3rd Annual Conference on Robot Learning, 2019

2018

Interaction and Autonomy in RoboCup@Home and Building-Wide Intelligence.

Justin W. Hart, Harel Yedidsion, Yuqian Jiang, Nick Walker, Rishi Shah, Jesse Thomason, Aishwarya Padmakumar, Rolando Fernandez, Jivko Sinapov, Raymond J. Mooney, Peter Stone

CoRR, 2018

Multi-modal Predicate Identification using Dynamically Learned Robot Controllers.

Saeid Amiri, Suhua Wei, Shiqi Zhang, Jivko Sinapov, Jesse Thomason, Peter Stone

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence, 2018

Robot Behavioral Exploration and Multi-modal Perception using Dynamically Constructed Controllers.

Saeid Amiri, Suhua Wei, Shiqi Zhang, Jivko Sinapov, Jesse Thomason, Peter Stone

Proceedings of the 2018 AAAI Spring Symposia, 2018

Guiding Exploratory Behaviors for Multi-Modal Grounding of Linguistic Descriptions.

Jesse Thomason, Jivko Sinapov, Raymond J. Mooney, Peter Stone

Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, 2018

Maximum-Variance Total Variation Denoising for Interpretable Spatial Smoothing.

Wesley Tansey, Jesse Thomason, James G. Scott

Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, 2018

2017

BWIBots: A platform for bridging the gap between AI and human-robot interaction research.

Piyush Khandelwal, Shiqi Zhang, Jivko Sinapov, Matteo Leonetti, Jesse Thomason, Fangkai Yang, Ilaria Gori, Maxwell Svetlik, Priyanka Khante, Vladimir Lifschitz, J. K. Aggarwal, Raymond J. Mooney, Peter Stone

Int. J. Robotics Res., 2017

Improving Black-box Speech Recognition using Semantic Parsing.

Rodolfo Corona, Jesse Thomason, Raymond J. Mooney

Proceedings of the Eighth International Joint Conference on Natural Language Processing, 2017

Multi-Modal Word Synset Induction.

Jesse Thomason, Raymond J. Mooney

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, 2017

Integrated Learning of Dialog Strategies and Semantic Parsing.

Aishwarya Padmakumar, Jesse Thomason, Raymond J. Mooney

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017

Opportunistic Active Learning for Grounding Natural Language Descriptions.

Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Justin W. Hart, Peter Stone, Raymond J. Mooney

Proceedings of the 1st Annual Conference on Robot Learning, CoRL 2017, Mountain View, 2017

Guiding Interaction Behaviors for Multi-modal Grounded Language Learning.

Jesse Thomason, Jivko Sinapov, Raymond J. Mooney

Proceedings of the First Workshop on Language Grounding for Robotics, 2017

2016

Learning Multi-Modal Grounded Linguistic Semantics by Playing "I Spy".

Jesse Thomason, Jivko Sinapov, Maxwell Svetlik, Peter Stone, Raymond J. Mooney

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

2015

Learning to Interpret Natural Language Commands through Human-Robot Dialog.

Jesse Thomason, Shiqi Zhang, Raymond J. Mooney, Peter Stone

Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, 2015

2014

Integrating Language and Vision to Generate Natural Language Descriptions of Videos in the Wild.

Jesse Thomason, Subhashini Venugopalan, Sergio Guadarrama, Kate Saenko, Raymond J. Mooney

Proceedings of the COLING 2014, 2014