Jonathan Francis

According to our database, Jonathan Francis authored at least 61 papers between 2010 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of four.

2024

Grounding Robot Policies with Visuomotor Language Guidance.

Arthur Bucker, Pablo Ortega-Kral, Jonathan Francis, Jean Oh

CoRR, 2024

SEAL: Towards Safe Autonomous Driving via Skill-Enabled Adversary Learning for Closed-Loop Scenario Generation.

Benjamin Stoler, Ingrid Navarro, Jonathan Francis, Jean Oh

CoRR, 2024

Cognitive LLMs: Towards Integrating Cognitive Architectures and Large Language Models for Manufacturing Decision-making.

Siyu Wu, Alessandro Oltramari, Jonathan Francis, C. Lee Giles, Frank E. Ritter

CoRR, 2024

Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge.

Sriram Yenamandra, Arun Ramachandran, Mukul Khanna, Karmesh Yadav, Jay Vakil, Andrew Melnik, Michael Büttner, Leon Harz, Lyon Brown, Gora Chand Nandi, Arjun P. S, Gaurav Kumar Yadav, Rahul Kala, Robert Haschke, Yang Luo, Jinxin Zhu, Yansen Han, Bingyi Lu, Xuan Gu, Qinyuan Liu, Yaping Zhao, Qiting Ye, Chenxiao Dou, Yansong Chua, Volodymyr Kuzma, Vladyslav Humennyy, Ruslan Partsey, Jonathan Francis, Devendra Singh Chaplot, Gunjan Chhablani, Alexander Clegg, Théophile Gervet, Vidhi Jain, Ram Ramrakhya, Andrew Szot, Austin S. Wang, Tsung-Yen Yang, Aaron Edsinger, Charles C. Kemp, Binit Shah, Zsolt Kira, Dhruv Batra, Roozbeh Mottaghi, Yonatan Bisk, Chris Paxton

CoRR, 2024

Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understanding.

Aaron Lohner, Francesco Compagno, Jonathan Francis, Alessandro Oltramari

CoRR, 2024

Attribution Regularization for Multimodal Paradigms.

Sahiti Yerramilli, Jayant Sravan Tamarapalli, Jonathan Francis, Eric Nyberg

CoRR, 2024

Semantic Augmentation in Images using Language.

Sahiti Yerramilli, Jayant Sravan Tamarapalli, Tanmay Girish Kulkarni, Jonathan Francis, Eric Nyberg

CoRR, 2024

CaDRE: Controllable and Diverse Generation of Safety-Critical Driving Scenarios using Real-World Trajectories.

Peide Huang, Wenhao Ding, Jonathan Francis, Bingqing Chen, Ding Zhao

CoRR, 2024

SafeShift: Safety-Informed Distribution Shifts for Robust Trajectory Prediction in Autonomous Driving.

Benjamin Stoler, Ingrid Navarro, Meghdeep Jana, Soonmin Hwang, Jonathan Francis, Jean Oh

Proceedings of the IEEE Intelligent Vehicles Symposium, 2024

MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Learning via Interactive Perception.

Gyan Tatiya, Jonathan Francis, Ho-Hsiang Wu, Yonatan Bisk, Jivko Sinapov

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

RoPotter: Toward Robotic Pottery and Deformable Object Manipulation with Structural Priors.

Uksang Yoo, Adam Hung, Jonathan Francis, Jean Oh, Jeffrey Ichnowski

Proceedings of the 23rd IEEE-RAS International Conference on Humanoid Robots, 2024

2023

Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis.

Yafei Hu, Quanting Xie, Vidhi Jain, Jonathan Francis, Jay Patrikar, Nikhil Varma Keetha, Seungchan Kim, Yaqi Xie, Tianyi Zhang, Shibo Zhao, Yu Quan Chong, Chen Wang, Katia P. Sycara, Matthew Johnson-Roberson, Dhruv Batra, Xiaolong Wang, Sebastian A. Scherer, Zsolt Kira, Fei Xia, Yonatan Bisk

CoRR, 2023

MOSAIC: Learning Unified Multi-Sensory Object Property Representations for Robot Perception.

Gyan Tatiya, Jonathan Francis, Ho-Hsiang Wu, Yonatan Bisk, Jivko Sinapov

CoRR, 2023

Traffic-Domain Video Question Answering with Automatic Captioning.

Ehsan Qasemi, Jonathan M. Francis, Alessandro Oltramari

CoRR, 2023

Regularizing Self-training for Unsupervised Domain Adaptation via Structural Constraints.

Rajshekhar Das, Jonathan Francis, Sanket Vaibhav Mehta, Jean Oh, Emma Strubell, José M. F. Moura

CoRR, 2023

Cross-Tool and Cross-Behavior Perceptual Knowledge Transfer for Grounded Object Recognition.

Gyan Tatiya, Jonathan Francis, Jivko Sinapov

CoRR, 2023

Generalizable Neuro-Symbolic Systems for Commonsense Question Answering.

Alessandro Oltramari, Jonathan Francis, Filip Ilievski, Kaixin Ma, Roshanak Mirzaee

Proceedings of the 17th International Workshop on Neural-Symbolic Learning and Reasoning, 2023

A Study of Situational Reasoning for Traffic Understanding.

Jiarui Zhang, Filip Ilievski, Kaixin Ma, Aravinda Kollaa, Jonathan Francis, Alessandro Oltramari

Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2023

Knowledge-enhanced Agents for Interactive Text Games.

Prateek Chhikara, Jiarui Zhang, Filip Ilievski, Jonathan Francis, Kaixin Ma

Proceedings of the 12th Knowledge Capture Conference 2023, 2023

Core Challenges in Embodied Vision-Language Planning (Extended Abstract).

Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu, Ingrid Navarro, Jean Oh

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023

Transferring Implicit Knowledge of Non-Visual Object Properties Across Heterogeneous Robot Morphologies.

Gyan Tatiya, Jonathan Francis, Jivko Sinapov

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

What Went Wrong? Closing the Sim-to-Real Gap via Differentiable Causal Discovery.

Peide Huang, Xilun Zhang, Ziang Cao, Shiqi Liu, Mengdi Xu, Wenhao Ding, Jonathan Francis, Bingqing Chen, Ding Zhao

Proceedings of the Conference on Robot Learning, 2023

2022

Core Challenges in Embodied Vision-Language Planning.

Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu, Ingrid Navarro, Jean Oh

J. Artif. Intell. Res., 2022

Knowledge-driven Scene Priors for Semantic Audio-Visual Embodied Navigation.

Gyan Tatiya, Jonathan Francis, Luca Bondi, Ingrid Navarro, Eric Nyberg, Jivko Sinapov, Jean Oh

CoRR, 2022

Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving.

Jonathan Francis, Bingqing Chen, Weiran Yao, Eric Nyberg, Jean Oh

CoRR, 2022

Utilizing Background Knowledge for Robust Reasoning over Traffic Situations.

Jiarui Zhang, Filip Ilievski, Aravinda Kollaa, Jonathan Francis, Kaixin Ma, Alessandro Oltramari

CoRR, 2022

An Empirical Investigation of Commonsense Self-Supervision with Knowledge Graphs.

Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, Alessandro Oltramari

CoRR, 2022

Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing.

Jonathan Francis, Bingqing Chen, Siddha Ganju, Sidharth Kathpal, Jyotish Poonganam, Ayush Shivani, Vrushank Vyas, Sahika Genc, Ivan Zhukov, Max Kumskoy, Anirudh Koul, Jean Oh, Eric Nyberg

CoRR, 2022

Coalescing Global and Local Information for Procedural Text Understanding.

Kaixin Ma, Filip Ilievski, Jonathan Francis, Eric Nyberg, Alessandro Oltramari

Proceedings of the 29th International Conference on Computational Linguistics, 2022

A Study of Zero-shot Adaptation with Commonsense Knowledge.

Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, Alessandro Oltramari

Proceedings of the 4th Conference on Automated Knowledge Base Construction, 2022

Handcrafted and Neural Network Based Features for Outlier Modulation Detection.

Yue Qi, Ruixuan Wang, Mojtaba Vaezi, Jonathan Francis, Xun Jiao

Proceedings of the 56th Asilomar Conference on Signals, Systems, and Computers, ACSSC 2022, Pacific Grove, CA, USA, October 31, 2022

2021

Generalizable Neuro-Symbolic Systems for Commonsense Question Answering.

Alessandro Oltramari, Jonathan Francis, Filip Ilievski, Kaixin Ma, Roshanak Mirzaee

Proceedings of the Neuro-Symbolic Artificial Intelligence: The State of the Art, 2021

Safety-aware Policy Optimisation for Autonomous Racing.

Bingqing Chen, Jonathan Francis, James Herman, Jean Oh, Eric Nyberg, Sylvia L. Herbert

CoRR, 2021

Learn-to-Race: A Multimodal Control Environment for Autonomous Racing.

James Herman, Jonathan Francis, Siddha Ganju, Bingqing Chen, Anirudh Koul, Abhinav Gupta, Alexey Skabelkin, Ivan Zhukov, Max Kumskoy, Eric Nyberg

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models.

Kaixin Ma, Filip Ilievski, Jonathan Francis, Satoru Ozaki, Eric Nyberg, Alessandro Oltramari

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Building Goal-oriented Document-grounded Dialogue Systems.

Xi Chen, Faner Lin, Yeju Zhou, Kaixin Ma, Jonathan Francis, Eric Nyberg, Alessandro Oltramari

Proceedings of the 1st Workshop on Document-grounded Dialogue and Conversational Question Answering, 2021

Knowledge-driven Data Construction for Zero-shot Evaluation in Commonsense Question Answering.

Kaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk, Eric Nyberg, Alessandro Oltramari

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Neuro-Symbolic Architectures for Context Understanding.

Alessandro Oltramari, Jonathan Francis, Cory A. Henson, Kaixin Ma, Ruwan Wickramarachchi

Proceedings of the Knowledge Graphs for eXplainable Artificial Intelligence: Foundations, 2020

Lexically-constrained Text Generation through Commonsense Knowledge Extraction and Injection.

Yikang Li, Pulkit Goel, Varsha Kuppur Rajendra, Har Simrat Singh, Jonathan Francis, Kaixin Ma, Eric Nyberg, Alessandro Oltramari

CoRR, 2020

Trajformer: Trajectory Prediction with Local Self-Attentive Contexts for Autonomous Driving.

Manoj Bhat, Jonathan Francis, Jean Oh

CoRR, 2020

Knowledge-driven Self-supervision for Zero-shot Commonsense Question Answering.

Kaixin Ma, Filip Ilievski, Jonathan Francis, Yonatan Bisk, Eric Nyberg, Alessandro Oltramari

CoRR, 2020

Neuro-symbolic Architectures for Context Understanding.

Alessandro Oltramari, Jonathan Francis, Cory A. Henson, Kaixin Ma, Ruwan Wickramarachchi

CoRR, 2020

Learning a Distributed Control Scheme for Demand Flexibility in Thermostatically Controlled Loads.

Bingqing Chen, Weiran Yao, Jonathan Francis, Mario Bergés

Proceedings of the 2020 IEEE International Conference on Communications, 2020

COHORT: Coordination of Heterogeneous Thermostatically Controlled Loads for Demand Flexibility.

Bingqing Chen, Jonathan Francis, Marco Pritoni, Soummya Kar, Mario Bergés

Proceedings of the BuildSys '20: The 7th ACM International Conference on Systems for Energy-Efficient Buildings, 2020

Leveraging Fine-Grained Occupancy Estimation Patterns for Effective HVAC Control.

Yukun Yuan, Kin Sum Liu, Sirajum Munir, Jonathan Francis, Charles Shelton, Shan Lin

Proceedings of the Fifth IEEE/ACM International Conference on Internet-of-Things Design and Implementation, 2020

Diverse and Admissible Trajectory Forecasting Through Multimodal Context Understanding.

Seong Hyeon Park, Gyubok Lee, Jimin Seo, Manoj Bhat, Minseok Kang, Jonathan Francis, Ashwin R. Jadhav, Paul Pu Liang, Louis-Philippe Morency

Proceedings of the Computer Vision - ECCV 2020, 2020

2019

Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answering.

Kaixin Ma, Jonathan Francis, Quanyang Lu, Eric Nyberg, Alessandro Oltramari

CoRR, 2019

Dataset: Inferring Thermal Comfort using Body Shape Information Utilizing Depth Sensors.

Sirajum Munir, Jonathan Francis, Matias Quintana, Nadine von Frankenberg, Mario Bergés

Proceedings of the 2nd Workshop on Data Acquisition To Analysis, 2019

OccuTherm: Occupant Thermal Comfort Inference using Body Shape Information.

Jonathan Francis, Matias Quintana, Nadine von Frankenberg, Sirajum Munir, Mario Bergés

Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, 2019

2018

Data-driven Thermal Model Inference with ARMAX, in Smart Environments, based on Normalized Mutual Information.

Zhanhong Jiang, Jonathan Francis, Anit Kumar Sahu, Sirajum Munir, Charles Shelton, Anthony Rowe, Mario Berges

Proceedings of the 2018 Annual American Control Conference, 2018

Towards Knowledge Oriented Intelligent Audio Analytics.

Alessandro Oltramari, Joseph Szurley, Samarjit Das, Jonathan Francis, Juncheng Li

Proceedings of the Workshops of the The Thirty-Second AAAI Conference on Artificial Intelligence, 2018

2017

How Would You Say It? Eliciting Lexically Diverse Dialogue for Supervised Semantic Parsing.

Abhilasha Ravichander, Thomas Manzini, Matthias Grabmair, Graham Neubig, Jonathan Francis, Eric Nyberg

Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue, 2017

FORK: fine grained occupancy estimatoR using kinect on ARM embedded platforms.

Sirajum Munir, Le Tran, Jonathan Francis, Charles Shelton, Ripudaman Singh Arora, Craig Hesling, Matias Quintana, Anand Krishnan Prakash, Anthony Rowe, Mario Berges

Proceedings of the 4th ACM International Conference on Systems for Energy-Efficient Built Environments, 2017

COD: a dataset of commercial building occupancy traces.

Kin Sum Liu, Elvin Vindel Pinto, Sirajum Munir, Jonathan Francis, Charles Shelton, Mario Berges, Shan Lin

Proceedings of the 4th ACM International Conference on Systems for Energy-Efficient Built Environments, 2017

Real-Time Fine Grained Occupancy Estimation Using Depth Sensors on ARM Embedded Platforms.

Sirajum Munir, Ripudaman Singh Arora, Craig Hesling, Juncheng Li, Jonathan Francis, Charles Shelton, Christopher Martin, Anthony Rowe, Mario Berges

Proceedings of the 2017 IEEE Real-Time and Embedded Technology and Applications Symposium, 2017

Long term occupancy estimation in a commercial space: an empirical study: poster abstract.

Kin Sum Liu, Sirajum Munir, Jonathan Francis, Charles Shelton, Shan Lin

Proceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks, 2017

Context Intelligence in Pervasive Environments: Poster Abstract.

Jonathan Francis, Alessandro Oltramari, Sirajum Munir, Charles Shelton, Anthony Rowe

Proceedings of the Second International Conference on Internet-of-Things Design and Implementation, 2017

2014

Computational Modelling of the Structural Integrity following Mass-Loss in Polymeric Charred Cellular Solids.

Justin P. M. Whitty, Jonathan Francis, Joe M. Howe, Brian Henderson

J. Comput. Eng., 2014

2013

MetaBot: Automated and dynamically schedulable robotic behaviors in retail environments.

Jonathan Francis, Utsav Drolia, Kunal Mankodiya, Rolando Martins, Rajeev Gandhi, Priya Narasimhan

Proceedings of the IEEE International Symposium on Robotic and Sensors Environments, 2013

Interactive Shopping Experience through Immersive Store Environments.

Kunal Mankodiya, Rolando Martins, Jonathan Francis, Elmer Garduño, Rajeev Gandhi, Priya Narasimhan

Proceedings of the Design, User Experience, and Usability. User Experience in Novel Technological Environments, 2013

2010

Advanced vehicular sensor system.

Javad Yazdani, Trevor Holden, Jonathan Francis

Proceedings of the International Conference on Ultra Modern Telecommunications, 2010