Jiafei Duan

According to our database, Jiafei Duan authored at least 26 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

SAT: Spatial Aptitude Training for Multimodal Language Models.

Arijit Ray, Jiafei Duan, Reuben Tan, Dina Bashkirova, Rose Hendrix, Kiana Ehsani, Aniruddha Kembhavi, Bryan A. Plummer, Ranjay Krishna, Kuo-Hao Zeng, Kate Saenko

CoRR, 2024

AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulation.

Jiafei Duan, Wilbert Pumacay, Nishanth Kumar, Yi Ru Wang, Shulin Tian, Wentao Yuan, Ranjay Krishna, Dieter Fox, Ajay Mandlekar, Yijie Guo

CoRR, 2024

Manipulate-Anything: Automating Real-World Robots using Vision-Language Models.

Jiafei Duan, Wentao Yuan, Wilbert Pumacay, Yi Ru Wang, Kiana Ehsani, Dieter Fox, Ranjay Krishna

CoRR, 2024

RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics.

Wentao Yuan, Jiafei Duan, Valts Blukis, Wilbert Pumacay, Ranjay Krishna, Adithyavairavan Murali, Arsalan Mousavian, Dieter Fox

CoRR, 2024

EVE: Enabling Anyone to Train Robot using Augmented Reality.

Jun Wang, Chun-Cheng Chang, Jiafei Duan, Dieter Fox, Ranjay Krishna

CoRR, 2024

EVE: Enabling Anyone to Train Robots using Augmented Reality.

Jun Wang, Chun-Cheng Chang, Jiafei Duan, Dieter Fox, Ranjay Krishna

Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, 2024

THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulation.

Wilbert Pumacay, Ishika Singh, Jiafei Duan, Ranjay Krishna, Jesse Thomason, Dieter Fox

Proceedings of the Robotics: Science and Systems XX, 2024

Octopi: Object Property Reasoning with Large Tactile-Language Models.

Samson Yu, Kelvin Lin, Anxing Xiao, Jiafei Duan, Harold Soh

Proceedings of the Robotics: Science and Systems XX, 2024

Selective Visual Representations Improve Convergence and Generalization for Embodied AI.

Ainaz Eftekhar, Kuo-Hao Zeng, Jiafei Duan, Ali Farhadi, Aniruddha Kembhavi, Ranjay Krishna

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Read My Mind: A Multi-Modal Dataset for Human Belief Prediction.

Jiafei Duan, Samson Yu, Nicholas Tan, Yi Ru Wang, Cheston Tan

CoRR, 2023

Robustness of Utilizing Feedback in Embodied Visual Navigation.

Jenny Zhang, Samson Yu, Jiafei Duan, Cheston Tan

CoRR, 2023

A Study of Comfortability between Interactive AI and Human.

Yi Ru Wang, Jiafei Duan, Sidharth Talia, Hao Zhu

CoRR, 2023

NEWTON: Are Large Language Models Capable of Physical Reasoning?

Yi Ru Wang, Jiafei Duan, Dieter Fox, Siddhartha S. Srinivasa

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

AR2-D2: Training a Robot Without a Robot.

Jiafei Duan, Yi Ru Wang, Mohit Shridhar, Dieter Fox, Ranjay Krishna

Proceedings of the Conference on Robot Learning, 2023

A Benchmark for Modeling Violation-of-Expectation in Physical Reasoning Across Event Categories.

Arijit Dasgupta, Jiafei Duan, Yi Lin, Su-Hua Wang, Renée Baillargeon, Cheston Tan

Proceedings of the 45th Annual Meeting of the Cognitive Science Society, 2023

2022

A Survey of Embodied AI: From Simulators to Research Tasks.

Jiafei Duan, Samson Yu, Hui Li Tan, Hongyuan Zhu, Cheston Tan

IEEE Trans. Emerg. Top. Comput. Intell., 2022

BOSS: A Benchmark for Human Belief Prediction in Object-context Scenarios.

Jiafei Duan, Samson Yu, Nicholas Tan, Li Yi, Cheston Tan

CoRR, 2022

Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation.

Jenny Zhang, Samson Yu, Jiafei Duan, Cheston Tan

CoRR, 2022

ABCDE: An Agent-Based Cognitive Development Environment.

Jieyi Ye, Jiafei Duan, Samson Yu, Bihan Wen, Cheston Tan

CoRR, 2022

A Survey on Machine Learning Approaches for Modelling Intuitive Physics.

Jiafei Duan, Arijit Dasgupta, Jason Fischer, Cheston Tan

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, 2022

PIP: Physical Interaction Prediction via Mental Simulation with Span Selection.

Jiafei Duan, Samson Yu, Soujanya Poria, Bihan Wen, Cheston Tan

Proceedings of the Computer Vision - ECCV 2022, 2022

2021

A Benchmark for Modeling Violation-of-Expectation in Physical Reasoning Across Event Categories.

Arijit Dasgupta, Jiafei Duan, Marcelo H. Ang Jr., Yi Lin, Su-Hua Wang, Renée Baillargeon, Cheston Tan

CoRR, 2021

AVoE: A Synthetic 3D Dataset on Understanding Violation of Expectation for Artificial Cognition.

Arijit Dasgupta, Jiafei Duan, Marcelo H. Ang Jr., Cheston Tan

CoRR, 2021

PIP: Physical Interaction Prediction via Mental Imagery with Span Selection.

Jiafei Duan, Samson Yu, Soujanya Poria, Bihan Wen, Cheston Tan

CoRR, 2021

SPACE: A Simulator for Physical Interactions and Causal Learning in 3D Environments.

Jiafei Duan, Samson Yu Bai Jian, Cheston Tan

Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, 2021

2020

Actionet: An Interactive End-To-End Platform For Task-Based Data Collection And Augmentation In 3D Environment.

Jiafei Duan, Samson Yu, Hui Li Tan, Cheston Tan

Proceedings of the IEEE International Conference on Image Processing, 2020