Yuke Zhu

According to our database, Yuke Zhu authored at least 126 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Interpretable machine learning model for predicting acute kidney injury in critically ill patients.

Xunliang Li, Peng Wang, Yuke Zhu, Wenman Zhao, Haifeng Pan, Deguang Wang

BMC Medical Informatics Decis. Mak., December, 2024

An AI-Aided Algorithm for Multivariate Polynomial Reconstruction on Cartesian Grids and the PLG Finite Difference Method.

Qinghai Zhang, Yuke Zhu, Zhixuan Li

J. Sci. Comput., December, 2024

PRIME: Scaffolding Manipulation Tasks With Behavior Primitives for Data-Efficient Imitation Learning.

Tian Gao, Soroush Nasiriany, Huihan Liu, Quantao Yang, Yuke Zhu

IEEE Robotics Autom. Lett., October, 2024

Voyager: An Open-Ended Embodied Agent with Large Language Models.

Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, Anima Anandkumar

Trans. Mach. Learn. Res., 2024

Granger Causal Interaction Skill Chains.

Caleb Chuck, Kevin Black, Aditya Arjun, Yuke Zhu, Scott Niekum

Trans. Mach. Learn. Res., 2024

Action-conditional implicit visual dynamics for deformable object manipulation.

Bokui Shen, Zhenyu Jiang, Christopher Bongsoo Choy, Silvio Savarese, Leonidas J. Guibas, Anima Anandkumar, Yuke Zhu

Int. J. Robotics Res., 2024

KinScene: Model-Based Mobile Manipulation of Articulated Scenes.

Cheng-Chun Hsu, Ben Abbatematteo, Zhenyu Jiang, Yuke Zhu, Roberto Martín-Martín, Joydeep Biswas

CoRR, 2024

PRESTO: Fast motion planning using diffusion models based on key-configuration environment representation.

Mingyo Seo, Yoonyoung Cho, Yoonchang Sung, Peter Stone, Yuke Zhu, Beomjoon Kim

CoRR, 2024

LongVILA: Scaling Long-Context Visual Language Models for Long Videos.

Fuzhao Xue, Yukang Chen, Dacheng Li, Qinghao Hu, Ligeng Zhu, Xiuyu Li, Yunhao Fang, Haotian Tang, Shang Yang, Zhijian Liu, Ethan He, Hongxu Yin, Pavlo Molchanov, Jan Kautz, Linxi Fan, Yuke Zhu, Yao Lu, Song Han

CoRR, 2024

ARDuP: Active Region Video Diffusion for Universal Policies.

Shuaiyi Huang, Mara Levy, Zhenyu Jiang, Anima Anandkumar, Yuke Zhu, Linxi Fan, De-An Huang, Abhinav Shrivastava

CoRR, 2024

RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots.

Soroush Nasiriany, Abhiram Maddukuri, Lance Zhang, Adeet Parikh, Aaron Lo, Abhishek Joshi, Ajay Mandlekar, Yuke Zhu

CoRR, 2024

DrEureka: Language Model Guided Sim-To-Real Transfer.

Yecheng Jason Ma, William Liang, Hung-Ju Wang, Sam Wang, Yuke Zhu, Linxi Fan, Osbert Bastani, Dinesh Jayaraman

CoRR, 2024

Vision-based Manipulation from Single Human Video with Open-World Object Graphs.

Yifeng Zhu, Arisrei Lim, Peter Stone, Yuke Zhu

CoRR, 2024

InterPreT: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning.

Muzhi Han, Yifeng Zhu, Song-Chun Zhu, Ying Nian Wu, Yuke Zhu

CoRR, 2024

LOTUS: Continual Imitation Learning for Robot Manipulation Through Unsupervised Skill Discovery.

Weikang Wan, Yifeng Zhu, Rutav Shah, Yuke Zhu

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration.

Abby O'Neill, Abdul Rehman, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, Ajinkya Jain, Albert Tung, Alex Bewley, Alexander Herzog, Alex Irpan, Alexander Khazatsky, Anant Rai, Anchit Gupta, Andrew Wang, Anikait Singh, Animesh Garg, Aniruddha Kembhavi, Annie Xie, Anthony Brohan, Antonin Raffin, Archit Sharma, Arefeh Yavary, Arhan Jain, Ashwin Balakrishna, Ayzaan Wahid, Ben Burgess-Limerick, Beomjoon Kim, Bernhard Schölkopf, Blake Wulfe, Brian Ichter, Cewu Lu, Charles Xu, Charlotte Le, Chelsea Finn, Chen Wang, Chenfeng Xu, Cheng Chi, Chenguang Huang, Christine Chan, Christopher Agia, Chuer Pan, Chuyuan Fu, Coline Devin, Danfei Xu, Daniel Morton, Danny Driess, Daphne Chen, Deepak Pathak, Dhruv Shah, Dieter Büchler, Dinesh Jayaraman, Dmitry Kalashnikov, Dorsa Sadigh, Edward Johns, Ethan Paul Foster, Fangchen Liu, Federico Ceola, Fei Xia, Feiyu Zhao, Freek Stulp, Gaoyue Zhou, Gaurav S. Sukhatme, Gautam Salhotra, Ge Yan, Gilbert Feng, Giulio Schiavi, Glen Berseth, Gregory Kahn, Guanzhi Wang, Hao Su, Haoshu Fang, Haochen Shi, Henghui Bao, Heni Ben Amor, Henrik I. Christensen, Hiroki Furuta, Homer Walke, Hongjie Fang, Huy Ha, Igor Mordatch, Ilija Radosavovic, Isabel Leal, Jacky Liang, Jad Abou-Chakra, Jaehyung Kim, Jaimyn Drake, Jan Peters, Jan Schneider, Jasmine Hsu, Jeannette Bohg, Jeffrey Bingham, Jeffrey Wu, Jensen Gao, Jiaheng Hu, Jiajun Wu, Jialin Wu, Jiankai Sun, Jianlan Luo, Jiayuan Gu, Jie Tan, Jihoon Oh, Jimmy Wu, Jingpei Lu, Jingyun Yang, Jitendra Malik, João Silvério, Joey Hejna, Jonathan Booher, Jonathan Tompson, Jonathan Yang, Jordi Salvador, Joseph J. Lim, Junhyek Han, Kaiyuan Wang, Kanishka Rao, Karl Pertsch, Karol Hausman, Keegan Go, Keerthana Gopalakrishnan, Ken Goldberg, Kendra Byrne, Kenneth Oslund, Kento Kawaharazuka, Kevin Black, Kevin Lin, Kevin Zhang, Kiana Ehsani, Kiran Lekkala, Kirsty Ellis, Krishan Rana, Krishnan Srinivasan, Kuan Fang, Kunal Pratap Singh, Kuo-Hao Zeng, Kyle Hatch, Kyle Hsu, Laurent Itti, Lawrence Yunliang Chen, Lerrel Pinto, Li Fei-Fei, Liam Tan, Linxi Jim Fan, Lionel Ott, Lisa Lee, Luca Weihs, Magnum Chen, Marion Lepert, Marius Memmel, Masayoshi Tomizuka, Masha Itkina, Mateo Guaman Castro, Max Spero, Maximilian Du, Michael Ahn, Michael C. Yip, Mingtong Zhang, Mingyu Ding, Minho Heo, Mohan Kumar Srirama, Mohit Sharma, Moo Jin Kim, Naoaki Kanazawa, Nicklas Hansen, Nicolas Heess, Nikhil J. Joshi, Niko Sünderhauf, Ning Liu, Norman Di Palo, Nur Muhammad (Mahi) Shafiullah, Oier Mees, Oliver Kroemer, Osbert Bastani, Pannag R. Sanketi, Patrick Tree Miller, Patrick Yin, Paul Wohlhart, Peng Xu, Peter David Fagan, Peter Mitrano, Pierre Sermanet, Pieter Abbeel, Priya Sundaresan, Qiuyu Chen, Quan Vuong, Rafael Rafailov, Ran Tian, Ria Doshi, Roberto Martín-Martín, Rohan Baijal, Rosario Scalise, Rose Hendrix, Roy Lin, Runjia Qian, Ruohan Zhang, Russell Mendonca, Rutav Shah, Ryan Hoque, Ryan Julian, Samuel Bustamante, Sean Kirmani, Sergey Levine, Shan Lin, Sherry Moore, Shikhar Bahl, Shivin Dass, Shubham D. Sonawani, Shuran Song, Sichun Xu, Siddhant Haldar, Siddharth Karamcheti, Simeon Adebola, Simon Guist, Soroush Nasiriany, Stefan Schaal, Stefan Welker, Stephen Tian, Subramanian Ramamoorthy, Sudeep Dasari, Suneel Belkhale, Sungjae Park, Suraj Nair, Suvir Mirchandani, Takayuki Osa, Tanmay Gupta, Tatsuya Harada, Tatsuya Matsushima, Ted Xiao, Thomas Kollar, Tianhe Yu, Tianli Ding, Todor Davchev, Tony Z. Zhao, Travis Armstrong, Trevor Darrell, Trinity Chung, Vidhi Jain, Vincent Vanhoucke, Wei Zhan, Wenxuan Zhou, Wolfram Burgard, Xi Chen, Xiaolong Wang, Xinghao Zhu, Xinyang Geng, Xiyuan Liu, Liangwei Xu, Xuanlin Li, Yao Lu, Yecheng Jason Ma, Yejin Kim, Yevgen Chebotar, Yifan Zhou, Yifeng Zhu, Yilin Wu, Ying Xu, Yixuan Wang, Yonatan Bisk, Yoonyoung Cho, Youngwoon Lee, Yuchen Cui, Yue Cao, Yueh-Hua Wu, Yujin Tang, Yuke Zhu, Yunchu Zhang, Yunfan Jiang, Yunshuang Li, Yunzhu Li, Yusuke Iwasawa, Yutaka Matsuo, Zehan Ma, Zhuo Xu, Zichen Jeff Cui, Zichen Zhang, Zipeng Lin

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Model-Based Runtime Monitoring with Interactive Imitation Learning.

Huihan Liu, Shivin Dass, Roberto Martín-Martín, Yuke Zhu

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Doduo: Learning Dense Visual Correspondence from Unsupervised Semantic-Aware Flow.

Zhenyu Jiang, Hanwen Jiang, Yuke Zhu

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs.

Soroush Nasiriany, Fei Xia, Wenhao Yu, Ted Xiao, Jacky Liang, Ishita Dasgupta, Annie Xie, Danny Driess, Ayzaan Wahid, Zhuo Xu, Quan Vuong, Tingnan Zhang, Tsang-Wei Edward Lee, Kuang-Huei Lee, Peng Xu, Sean Kirmani, Yuke Zhu, Andy Zeng, Karol Hausman, Nicolas Heess, Chelsea Finn, Sergey Levine, Brian Ichter

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Eureka: Human-Level Reward Design via Coding Large Language Models.

Yecheng Jason Ma, William Liang, Guanzhi Wang, De-An Huang, Osbert Bastani, Dinesh Jayaraman, Yuke Zhu, Linxi Fan, Anima Anandkumar

Proceedings of the Twelfth International Conference on Learning Representations, 2024

AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents.

Jake Grigsby, Linxi Fan, Yuke Zhu

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Building Minimal and Reusable Causal State Abstractions for Reinforcement Learning.

Zizhao Wang, Caroline Wang, Xuesu Xiao, Yuke Zhu, Peter Stone

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

Few-View Object Reconstruction with Unknown Categories and Camera Poses.

Hanwen Jiang, Zhenyu Jiang, Kristen Grauman, Yuke Zhu

Proceedings of the International Conference on 3D Vision, 2024

2023

Foundation Models in Robotics: Applications, Challenges, and the Future.

Roya Firoozi, Johnathan Tucker, Stephen Tian, Anirudha Majumdar, Jiankai Sun, Weiyu Liu, Yuke Zhu, Shuran Song, Ashish Kapoor, Karol Hausman, Brian Ichter, Danny Driess, Jiajun Wu, Cewu Lu, Mac Schwager

CoRR, 2023

Edge Wasserstein Distance Loss for Oriented Object Detection.

Yuke Zhu, Yumeng Ruan, Zihua Xiong, Sheng Guo

CoRR, 2023

RotaTR: Detection Transformer for Dense and Rotated Object.

Yuke Zhu, Yumeng Ruan, Lei Yang, Sheng Guo

CoRR, 2023

Interactive Robot Learning from Verbal Correction.

Huihan Liu, Alice Chen, Yuke Zhu, Adith Swaminathan, Andrey Kolobov, Ching-An Cheng

CoRR, 2023

Granger-Causal Hierarchical Skill Discovery.

Caleb Chuck, Kevin Black, Aditya Arjun, Yuke Zhu, Scott Niekum

CoRR, 2023

Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deployment.

Huihan Liu, Soroush Nasiriany, Lance Zhang, Zhiyao Bao, Yuke Zhu

Proceedings of the Robotics: Science and Systems XIX, Daegu, 2023

Cross-Episodic Curriculum for Transformer Agents.

Lucy Xiaoyang Shi, Yunfan Jiang, Jake Grigsby, Linxi Fan, Yuke Zhu

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning.

Bo Liu, Yifeng Zhu, Chongkai Gao, Yihao Feng, Qiang Liu, Yuke Zhu, Peter Stone

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Symbolic State Space Optimization for Long Horizon Mobile Manipulation Planning.

Xiaohan Zhang, Yifeng Zhu, Yan Ding, Yuqian Jiang, Yuke Zhu, Peter Stone, Shiqi Zhang

IROS, 2023

Learning to Walk by Steering: Perceptive Quadrupedal Locomotion in Dynamic Environments.

Mingyo Seo, Ryan Gupta, Yifeng Zhu, Alexy Skoutnev, Luis Sentis, Yuke Zhu

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

Ditto in the House: Building Articulation Models of Indoor Scenes through Interactive Perception.

Cheng-Chun Hsu, Zhenyu Jiang, Yuke Zhu

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

VIMA: Robot Manipulation with Multimodal Prompts.

Yunfan Jiang, Agrim Gupta, Zichen Zhang, Guanzhi Wang, Yongqiang Dou, Yanjun Chen, Li Fei-Fei, Anima Anandkumar, Yuke Zhu, Linxi Fan

Proceedings of the International Conference on Machine Learning, 2023

Deep Imitation Learning for Humanoid Loco-manipulation Through Human Teleoperation.

Mingyo Seo, Steve Han, Kyutae Sim, SeungHyeon Bang, Carlos Gonzalez, Luis Sentis, Yuke Zhu

Proceedings of the 22nd IEEE-RAS International Conference on Humanoid Robots, 2023

Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning.

Zhuolin Yang, Wei Ping, Zihan Liu, Vijay Korthikanti, Weili Nie, De-An Huang, Linxi Fan, Zhiding Yu, Shiyi Lan, Bo Li, Mohammad Shoeybi, Ming-Yu Liu, Yuke Zhu, Bryan Catanzaro, Chaowei Xiao, Anima Anandkumar

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids.

Wei Dong, Christopher B. Choy, Charles Loop, Or Litany, Yuke Zhu, Anima Anandkumar

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Learning Generalizable Manipulation Policies with Object-Centric 3D Representations.

Yifeng Zhu, Zhenyu Jiang, Peter Stone, Yuke Zhu

Proceedings of the Conference on Robot Learning, 2023

MimicPlay: Long-Horizon Imitation Learning by Watching Human Play.

Chen Wang, Linxi Fan, Jiankai Sun, Ruohan Zhang, Li Fei-Fei, Danfei Xu, Yuke Zhu, Anima Anandkumar

Proceedings of the Conference on Robot Learning, 2023

MUTEX: Learning Unified Policies from Multimodal Task Specifications.

Rutav Shah, Roberto Martín-Martín, Yuke Zhu

Proceedings of the Conference on Robot Learning, 2023

MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations.

Ajay Mandlekar, Soroush Nasiriany, Bowen Wen, Iretiayo Akinola, Yashraj S. Narang, Linxi Fan, Yuke Zhu, Dieter Fox

Proceedings of the Conference on Robot Learning, 2023

Building Compositional Robot Autonomy with Modularity and Abstraction.

Yuke Zhu

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Bottom-Up Skill Discovery From Unsegmented Demonstrations for Long-Horizon Robot Manipulation.

Yifeng Zhu, Peter Stone, Yuke Zhu

IEEE Robotics Autom. Lett., 2022

VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors.

Yifeng Zhu, Abhishek Joshi, Peter Stone, Yuke Zhu

CoRR, 2022

VIMA: General Robot Manipulation with Multimodal Prompts.

Yunfan Jiang, Agrim Gupta, Zichen Zhang, Guanzhi Wang, Yongqiang Dou, Yanjun Chen, Li Fei-Fei, Anima Anandkumar, Yuke Zhu, Linxi Fan

CoRR, 2022

ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation.

Bokui Shen, Zhenyu Jiang, Christopher B. Choy, Silvio Savarese, Leonidas J. Guibas, Anima Anandkumar, Yuke Zhu

Proceedings of the Robotics: Science and Systems XVIII, New York City, NY, USA, June 27, 2022

Pre-Trained Language Models for Interactive Decision-Making.

Shuang Li, Xavier Puig, Chris Paxton, Yilun Du, Clinton Wang, Linxi Fan, Tao Chen, De-An Huang, Ekin Akyürek, Anima Anandkumar, Jacob Andreas, Igor Mordatch, Antonio Torralba, Yuke Zhu

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge.

Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Visually Grounded Task and Motion Planning for Mobile Manipulation.

Xiaohan Zhang, Yifeng Zhu, Yan Ding, Yuke Zhu, Peter Stone, Shiqi Zhang

Proceedings of the 2022 International Conference on Robotics and Automation, 2022

OSCAR: Data-Driven Operational Space Control for Adaptive and Robust Robot Manipulation.

Josiah Wong, Viktor Makoviychuk, Anima Anandkumar, Yuke Zhu

Proceedings of the 2022 International Conference on Robotics and Automation, 2022

Augmenting Reinforcement Learning with Behavior Primitives for Diverse Manipulation Tasks.

Soroush Nasiriany, Huihan Liu, Yuke Zhu

Proceedings of the 2022 International Conference on Robotics and Automation, 2022

Causal Dynamics Learning for Task-Independent State Abstraction.

Zizhao Wang, Xuesu Xiao, Zifan Xu, Yuke Zhu, Peter Stone

Proceedings of the International Conference on Machine Learning, 2022

RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning.

Xiaojian Ma, Weili Nie, Zhiding Yu, Huaizu Jiang, Chaowei Xiao, Yuke Zhu, Song-Chun Zhu, Anima Anandkumar

Proceedings of the Tenth International Conference on Learning Representations, 2022

Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions.

Huaizu Jiang, Xiaojian Ma, Weili Nie, Zhiding Yu, Yuke Zhu, Anima Anandkumar

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Coopernaut: End-to-End Driving with Cooperative Perception for Networked Vehicles.

Jiaxun Cui, Hang Qiu, Dian Chen, Peter Stone, Yuke Zhu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Ditto: Building Digital Twins of Articulated Objects from Interaction.

Zhenyu Jiang, Cheng-Chun Hsu, Yuke Zhu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

VIOLA: Object-Centric Imitation Learning for Vision-Based Robot Manipulation.

Yifeng Zhu, Abhishek Joshi, Peter Stone, Yuke Zhu

Proceedings of the Conference on Robot Learning, 2022

Learning and Retrieval from Prior Data for Skill-based Imitation Learning.

Soroush Nasiriany, Tian Gao, Ajay Mandlekar, Yuke Zhu

Proceedings of the Conference on Robot Learning, 2022

1st Place Solution for FungiCLEF 2022 Competition: Fine-grained Open-set Fungi Recognition.

Zihua Xiong, Yumeng Ruan, Yifei Hu, Yue Zhang, Yuke Zhu, Sheng Guo, Bing Han

Proceedings of the Working Notes of CLEF 2022 - Conference and Labs of the Evaluation Forum, Bologna, Italy, September 5th - to, 2022

2021

Reinforcement Learning in Factored Action Spaces using Tensor Decompositions.

Anuj Mahajan, Mikayel Samvelyan, Lei Mao, Viktor Makoviychuk, Animesh Garg, Jean Kossaifi, Shimon Whiteson, Yuke Zhu, Animashree Anandkumar

CoRR, 2021

Discovering Generalizable Skills via Automated Generation of Diverse Tasks.

Kuan Fang, Yuke Zhu, Silvio Savarese, Li Fei-Fei

Proceedings of the Robotics: Science and Systems XVII, Virtual Event, July 12-16, 2021., 2021

Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations.

Zhenyu Jiang, Yifeng Zhu, Maxwell Svetlik, Kuan Fang, Yuke Zhu

Proceedings of the Robotics: Science and Systems XVII, Virtual Event, July 12-16, 2021., 2021

MultiBench: Multiscale Benchmarks for Multimodal Representation Learning.

Paul Pu Liang, Yiwei Lyu, Xiang Fan, Zetian Wu, Yun Cheng, Jason Wu, Leslie Chen, Peter Wu, Michelle A. Lee, Yuke Zhu, Ruslan Salakhutdinov, Louis-Philippe Morency

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphs.

Yifeng Zhu, Jonathan Tremblay, Stan Birchfield, Yuke Zhu

Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Deep Affordance Foresight: Planning Through What Can Be Done in the Future.

Danfei Xu, Ajay Mandlekar, Roberto Martín-Martín, Yuke Zhu, Silvio Savarese, Li Fei-Fei

Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Learning Multi-Arm Manipulation Through Collaborative Teleoperation.

Albert Tung, Josiah Wong, Ajay Mandlekar, Roberto Martín-Martín, Yuke Zhu, Li Fei-Fei, Silvio Savarese

Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Fast Uncertainty Quantification for Deep Object Pose Estimation.

Guanya Shi, Yifeng Zhu, Jonathan Tremblay, Stan Birchfield, Fabio Ramos, Animashree Anandkumar, Yuke Zhu

Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Emergent Hand Morphology and Control from Optimizing Robust Grasps of Diverse Objects.

Xinlei Pan, Animesh Garg, Animashree Anandkumar, Yuke Zhu

Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Detect, Reject, Correct: Crossmodal Compensation of Corrupted Sensors.

Michelle A. Lee, Matthew Tan, Yuke Zhu, Jeannette Bohg

Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Tesseract: Tensorised Actors for Multi-Agent Reinforcement Learning.

Anuj Mahajan, Mikayel Samvelyan, Lei Mao, Viktor Makoviychuk, Animesh Garg, Jean Kossaifi, Shimon Whiteson, Yuke Zhu, Animashree Anandkumar

Proceedings of the 38th International Conference on Machine Learning, 2021

Coach-Player Multi-agent Reinforcement Learning for Dynamic Team Composition.

Bo Liu, Qiang Liu, Peter Stone, Animesh Garg, Yuke Zhu, Anima Anandkumar

Proceedings of the 38th International Conference on Machine Learning, 2021

SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies.

Linxi Fan, Guanzhi Wang, De-An Huang, Zhiding Yu, Li Fei-Fei, Yuke Zhu, Animashree Anandkumar

Proceedings of the 38th International Conference on Machine Learning, 2021

Adaptive Procedural Task Generation for Hard-Exploration Problems.

Kuan Fang, Yuke Zhu, Silvio Savarese, Li Fei-Fei

Proceedings of the 9th International Conference on Learning Representations, 2021

DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision.

Shiyi Lan, Zhiding Yu, Christopher B. Choy, Subhashree Radhakrishnan, Guilin Liu, Yuke Zhu, Larry S. Davis, Anima Anandkumar

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Dynamic Metric Learning: Towards a Scalable Metric Space To Accommodate Multiple Semantic Scales.

Yifan Sun, Yuke Zhu, Yuhan Zhang, Pengkun Zheng, Xi Qiu, Chi Zhang, Yichen Wei

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

What Matters in Learning from Offline Human Demonstrations for Robot Manipulation.

Ajay Mandlekar, Danfei Xu, Josiah Wong, Soroush Nasiriany, Chen Wang, Rohun Kulkarni, Li Fei-Fei, Silvio Savarese, Yuke Zhu, Roberto Martín-Martín

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularization.

Youngwoon Lee, Joseph J. Lim, Anima Anandkumar, Yuke Zhu

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

2020

Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks.

Michelle A. Lee, Yuke Zhu, Peter Zachares, Matthew Tan, Krishnan Srinivasan, Silvio Savarese, Li Fei-Fei, Animesh Garg, Jeannette Bohg

IEEE Trans. Robotics, 2020

Learning task-oriented grasping for tool manipulation from simulated self-supervision.

Kuan Fang, Yuke Zhu, Animesh Garg, Andrey Kurenkov, Viraj Mehta, Li Fei-Fei, Silvio Savarese

Int. J. Robotics Res., 2020

Human-in-the-Loop Imitation Learning using Remote Teleoperation.

Ajay Mandlekar, Danfei Xu, Roberto Martín-Martín, Yuke Zhu, Li Fei-Fei, Silvio Savarese

CoRR, 2020

robosuite: A Modular Simulation Framework and Benchmark for Robot Learning.

Yuke Zhu, Josiah Wong, Ajay Mandlekar, Roberto Martín-Martín

CoRR, 2020

OCEAN: Online Task Inference for Compositional Tasks with Context Adaptation.

Hongyu Ren, Yuke Zhu, Jure Leskovec, Animashree Anandkumar, Animesh Garg

Proceedings of the Thirty-Sixth Conference on Uncertainty in Artificial Intelligence, 2020

Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning.

Weili Nie, Zhiding Yu, Lei Mao, Ankit B. Patel, Yuke Zhu, Anima Anandkumar

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPs.

Yunbo Wang, Bo Liu, Jiajun Wu, Yuke Zhu, Simon S. Du, Li Fei-Fei, Joshua B. Tenenbaum

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, 2020

6-PACK: Category-level 6D Pose Tracker with Anchor-Based Keypoints.

Chen Wang, Roberto Martín-Martín, Danfei Xu, Jun Lv, Cewu Lu, Li Fei-Fei, Silvio Savarese, Yuke Zhu

Proceedings of the 2020 IEEE International Conference on Robotics and Automation, 2020

KETO: Learning Keypoint Representations for Tool Manipulation.

Zengyi Qin, Kuan Fang, Yuke Zhu, Li Fei-Fei, Silvio Savarese

Proceedings of the 2020 IEEE International Conference on Robotics and Automation, 2020

Spherical Feature Transform for Deep Metric Learning.

Yuke Zhu, Yan Bai, Yichen Wei

Proceedings of the Computer Vision - ECCV 2020, 2020

RubiksNet: Learnable 3D-Shift for Efficient Video Action Recognition.

Linxi Fan, Shyamal Buch, Guanzhi Wang, Ryan Cao, Yuke Zhu, Juan Carlos Niebles, Li Fei-Fei

Proceedings of the Computer Vision - ECCV 2020, 2020

Learning a Contact-Adaptive Controller for Robust, Efficient Legged Locomotion.

Xingye Da, Zhaoming Xie, David Hoeller, Byron Boots, Anima Anandkumar, Yuke Zhu, Buck Babich, Animesh Garg

Proceedings of the 4th Conference on Robot Learning, 2020

2019

Closing the perception-action loop: towards general-purpose robot autonomy.

Yuke Zhu

PhD thesis, 2019

Causal Induction from Visual Observations for Goal Directed Tasks.

Suraj Nair, Yuke Zhu, Silvio Savarese, Li Fei-Fei

CoRR, 2019

Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs.

Yunbo Wang, Bo Liu, Jiajun Wu, Yuke Zhu, Simon S. Du, Li Fei-Fei, Joshua B. Tenenbaum

CoRR, 2019

SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning.

Linxi Fan, Yuke Zhu, Jiren Zhu, Zihua Liu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei

CoRR, 2019

Regression Planning Networks.

Danfei Xu, Roberto Martín-Martín, De-An Huang, Yuke Zhu, Silvio Savarese, Li Fei-Fei

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Scaling Robot Supervision to Hundreds of Hours with RoboTurk: Robotic Manipulation Dataset through Human Reasoning and Dexterity.

Ajay Mandlekar, Jonathan Booher, Max Spero, Albert Tung, Anchit Gupta, Yuke Zhu, Animesh Garg, Silvio Savarese, Li Fei-Fei

Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019

Continuous Relaxation of Symbolic Planner for One-Shot Imitation Learning.

De-An Huang, Danfei Xu, Yuke Zhu, Animesh Garg, Silvio Savarese, Li Fei-Fei, Juan Carlos Niebles

Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2019

Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks.

Michelle A. Lee, Yuke Zhu, Krishnan Srinivasan, Parth Shah, Silvio Savarese, Li Fei-Fei, Animesh Garg, Jeannette Bohg

Proceedings of the International Conference on Robotics and Automation, 2019

Situational Fusion of Visual Representation for Visual Navigation.

William B. Shen, Danfei Xu, Yuke Zhu, Li Fei-Fei, Leonidas J. Guibas, Silvio Savarese

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion.

Chen Wang, Danfei Xu, Yuke Zhu, Roberto Martin Martin, Cewu Lu, Li Fei-Fei, Silvio Savarese

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Neural Task Graphs: Generalizing to Unseen Tasks From a Single Video Demonstration.

De-An Huang, Suraj Nair, Danfei Xu, Yuke Zhu, Animesh Garg, Li Fei-Fei, Silvio Savarese, Juan Carlos Niebles

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Dynamics Learning with Cascaded Variational Inference for Multi-Step Manipulation.

Kuan Fang, Yuke Zhu, Animesh Garg, Silvio Savarese, Li Fei-Fei

Proceedings of the 3rd Annual Conference on Robot Learning, 2019

2018

Reinforcement and Imitation Learning for Diverse Visuomotor Skills.

Yuke Zhu, Ziyu Wang, Josh Merel, Andrei A. Rusu, Tom Erez, Serkan Cabi, Saran Tunyasuvunakool, János Kramár, Raia Hadsell, Nando de Freitas, Nicolas Heess

Proceedings of the Robotics: Science and Systems XIV, 2018

Neural Task Programming: Learning to Generalize Across Hierarchical Tasks.

Danfei Xu, Suraj Nair, Yuke Zhu, Julian Gao, Animesh Garg, Li Fei-Fei, Silvio Savarese

Proceedings of the 2018 IEEE International Conference on Robotics and Automation, 2018

Point Pair Features Based Object Recognition with Improved Training Pipeline.

Yuke Zhu, Xu Zhang, Limin Zhu, Yongkai Cai

Proceedings of the Intelligent Robotics and Applications - 11th International Conference, 2018

Digital Template System for Measuring Turbine Blade Forging and Its Calibration Method.

Yongkai Cai, Xu Zhang, Zelong Zheng, Limin Zhu, Yuke Zhu

Proceedings of the Intelligent Robotics and Applications - 11th International Conference, 2018

ROBOTURK: A Crowdsourcing Platform for Robotic Skill Learning through Imitation.

Ajay Mandlekar, Yuke Zhu, Animesh Garg, Jonathan Booher, Max Spero, Albert Tung, Julian Gao, John Emmons, Anchit Gupta, Emre Orbay, Silvio Savarese, Li Fei-Fei

Proceedings of the 2nd Annual Conference on Robot Learning, 2018

SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark.

Linxi Fan, Yuke Zhu, Jiren Zhu, Zihua Liu, Orien Zeng, Anchit Gupta, Joan Creus-Costa, Silvio Savarese, Li Fei-Fei

Proceedings of the 2nd Annual Conference on Robot Learning, 2018

2017

Vicus: Exploiting local structures to improve network-based analysis of biological data.

Bo Wang, Lin Huang, Yuke Zhu, Anshul Kundaje, Serafim Batzoglou, Anna Goldenberg

PLoS Comput. Biol., 2017

Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations.

Ranjay Krishna, Yuke Zhu, Oliver Groth, Justin Johnson, Kenji Hata, Joshua Kravitz, Stephanie Chen, Yannis Kalantidis, Li-Jia Li, David A. Shamma, Michael S. Bernstein, Li Fei-Fei

Int. J. Comput. Vis., 2017

AI2-THOR: An Interactive 3D Environment for Visual AI.

Eric Kolve, Roozbeh Mottaghi, Daniel Gordon, Yuke Zhu, Abhinav Gupta, Ali Farhadi

CoRR, 2017

AdaPT: Zero-Shot Adaptive Policy Transfer for Stochastic Dynamical Systems.

James Harrison, Animesh Garg, Boris Ivanovic, Yuke Zhu, Silvio Savarese, Li Fei-Fei, Marco Pavone

Proceedings of the Robotics Research, The 18th International Symposium, 2017

Adversarially Robust Policy Learning: Active construction of physically-plausible perturbations.

Ajay Mandlekar, Yuke Zhu, Animesh Garg, Li Fei-Fei, Silvio Savarese

Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2017

Target-driven visual navigation in indoor scenes using deep reinforcement learning.

Yuke Zhu, Roozbeh Mottaghi, Eric Kolve, Joseph J. Lim, Abhinav Gupta, Li Fei-Fei, Ali Farhadi

Proceedings of the 2017 IEEE International Conference on Robotics and Automation, 2017

Visual Semantic Planning Using Deep Successor Representations.

Yuke Zhu, Daniel Gordon, Eric Kolve, Dieter Fox, Li Fei-Fei, Abhinav Gupta, Roozbeh Mottaghi, Ali Farhadi

Proceedings of the IEEE International Conference on Computer Vision, 2017

Knowledge Acquisition for Visual Question Answering via Iterative Querying.

Yuke Zhu, Joseph J. Lim, Li Fei-Fei

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

Scene Graph Generation by Iterative Message Passing.

Danfei Xu, Yuke Zhu, Christopher B. Choy, Li Fei-Fei

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

2016

Visual7W: Grounded Question Answering in Images.

Yuke Zhu, Oliver Groth, Michael S. Bernstein, Li Fei-Fei

Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, 2016

2015

Building a Large-scale Multimodal Knowledge Base for Visual Question Answering.

Yuke Zhu, Ce Zhang, Christopher Ré, Li Fei-Fei

CoRR, 2015

Action Recognition by Hierarchical Mid-Level Action Elements.

Tian Lan, Yuke Zhu, Amir Roshan Zamir, Silvio Savarese

Proceedings of the 2015 IEEE International Conference on Computer Vision, 2015

2014

Modelling relational statistics with Bayes Nets.

Oliver Schulte, Hassan Khosravi, Arthur E. Kirkpatrick, Tianxiang Gao, Yuke Zhu

Mach. Learn., 2014

Reasoning about Object Affordances in a Knowledge Base Representation.

Yuke Zhu, Alireza Fathi, Li Fei-Fei

Proceedings of the Computer Vision - ECCV 2014, 2014

StrokeBank: Automating Personalized Chinese Handwriting Generation.

Alfred Zong, Yuke Zhu

Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, 2014

2013

Latent Spatio-temporal Models for Action Localization and Recognition in Nursing Home Surveillance Video.

Yuke Zhu, Tian Lan, Yijian Yang, Steve Robinovitch, Greg Mori

Proceedings of the 13. IAPR International Conference on Machine Vision Applications, 2013

Graphical Model-Based Learning in High Dimensional Feature Spaces.

Zhao Song, Yuke Zhu

Proceedings of the Twenty-Seventh AAAI Conference on Artificial Intelligence, 2013

2012

Random Regression for Bayes Nets Applied to Relational Data.

Oliver Schulte, Hassan Khosravi, Tianxiang Gao, Yuke Zhu

Proceedings of the 2nd International Workshop on Statistical Relational AI (StaRAI-12), 2012