Joseph J. Lim

According to our database, Joseph J. Lim authored at least 63 papers between 2007 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

EXTRACT: Efficient Policy Learning by Extracting Transferrable Robot Skills from Offline Data.

Jesse Zhang, Minho Heo, Zuxin Liu, Erdem Biyik, Joseph J. Lim, Yao Liu, Rasool Fakoor

CoRR, 2024

SPRINT: Scalable Policy Pre-Training via Language Instruction Relabeling.

Jesse Zhang, Karl Pertsch, Jiahui Zhang, Joseph J. Lim

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration.

Abby O'Neill, Abdul Rehman, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, Ajinkya Jain, Albert Tung, Alex Bewley, Alexander Herzog, Alex Irpan, Alexander Khazatsky, Anant Rai, Anchit Gupta, Andrew Wang, Anikait Singh, Animesh Garg, Aniruddha Kembhavi, Annie Xie, Anthony Brohan, Antonin Raffin, Archit Sharma, Arefeh Yavary, Arhan Jain, Ashwin Balakrishna, Ayzaan Wahid, Ben Burgess-Limerick, Beomjoon Kim, Bernhard Schölkopf, Blake Wulfe, Brian Ichter, Cewu Lu, Charles Xu, Charlotte Le, Chelsea Finn, Chen Wang, Chenfeng Xu, Cheng Chi, Chenguang Huang, Christine Chan, Christopher Agia, Chuer Pan, Chuyuan Fu, Coline Devin, Danfei Xu, Daniel Morton, Danny Driess, Daphne Chen, Deepak Pathak, Dhruv Shah, Dieter Büchler, Dinesh Jayaraman, Dmitry Kalashnikov, Dorsa Sadigh, Edward Johns, Ethan Paul Foster, Fangchen Liu, Federico Ceola, Fei Xia, Feiyu Zhao, Freek Stulp, Gaoyue Zhou, Gaurav S. Sukhatme, Gautam Salhotra, Ge Yan, Gilbert Feng, Giulio Schiavi, Glen Berseth, Gregory Kahn, Guanzhi Wang, Hao Su, Haoshu Fang, Haochen Shi, Henghui Bao, Heni Ben Amor, Henrik I. Christensen, Hiroki Furuta, Homer Walke, Hongjie Fang, Huy Ha, Igor Mordatch, Ilija Radosavovic, Isabel Leal, Jacky Liang, Jad Abou-Chakra, Jaehyung Kim, Jaimyn Drake, Jan Peters, Jan Schneider, Jasmine Hsu, Jeannette Bohg, Jeffrey Bingham, Jeffrey Wu, Jensen Gao, Jiaheng Hu, Jiajun Wu, Jialin Wu, Jiankai Sun, Jianlan Luo, Jiayuan Gu, Jie Tan, Jihoon Oh, Jimmy Wu, Jingpei Lu, Jingyun Yang, Jitendra Malik, João Silvério, Joey Hejna, Jonathan Booher, Jonathan Tompson, Jonathan Yang, Jordi Salvador, Joseph J. Lim, Junhyek Han, Kaiyuan Wang, Kanishka Rao, Karl Pertsch, Karol Hausman, Keegan Go, Keerthana Gopalakrishnan, Ken Goldberg, Kendra Byrne, Kenneth Oslund, Kento Kawaharazuka, Kevin Black, Kevin Lin, Kevin Zhang, Kiana Ehsani, Kiran Lekkala, Kirsty Ellis, Krishan Rana, Krishnan Srinivasan, Kuan Fang, Kunal Pratap Singh, Kuo-Hao Zeng, Kyle Hatch, Kyle Hsu, Laurent Itti, Lawrence Yunliang Chen, Lerrel Pinto, Li Fei-Fei, Liam Tan, Linxi Jim Fan, Lionel Ott, Lisa Lee, Luca Weihs, Magnum Chen, Marion Lepert, Marius Memmel, Masayoshi Tomizuka, Masha Itkina, Mateo Guaman Castro, Max Spero, Maximilian Du, Michael Ahn, Michael C. Yip, Mingtong Zhang, Mingyu Ding, Minho Heo, Mohan Kumar Srirama, Mohit Sharma, Moo Jin Kim, Naoaki Kanazawa, Nicklas Hansen, Nicolas Heess, Nikhil J. Joshi, Niko Sünderhauf, Ning Liu, Norman Di Palo, Nur Muhammad (Mahi) Shafiullah, Oier Mees, Oliver Kroemer, Osbert Bastani, Pannag R. Sanketi, Patrick Tree Miller, Patrick Yin, Paul Wohlhart, Peng Xu, Peter David Fagan, Peter Mitrano, Pierre Sermanet, Pieter Abbeel, Priya Sundaresan, Qiuyu Chen, Quan Vuong, Rafael Rafailov, Ran Tian, Ria Doshi, Roberto Martín-Martín, Rohan Baijal, Rosario Scalise, Rose Hendrix, Roy Lin, Runjia Qian, Ruohan Zhang, Russell Mendonca, Rutav Shah, Ryan Hoque, Ryan Julian, Samuel Bustamante, Sean Kirmani, Sergey Levine, Shan Lin, Sherry Moore, Shikhar Bahl, Shivin Dass, Shubham D. Sonawani, Shuran Song, Sichun Xu, Siddhant Haldar, Siddharth Karamcheti, Simeon Adebola, Simon Guist, Soroush Nasiriany, Stefan Schaal, Stefan Welker, Stephen Tian, Subramanian Ramamoorthy, Sudeep Dasari, Suneel Belkhale, Sungjae Park, Suraj Nair, Suvir Mirchandani, Takayuki Osa, Tanmay Gupta, Tatsuya Harada, Tatsuya Matsushima, Ted Xiao, Thomas Kollar, Tianhe Yu, Tianli Ding, Todor Davchev, Tony Z. Zhao, Travis Armstrong, Trevor Darrell, Trinity Chung, Vidhi Jain, Vincent Vanhoucke, Wei Zhan, Wenxuan Zhou, Wolfram Burgard, Xi Chen, Xiaolong Wang, Xinghao Zhu, Xinyang Geng, Xiyuan Liu, Liangwei Xu, Xuanlin Li, Yao Lu, Yecheng Jason Ma, Yejin Kim, Yevgen Chebotar, Yifan Zhou, Yifeng Zhu, Yilin Wu, Ying Xu, Yixuan Wang, Yonatan Bisk, Yoonyoung Cho, Youngwoon Lee, Yuchen Cui, Yue Cao, Yueh-Hua Wu, Yujin Tang, Yuke Zhu, Yunchu Zhang, Yunfan Jiang, Yunshuang Li, Yunzhu Li, Yusuke Iwasawa, Yutaka Matsuo, Zehan Ma, Zhuo Xu, Zichen Jeff Cui, Zichen Zhang, Zipeng Lin

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

2023

LiFT: Unsupervised Reinforcement Learning with Foundation Models as Teachers.

Taewook Nam, Juyong Lee, Jesse Zhang, Sung Ju Hwang, Joseph J. Lim, Karl Pertsch

CoRR, 2023

Hierarchical Neural Program Synthesis.

Linghan Zhong, Ryan Lindeborg, Jesse Zhang, Joseph J. Lim, Shao-Hua Sun

CoRR, 2023

Efficient Multi-Task Reinforcement Learning via Selective Behavior Sharing.

Grace Zhang, Ayush Jain, Injune Hwang, Shao-Hua Sun, Joseph J. Lim

CoRR, 2023

FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation.

Minho Heo, Youngwoon Lee, Doohyun Lee, Joseph J. Lim

Proceedings of the Robotics: Science and Systems XIX, Daegu, 2023

PATO: Policy Assisted TeleOperation for Scalable Robot Data Collection.

Shivin Dass, Karl Pertsch, Hejia Zhang, Youngwoon Lee, Joseph J. Lim, Stefanos Nikolaidis

Proceedings of the Robotics: Science and Systems XIX, Daegu, 2023

Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidance.

Jesse Zhang, Jiahui Zhang, Karl Pertsch, Ziyi Liu, Xiang Ren, Minsuk Chang, Shao-Hua Sun, Joseph J. Lim

Proceedings of the Conference on Robot Learning, 2023

2022

Task-Induced Representation Learning.

Jun Yamada, Karl Pertsch, Anisha Gunjal, Joseph J. Lim

Proceedings of the Tenth International Conference on Learning Representations, 2022

Skill-based Meta-Reinforcement Learning.

Taewook Nam, Shao-Hua Sun, Karl Pertsch, Sung Ju Hwang, Joseph J. Lim

Proceedings of the Tenth International Conference on Learning Representations, 2022

Know Your Action Set: Learning Action Relations for Reinforcement Learning.

Ayush Jain, Norio Kosaka, Kyung-Min Kim, Joseph J. Lim

Proceedings of the Tenth International Conference on Learning Representations, 2022

Skill-based Model-based Reinforcement Learning.

Lucy Xiaoyang Shi, Joseph J. Lim, Youngwoon Lee

Proceedings of the Conference on Robot Learning, 2022

Cross-Domain Transfer via Semantic Skill Imitation.

Karl Pertsch, Ruta Desai, Vikash Kumar, Franziska Meier, Joseph J. Lim, Dhruv Batra, Akshara Rai

Proceedings of the Conference on Robot Learning, 2022

2021

Policy Transfer across Visual and Dynamics Domain Gaps via Iterative Grounding.

Grace Zhang, Linghan Zhong, Youngwoon Lee, Joseph J. Lim

Proceedings of the Robotics: Science and Systems XVII, Virtual Event, July 12-16, 2021., 2021

Learning to Synthesize Programs as Interpretable and Generalizable Policies.

Dweep Trivedi, Jesse Zhang, Shao-Hua Sun, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Generalizable Imitation Learning from Observation via Inferring Goal Proximity.

Youngwoon Lee, Andrew Szot, Shao-Hua Sun, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

IKEA Furniture Assembly Environment for Long-Horizon Complex Manipulation Tasks.

Youngwoon Lee, Edward S. Hu, Joseph J. Lim

Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Message Passing Adaptive Resonance Theory for Online Active Semi-supervised Learning.

Taehyeong Kim, Injune Hwang, Hyundo Lee, Hyunseo Kim, Won-Seok Choi, Joseph J. Lim, Byoung-Tak Zhang

Proceedings of the 38th International Conference on Machine Learning, 2021

Demonstration-Guided Reinforcement Learning with Learned Skills.

Karl Pertsch, Youngwoon Lee, Yue Wu, Joseph J. Lim

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

Distilling Motion Planner Augmented Policies into Visual Control Policies for Robot Manipulation.

I-Chun Arthur Liu, Shagun Uppal, Gaurav S. Sukhatme, Joseph J. Lim, Peter Englert, Youngwoon Lee

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularization.

Youngwoon Lee, Joseph J. Lim, Anima Anandkumar, Yuke Zhu

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

2020

Scaling simulation-to-real transfer by learning a latent space of robot skills.

Ryan Julian, Eric Heiden, Zhanpeng He, Hejia Zhang, Stefan Schaal, Joseph J. Lim, Gaurav S. Sukhatme, Karol Hausman

Int. J. Robotics Res., 2020

Keyframing the Future: Keyframe Discovery for Visual Prediction and Planning.

Karl Pertsch, Oleh Rybkin, Jingyun Yang, Shenghao Zhou, Konstantinos G. Derpanis, Kostas Daniilidis, Joseph J. Lim, Andrew Jaegle

Proceedings of the 2nd Annual Conference on Learning for Dynamics and Control, 2020

Generalization to New Actions in Reinforcement Learning.

Ayush Jain, Andrew Szot, Joseph J. Lim

Proceedings of the 37th International Conference on Machine Learning, 2020

Program Guided Agent.

Shao-Hua Sun, Te-Lin Wu, Joseph J. Lim

Proceedings of the 8th International Conference on Learning Representations, 2020

Learning to Coordinate Manipulation Skills via Skill Behavior Diversification.

Youngwoon Lee, Jingyun Yang, Joseph J. Lim

Proceedings of the 8th International Conference on Learning Representations, 2020

Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environments.

Jun Yamada, Youngwoon Lee, Gautam Salhotra, Karl Pertsch, Max Pflueger, Gaurav S. Sukhatme, Joseph J. Lim, Peter Englert

Proceedings of the 4th Conference on Robot Learning, 2020

Accelerating Reinforcement Learning with Learned Skill Priors.

Karl Pertsch, Youngwoon Lee, Joseph J. Lim

Proceedings of the 4th Conference on Robot Learning, 2020

2019

IKEA Furniture Assembly Environment for Long-Horizon Complex Manipulation Tasks.

Youngwoon Lee, Edward S. Hu, Zhengyu Yang, Alex Yin, Joseph J. Lim

CoRR, 2019

KeyIn: Discovering Subgoal Structure with Keyframe-based Video Prediction.

Karl Pertsch, Oleh Rybkin, Jingyun Yang, Konstantinos G. Derpanis, Joseph J. Lim, Kostas Daniilidis, Andrew Jaegle

CoRR, 2019

Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation.

Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Composing Complex Skills by Learning Transition Policies.

Youngwoon Lee, Shao-Hua Sun, Sriram Somasundaram, Edward S. Hu, Joseph J. Lim

Proceedings of the 7th International Conference on Learning Representations, 2019

To Follow or not to Follow: Selective Imitation Learning from Observations.

Youngwoon Lee, Edward S. Hu, Zhengyu Yang, Joseph J. Lim

Proceedings of the 3rd Annual Conference on Robot Learning, 2019

2018

3D Interpreter Networks for Viewer-Centered Wireframe Modeling.

Jiajun Wu, Tianfan Xue, Joseph J. Lim, Yuandong Tian, Joshua B. Tenenbaum, Antonio Torralba, William T. Freeman

Int. J. Comput. Vis., 2018

Toward Multimodal Model-Agnostic Meta-Learning.

Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim

CoRR, 2018

Zero-Shot Skill Composition and Simulation-to-Real Transfer by Learning Task Representations.

Zhanpeng He, Ryan Julian, Eric Heiden, Hejia Zhang, Stefan Schaal, Joseph J. Lim, Gaurav S. Sukhatme, Karol Hausman

CoRR, 2018

Auto-conditioned Recurrent Mixture Density Networks for Complex Trajectory Generation.

Hejia Zhang, Eric Heiden, Ryan Julian, Zhangpeng He, Joseph J. Lim, Gaurav S. Sukhatme

CoRR, 2018

Scaling Simulation-to-Real Transfer by Learning Composable Robot Skills.

Ryan Julian, Eric Heiden, Zhanpeng He, Hejia Zhang, Stefan Schaal, Joseph J. Lim, Gaurav S. Sukhatme, Karol Hausman

Proceedings of the 2018 International Symposium on Experimental Robotics, 2018

Neural Program Synthesis from Diverse Demonstration Videos.

Shao-Hua Sun, Hyeonwoo Noh, Sriram Somasundaram, Joseph J. Lim

Proceedings of the 35th International Conference on Machine Learning, 2018

Universal Agent for Disentangling Environments and Tasks.

Jiayuan Mao, Honghua Dong, Joseph J. Lim

Proceedings of the 6th International Conference on Learning Representations, 2018

Multi-view to Novel View: Synthesizing Novel Views With Self-learned Confidence.

Shao-Hua Sun, Minyoung Huh, Yuan-Hong Liao, Ning Zhang, Joseph J. Lim

Proceedings of the Computer Vision - ECCV 2018, 2018

Learning and Using the Arrow of Time.

Donglai Wei, Joseph J. Lim, Andrew Zisserman, William T. Freeman

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Demo2Vec: Reasoning Object Affordances From Online Videos.

Kuan Fang, Te-Lin Wu, Daniel Yang, Silvio Savarese, Joseph J. Lim

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

2017

Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial Nets.

Karol Hausman, Yevgen Chebotar, Stefan Schaal, Gaurav S. Sukhatme, Joseph J. Lim

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Target-driven visual navigation in indoor scenes using deep reinforcement learning.

Yuke Zhu, Roozbeh Mottaghi, Eric Kolve, Joseph J. Lim, Abhinav Gupta, Li Fei-Fei, Ali Farhadi

Proceedings of the 2017 IEEE International Conference on Robotics and Automation, 2017

Knowledge Acquisition for Visual Question Answering via Iterative Querying.

Yuke Zhu, Joseph J. Lim, Li Fei-Fei

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

Unsupervised Visual-Linguistic Reference Resolution in Instructional Videos.

De-An Huang, Joseph J. Lim, Li Fei-Fei, Juan Carlos Niebles

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

2016

High-fidelity facial and speech animation for VR HMDs.

Kyle Olszewski, Joseph J. Lim, Shunsuke Saito, Hao Li

ACM Trans. Graph., 2016

Single Image 3D Interpreter Network.

Jiajun Wu, Tianfan Xue, Joseph J. Lim, Yuandong Tian, Joshua B. Tenenbaum, Antonio Torralba, William T. Freeman

Proceedings of the Computer Vision - ECCV 2016, 2016

Physics 101: Learning Physical Object Properties from Unlabeled Videos.

Jiajun Wu, Joseph J. Lim, Hongyi Zhang, Joshua B. Tenenbaum, William T. Freeman

Proceedings of the British Machine Vision Conference 2016, 2016

2015

Toward visual understanding of everyday object.

Joseph J. Lim

PhD thesis, 2015

Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning.

Jiajun Wu, Ilker Yildirim, Joseph J. Lim, Bill Freeman, Joshua B. Tenenbaum

Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, 2015

Discovering states and transformations in image collections.

Phillip Isola, Joseph J. Lim, Edward H. Adelson

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015

2014

FPM: Fine Pose Parts-Based Model with 3D CAD Models.

Joseph J. Lim, Aditya Khosla, Antonio Torralba

Proceedings of the Computer Vision - ECCV 2014, 2014

Looking Beyond the Visible Scene.

Aditya Khosla, Byoungkwon An, Joseph J. Lim, Antonio Torralba

Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014

2013

Parsing IKEA Objects: Fine Pose Estimation.

Joseph J. Lim, Hamed Pirsiavash, Antonio Torralba

Proceedings of the IEEE International Conference on Computer Vision, 2013

Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection.

Joseph J. Lim, C. Lawrence Zitnick, Piotr Dollár

Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, 2013

2011

Transfer Learning by Borrowing Examples for Multiclass Object Detection.

Joseph J. Lim, Ruslan Salakhutdinov, Antonio Torralba

Proceedings of the Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011. Proceedings of a meeting held 12-14 December 2011, 2011

2010

Exploiting hierarchical context on a large database of object categories.

Myung Jin Choi, Joseph J. Lim, Antonio Torralba, Alan S. Willsky

Proceedings of the Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, 2010

2009

Context by region ancestry.

Joseph J. Lim, Pablo Arbeláez, Chunhui Gu, Jitendra Malik

Proceedings of the IEEE 12th International Conference on Computer Vision, ICCV 2009, Kyoto, Japan, September 27, 2009

Recognition using regions.

Chunhui Gu, Joseph J. Lim, Pablo Arbeláez, Jitendra Malik

Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2009), 2009

2007

A Distributed Message Passing Algorithm for Sensor Localization.

Max Welling, Joseph J. Lim

Proceedings of the Artificial Neural Networks, 2007