Luca Weihs

According to our database, Luca Weihs authored at least 43 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models.

Matt Deitke, Christopher Clark, Sangho Lee, Rohun Tripathi, Yue Yang, Jae Sung Park, Mohammadreza Salehi, Niklas Muennighoff, Kyle Lo, Luca Soldaini, Jiasen Lu, Taira Anderson, Erin Bransom, Kiana Ehsani, Huong Ngo, Yen-Sung Chen, Ajay Patel, Mark Yatskar, Chris Callison-Burch, Andrew Head, Rose Hendrix, Favyen Bastani, Eli VanderBilt, Nathan Lambert, Yvonne Chou, Arnavi Chheda, Jenna Sparks, Sam Skjonsberg, Michael Schmitz, Aaron Sarnat, Byron Bischoff, Pete Walsh, Chris Newell, Piper Wolters, Tanmay Gupta, Kuo-Hao Zeng, Jon Borchardt, Dirk Groeneveld, Jen Dumas, Crystal Nam, Sophie Lebrecht, Caitlin Wittlif, Carissa Schoenick, Oscar Michel, Ranjay Krishna, Luca Weihs, Noah A. Smith, Hannaneh Hajishirzi, Ross B. Girshick, Ali Farhadi, Aniruddha Kembhavi

CoRR, 2024

PoliFormer: Scaling On-Policy RL with Transformers Results in Masterful Navigators.

Kuo-Hao Zeng, Zichen Zhang, Kiana Ehsani, Rose Hendrix, Jordi Salvador, Alvaro Herrasti, Ross B. Girshick, Aniruddha Kembhavi, Luca Weihs

CoRR, 2024

CodeNav: Beyond tool-use to using real-world codebases with LLM agents.

Tanmay Gupta, Luca Weihs, Aniruddha Kembhavi

CoRR, 2024

Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration.

Abby O'Neill, Abdul Rehman, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, Ajinkya Jain, Albert Tung, Alex Bewley, Alexander Herzog, Alex Irpan, Alexander Khazatsky, Anant Rai, Anchit Gupta, Andrew Wang, Anikait Singh, Animesh Garg, Aniruddha Kembhavi, Annie Xie, Anthony Brohan, Antonin Raffin, Archit Sharma, Arefeh Yavary, Arhan Jain, Ashwin Balakrishna, Ayzaan Wahid, Ben Burgess-Limerick, Beomjoon Kim, Bernhard Schölkopf, Blake Wulfe, Brian Ichter, Cewu Lu, Charles Xu, Charlotte Le, Chelsea Finn, Chen Wang, Chenfeng Xu, Cheng Chi, Chenguang Huang, Christine Chan, Christopher Agia, Chuer Pan, Chuyuan Fu, Coline Devin, Danfei Xu, Daniel Morton, Danny Driess, Daphne Chen, Deepak Pathak, Dhruv Shah, Dieter Büchler, Dinesh Jayaraman, Dmitry Kalashnikov, Dorsa Sadigh, Edward Johns, Ethan Paul Foster, Fangchen Liu, Federico Ceola, Fei Xia, Feiyu Zhao, Freek Stulp, Gaoyue Zhou, Gaurav S. Sukhatme, Gautam Salhotra, Ge Yan, Gilbert Feng, Giulio Schiavi, Glen Berseth, Gregory Kahn, Guanzhi Wang, Hao Su, Haoshu Fang, Haochen Shi, Henghui Bao, Heni Ben Amor, Henrik I. Christensen, Hiroki Furuta, Homer Walke, Hongjie Fang, Huy Ha, Igor Mordatch, Ilija Radosavovic, Isabel Leal, Jacky Liang, Jad Abou-Chakra, Jaehyung Kim, Jaimyn Drake, Jan Peters, Jan Schneider, Jasmine Hsu, Jeannette Bohg, Jeffrey Bingham, Jeffrey Wu, Jensen Gao, Jiaheng Hu, Jiajun Wu, Jialin Wu, Jiankai Sun, Jianlan Luo, Jiayuan Gu, Jie Tan, Jihoon Oh, Jimmy Wu, Jingpei Lu, Jingyun Yang, Jitendra Malik, João Silvério, Joey Hejna, Jonathan Booher, Jonathan Tompson, Jonathan Yang, Jordi Salvador, Joseph J. Lim, Junhyek Han, Kaiyuan Wang, Kanishka Rao, Karl Pertsch, Karol Hausman, Keegan Go, Keerthana Gopalakrishnan, Ken Goldberg, Kendra Byrne, Kenneth Oslund, Kento Kawaharazuka, Kevin Black, Kevin Lin, Kevin Zhang, Kiana Ehsani, Kiran Lekkala, Kirsty Ellis, Krishan Rana, Krishnan Srinivasan, Kuan Fang, Kunal Pratap Singh, Kuo-Hao Zeng, Kyle Hatch, Kyle Hsu, Laurent Itti, Lawrence Yunliang Chen, Lerrel Pinto, Li Fei-Fei, Liam Tan, Linxi Jim Fan, Lionel Ott, Lisa Lee, Luca Weihs, Magnum Chen, Marion Lepert, Marius Memmel, Masayoshi Tomizuka, Masha Itkina, Mateo Guaman Castro, Max Spero, Maximilian Du, Michael Ahn, Michael C. Yip, Mingtong Zhang, Mingyu Ding, Minho Heo, Mohan Kumar Srirama, Mohit Sharma, Moo Jin Kim, Naoaki Kanazawa, Nicklas Hansen, Nicolas Heess, Nikhil J. Joshi, Niko Sünderhauf, Ning Liu, Norman Di Palo, Nur Muhammad (Mahi) Shafiullah, Oier Mees, Oliver Kroemer, Osbert Bastani, Pannag R. Sanketi, Patrick Tree Miller, Patrick Yin, Paul Wohlhart, Peng Xu, Peter David Fagan, Peter Mitrano, Pierre Sermanet, Pieter Abbeel, Priya Sundaresan, Qiuyu Chen, Quan Vuong, Rafael Rafailov, Ran Tian, Ria Doshi, Roberto Martín-Martín, Rohan Baijal, Rosario Scalise, Rose Hendrix, Roy Lin, Runjia Qian, Ruohan Zhang, Russell Mendonca, Rutav Shah, Ryan Hoque, Ryan Julian, Samuel Bustamante, Sean Kirmani, Sergey Levine, Shan Lin, Sherry Moore, Shikhar Bahl, Shivin Dass, Shubham D. Sonawani, Shuran Song, Sichun Xu, Siddhant Haldar, Siddharth Karamcheti, Simeon Adebola, Simon Guist, Soroush Nasiriany, Stefan Schaal, Stefan Welker, Stephen Tian, Subramanian Ramamoorthy, Sudeep Dasari, Suneel Belkhale, Sungjae Park, Suraj Nair, Suvir Mirchandani, Takayuki Osa, Tanmay Gupta, Tatsuya Harada, Tatsuya Matsushima, Ted Xiao, Thomas Kollar, Tianhe Yu, Tianli Ding, Todor Davchev, Tony Z. Zhao, Travis Armstrong, Trevor Darrell, Trinity Chung, Vidhi Jain, Vincent Vanhoucke, Wei Zhan, Wenxuan Zhou, Wolfram Burgard, Xi Chen, Xiaolong Wang, Xinghao Zhu, Xinyang Geng, Xiyuan Liu, Liangwei Xu, Xuanlin Li, Yao Lu, Yecheng Jason Ma, Yejin Kim, Yevgen Chebotar, Yifan Zhou, Yifeng Zhu, Yilin Wu, Ying Xu, Yixuan Wang, Yonatan Bisk, Yoonyoung Cho, Youngwoon Lee, Yuchen Cui, Yue Cao, Yueh-Hua Wu, Yujin Tang, Yuke Zhu, Yunchu Zhang, Yunfan Jiang, Yunshuang Li, Yunzhu Li, Yusuke Iwasawa, Yutaka Matsuo, Zehan Ma, Zhuo Xu, Zichen Jeff Cui, Zichen Zhang, Zipeng Lin

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Universal Visual Decomposer: Long-Horizon Manipulation Made Easy.

Zichen Zhang, Yunshuang Li, Osbert Bastani, Abhishek Gupta, Dinesh Jayaraman, Yecheng Jason Ma, Luca Weihs

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Holodeck: Language Guided Generation of 3D Embodied AI Environments.

Yue Yang, Fan-Yun Sun, Luca Weihs, Eli VanderBilt, Alvaro Herrasti, Winson Han, Jiajun Wu, Nick Haber, Ranjay Krishna, Lingjie Liu, Chris Callison-Burch, Mark Yatskar, Aniruddha Kembhavi, Christopher Clark

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Seeing the Unseen: Visual Common Sense for Semantic Placement.

Ram Ramrakhya, Aniruddha Kembhavi, Dhruv Batra, Zsolt Kira, Kuo-Hao Zeng, Luca Weihs

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Promptable Behaviors: Personalizing Multi-Objective Rewards from Human Preferences.

Minyoung Hwang, Luca Weihs, Chanwoo Park, Kimin Lee, Aniruddha Kembhavi, Kiana Ehsani

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

SPOC: Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World.

Kiana Ehsani, Tanmay Gupta, Rose Hendrix, Jordi Salvador, Luca Weihs, Kuo-Hao Zeng, Kunal Pratap Singh, Yejin Kim, Winson Han, Alvaro Herrasti, Ranjay Krishna, Dustin Schwenk, Eli VanderBilt, Aniruddha Kembhavi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

Understanding Representations Pretrained with Auxiliary Losses for Embodied Agent Planning.

Yuxuan Li, Luca Weihs

CoRR, 2023

Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World.

Kiana Ehsani, Tanmay Gupta, Rose Hendrix, Jordi Salvador, Luca Weihs, Kuo-Hao Zeng, Kunal Pratap Singh, Yejin Kim, Winson Han, Alvaro Herrasti, Ranjay Krishna, Dustin Schwenk, Eli VanderBilt, Aniruddha Kembhavi

CoRR, 2023

When Learning Is Out of Reach, Reset: Generalization in Autonomous Visuomotor Reinforcement Learning.

Zichen Zhang, Luca Weihs

CoRR, 2023

Towards Disturbance-Free Visual Mobile Manipulation.

Tianwei Ni, Kiana Ehsani, Luca Weihs, Jordi Salvador

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023

Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics.

Kuo-Hao Zeng, Luca Weihs, Roozbeh Mottaghi, Ali Farhadi

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Scene Graph Contrastive Learning for Embodied Navigation.

Kunal Pratap Singh, Jordi Salvador, Luca Weihs, Aniruddha Kembhavi

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

EXCALIBUR: Encouraging and Evaluating Embodied Exploration.

Hao Zhu, Raghav Kapoor, So Yeon Min, Winson Han, Jiatai Li, Kaiwen Geng, Graham Neubig, Yonatan Bisk, Aniruddha Kembhavi, Luca Weihs

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Objaverse: A Universe of Annotated 3D Objects.

Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, Ali Farhadi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

2022

Benchmarking Progress to Infant-Level Physical Reasoning in AI.

Luca Weihs, Amanda Rose Yuile, Renée Baillargeon, Cynthia Fisher, Gary Marcus, Roozbeh Mottaghi, Aniruddha Kembhavi

Trans. Mach. Learn. Res., 2022

Phone2Proc: Bringing Robust Robots Into Our Chaotic World.

Matt Deitke, Rose Hendrix, Luca Weihs, Ali Farhadi, Kiana Ehsani, Aniruddha Kembhavi

CoRR, 2022

A General Purpose Supervisory Signal for Embodied Agents.

Kunal Pratap Singh, Jordi Salvador, Luca Weihs, Aniruddha Kembhavi

CoRR, 2022

Retrospectives on the Embodied AI Workshop.

Matt Deitke, Dhruv Batra, Yonatan Bisk, Tommaso Campari, Angel X. Chang, Devendra Singh Chaplot, Changan Chen, Claudia Pérez-D'Arpino, Kiana Ehsani, Ali Farhadi, Li Fei-Fei, Anthony G. Francis, Chuang Gan, Kristen Grauman, David Hall, Winson Han, Unnat Jain, Aniruddha Kembhavi, Jacob Krantz, Stefan Lee, Chengshu Li, Sagnik Majumder, Oleksandr Maksymets, Roberto Martín-Martín, Roozbeh Mottaghi, Sonia Raychaudhuri, Mike Roberts, Silvio Savarese, Manolis Savva, Mohit Shridhar, Niko Sünderhauf, Andrew Szot, Ben Talbot, Joshua B. Tenenbaum, Jesse Thomason, Alexander Toshev, Joanne Truong, Luca Weihs, Jiajun Wu

CoRR, 2022

ProcTHOR: Large-Scale Embodied AI Using Procedural Generation.

Matt Deitke, Eli VanderBilt, Alvaro Herrasti, Luca Weihs, Jordi Salvador, Kiana Ehsani, Winson Han, Eric Kolve, Ali Farhadi, Aniruddha Kembhavi, Roozbeh Mottaghi

CoRR, 2022

The Introspective Agent: Interdependence of Strategy, Physiology, and Sensing for Embodied Agents.

Sarah M. Pratt, Luca Weihs, Ali Farhadi

CoRR, 2022

Ask4Help: Learning to Leverage an Expert for Embodied Tasks.

Kunal Pratap Singh, Luca Weihs, Alvaro Herrasti, Jonghyun Choi, Aniruddha Kembhavi, Roozbeh Mottaghi

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

🏘️ ProcTHOR: Large-Scale Embodied AI Using Procedural Generation.

Matt Deitke, Eli VanderBilt, Alvaro Herrasti, Luca Weihs, Kiana Ehsani, Jordi Salvador, Winson Han, Eric Kolve, Aniruddha Kembhavi, Roozbeh Mottaghi

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Simple but Effective: CLIP Embeddings for Embodied AI.

Apoorv Khandelwal, Luca Weihs, Roozbeh Mottaghi, Aniruddha Kembhavi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

2021

Gender trends in computer science authorship.

Lucy Lu Wang, Gabriel Stanovsky, Luca Weihs, Oren Etzioni

Commun. ACM, 2021

Bridging the Imitation Gap by Adaptive Insubordination.

Luca Weihs, Unnat Jain, Iou-Jen Liu, Jordi Salvador, Svetlana Lazebnik, Aniruddha Kembhavi, Alexander G. Schwing

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Learning Generalizable Visual Representations via Interactive Gameplay.

Luca Weihs, Aniruddha Kembhavi, Kiana Ehsani, Sarah M. Pratt, Winson Han, Alvaro Herrasti, Eric Kolve, Dustin Schwenk, Roozbeh Mottaghi, Ali Farhadi

Proceedings of the 9th International Conference on Learning Representations, 2021

GridToPix: Training Embodied Agents with Minimal Supervision.

Unnat Jain, Iou-Jen Liu, Svetlana Lazebnik, Aniruddha Kembhavi, Luca Weihs, Alexander G. Schwing

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Pushing It Out of the Way: Interactive Visual Navigation.

Kuo-Hao Zeng, Luca Weihs, Ali Farhadi, Roozbeh Mottaghi

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Visual Room Rearrangement.

Luca Weihs, Matt Deitke, Aniruddha Kembhavi, Roozbeh Mottaghi

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

ManipulaTHOR: A Framework for Visual Object Manipulation.

Kiana Ehsani, Winson Han, Alvaro Herrasti, Eli VanderBilt, Luca Weihs, Eric Kolve, Aniruddha Kembhavi, Roozbeh Mottaghi

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

AllenAct: A Framework for Embodied AI Research.

Luca Weihs, Jordi Salvador, Klemen Kotar, Unnat Jain, Kuo-Hao Zeng, Roozbeh Mottaghi, Aniruddha Kembhavi

CoRR, 2020

Bridging the Imitation Gap by Adaptive Insubordination.

Luca Weihs, Unnat Jain, Jordi Salvador, Svetlana Lazebnik, Aniruddha Kembhavi, Alexander G. Schwing

CoRR, 2020

Grounded Situation Recognition.

Sarah M. Pratt, Mark Yatskar, Luca Weihs, Ali Farhadi, Aniruddha Kembhavi

Proceedings of the Computer Vision - ECCV 2020, 2020

A Cordial Sync: Going Beyond Marginal Policies for Multi-agent Embodied Tasks.

Unnat Jain, Luca Weihs, Eric Kolve, Ali Farhadi, Svetlana Lazebnik, Aniruddha Kembhavi, Alexander G. Schwing

Proceedings of the Computer Vision - ECCV 2020, 2020

Visual Reaction: Learning to Play Catch With Your Drone.

Kuo-Hao Zeng, Roozbeh Mottaghi, Luca Weihs, Ali Farhadi

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

RoboTHOR: An Open Simulation-to-Real Embodied AI Platform.

Matt Deitke, Winson Han, Alvaro Herrasti, Aniruddha Kembhavi, Eric Kolve, Roozbeh Mottaghi, Jordi Salvador, Dustin Schwenk, Eli VanderBilt, Matthew Wallingford, Luca Weihs, Mark Yatskar, Ali Farhadi

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

2019

Artificial Agents Learn Flexible Visual Representations by Playing a Hiding Game.

Luca Weihs, Aniruddha Kembhavi, Winson Han, Alvaro Herrasti, Eric Kolve, Dustin Schwenk, Roozbeh Mottaghi, Ali Farhadi

CoRR, 2019

Two Body Problem: Collaborative Visual Task Completion.

Unnat Jain, Luca Weihs, Eric Kolve, Mohammad Rastegari, Svetlana Lazebnik, Ali Farhadi, Alexander G. Schwing, Aniruddha Kembhavi

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

2017

Learning to Predict Citation-Based Impact Measures.

Luca Weihs, Oren Etzioni

Proceedings of the 2017 ACM/IEEE Joint Conference on Digital Libraries, 2017

2016

Efficient computation of the Bergsma-Dassios sign covariance.

Luca Weihs, Mathias Drton, Dennis Leung

Comput. Stat., 2016