Jiajun Wu

Timothy Edward John Behrens

Rahul Mysore Venkatesh

Trans. Mach. Learn. Res., 2024

RoboCraft: Learning to see, simulate, and shape elasto-plastic objects in 3D with graph networks.

[BibT_eX]

[DOI]

Int. J. Robotics Res., 2024

The Scene Language: Representing Scenes with Programs, Words, and Embeddings.

[BibT_eX]

[DOI]

CoRR, 2024

Learning Smooth Humanoid Locomotion through Lipschitz-Constrained Policies.

[BibT_eX]

[DOI]

CoRR, 2024

Generalizable Humanoid Manipulation with Improved 3D Diffusion Policies.

[BibT_eX]

[DOI]

CoRR, 2024

Automated Creation of Digital Cousins for Robust Policy Learning.

[BibT_eX]

[DOI]

CoRR, 2024

Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making.

[BibT_eX]

[DOI]

CoRR, 2024

Don't Cut Corners: Exact Conditions for Modularity in Biologically Inspired Representations.

[BibT_eX]

[DOI]

James C. R. Whittington

CoRR, 2024

MARPLE: A Benchmark for Long-Horizon Inference.

[BibT_eX]

[DOI]

CoRR, 2024

What Makes a Maze Look Like a Maze?

[BibT_eX]

[DOI]

CoRR, 2024

View-Invariant Policy Learning via Zero-Shot Novel View Synthesis.

[BibT_eX]

[DOI]

CoRR, 2024

RoboPack: Learning Tactile-Informed Dynamics Models for Dense Packing.

[BibT_eX]

[DOI]

CoRR, 2024

WonderWorld: Interactive 3D Scene Generation from a Single Image.

[BibT_eX]

[DOI]

CoRR, 2024

TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correction.

[BibT_eX]

[DOI]

CoRR, 2024

BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation.

[BibT_eX]

[DOI]

CoRR, 2024

Evaluating Real-World Robot Manipulation Policies in Simulation.

[BibT_eX]

[DOI]

CoRR, 2024

Text-Based Reasoning About Vector Graphics.

[BibT_eX]

[DOI]

CoRR, 2024

BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1, 000 Everyday Activities and Realistic Simulation.

[BibT_eX]

[DOI]

CoRR, 2024

Unsupervised Discovery of Object-Centric Neural Fields.

[BibT_eX]

[DOI]

Rundong Luo

CoRR, 2024

Physical scene understanding.

[BibT_eX]

[DOI]

Nur Muhammad (Mahi) Shafiullah

AI Mag., 2024

DiffSound: Differentiable Modal Sound Rendering and Inverse Rendering for Diverse Inference Tasks.

[BibT_eX]

[DOI]

Proceedings of the ACM SIGGRAPH 2024 Conference Papers, 2024

D5RL: Diverse Datasets for Data-Driven Deep Reinforcement Learning.

[BibT_eX]

Philippe Hansen-Estruch

RLJ, 2024

Efficient imitation learning with conservative world models.

[BibT_eX]

[DOI]

Proceedings of the 6th Annual Learning for Dynamics & Control Conference, 2024

Open X-Embodiment: Robotic Learning Datasets and RT-X Models : Open X-Embodiment Collaboration.

[BibT_eX]

[DOI]

Henrik I. Christensen

Keerthana Gopalakrishnan

Lawrence Yunliang Chen

Subramanian Ramamoorthy

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Learning to Design 3D Printable Adaptations on Everyday Objects for Robot Manipulation.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Physically Grounded Vision-Language Models for Robotic Manipulation.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Tripod: Three Complementary Inductive Biases for Disentangled Representation Learning.

[BibT_eX]

[DOI]

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Learning Planning Abstractions from Language.

[BibT_eX]

[DOI]

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Language-Informed Visual Concept Learning.

[BibT_eX]

[DOI]

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Patched Denoising Diffusion Models For High-Resolution Image Synthesis.

[BibT_eX]

[DOI]

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Neural Polynomial Gabor Fields for Macro Motion Analysis.

[BibT_eX]

[DOI]

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2024, 2024

PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2024, 2024

3D Congealing: 3D-Aware Image Alignment in the Wild.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2024, 2024

Ponymation: Learning Articulated 3D Animal Motions from Unlabeled Online Videos.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2024, 2024

Controllable Human-Object Interaction Synthesis.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2024, 2024

WonderJourney: Going from Anywhere to Everywhere.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Holodeck: Language Guided Generation of 3D Embodied AI Environments.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

ULIP-2: Towards Scalable Multimodal Pre-Training for 3D Understanding.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Hearing Anything Anywhere.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Learning the 3D Fauna of the Web.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Naturally Supervised 3D Visual Grounding with Language-Regularized Concept Learners.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

CityPulse: Fine-Grained Assessment of Urban Change with Street View Time Series.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

Partial-View Object View Synthesis via Filtering Inversion.

[BibT_eX]

[DOI]

Proceedings of the International Conference on 3D Vision, 2024

2023

Editing Motion Graphics Video via Motion Vectorization and Transformation.

[BibT_eX]

[DOI]

ACM Trans. Graph., December, 2023

Object Motion Guided Human Motion Synthesis.

[BibT_eX]

[DOI]

Jiaman Li

C. Karen Liu

ACM Trans. Graph., December, 2023

Fluid Simulation on Neural Flow Maps.

[BibT_eX]

[DOI]

ACM Trans. Graph., December, 2023

Ego-Body Pose Estimation via Ego-Head Pose Estimation.

[BibT_eX]

[DOI]

Jiaman Li

C. Karen Liu

AI Matters, June, 2023

Differentiable Physics Simulation of Dynamics-Augmented Neural Objects.

[BibT_eX]

[DOI]

IEEE Robotics Autom. Lett., May, 2023

Neurosymbolic Models for Computer Graphics.

[BibT_eX]

[DOI]

Comput. Graph. Forum, May, 2023

Learning Object-Centric Neural Scattering Functions for Free-viewpoint Relighting and Scene Composition.

[BibT_eX]

[DOI]

Trans. Mach. Learn. Res., 2023

Unsupervised Discovery and Composition of Object Light Fields.

[BibT_eX]

[DOI]

Trans. Mach. Learn. Res., 2023

DisCo: Improving Compositional Generalization in Visual Reasoning through Distribution Coverage.

[BibT_eX]

[DOI]

Joy Hsu

Trans. Mach. Learn. Res., 2023

Ponymation: Learning 3D Animal Motions from Unlabeled Online Videos.

[BibT_eX]

[DOI]

CoRR, 2023

Foundation Models in Robotics: Applications, Challenges, and the Future.

[BibT_eX]

[DOI]

CoRR, 2023

ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Real Image.

[BibT_eX]

[DOI]

CoRR, 2023

Mini-BEHAVIOR: A Procedurally Generated Benchmark for Long-horizon Decision-Making in Embodied AI.

[BibT_eX]

[DOI]

Katherine Rose Driggs-Campbell

CoRR, 2023

D<sup>3</sup>Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Robotic Manipulation.

[BibT_eX]

[DOI]

Yixuan Wang

Zhuoran Li

Mingtong Zhang

Yunzhu Li

CoRR, 2023

PyPose v0.6: The Imperative Programming Interface for Robotics.

[BibT_eX]

[DOI]

CoRR, 2023

Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations.

[BibT_eX]

[DOI]

Moo Jin Kim

Chelsea Finn

CoRR, 2023

HomE: Homography-Equivariant Video Representation Learning.

[BibT_eX]

[DOI]

CoRR, 2023

The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects.

[BibT_eX]

[DOI]

CoRR, 2023

An Extensible Multimodal Multi-task Object Dataset with Materials.

[BibT_eX]

[DOI]

CoRR, 2023

ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding.

[BibT_eX]

[DOI]

Katherine Driggs Campbell

CoRR, 2023

Partial-View Object View Synthesis via Filtered Inversion.

[BibT_eX]

[DOI]

CoRR, 2023

Physically Plausible Animation of Human Upper Body from a Single Image.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023

Dynamic-Resolution Model Learning for Object Pile Manipulation.

[BibT_eX]

[DOI]

Yixuan Wang

Yunzhu Li

Proceedings of the Robotics: Science and Systems XIX, Daegu, 2023

Inferring Hybrid Neural Fluid Fields from Videos.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

SoundCam: A Dataset for Finding Humans Using Room Acoustics.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Holistic Evaluation of Text-to-Image Models.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Stanford-ORB: A Real-World 3D Object Inverse Rendering Benchmark.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Are These the Same Apple? Comparing Images Based on Object Intrinsics.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

What's Left? Concept Grounding with Logic-Enhanced Foundation Models.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Disentanglement via Latent Quantization.

[BibT_eX]

[DOI]

Kyle Hsu

William Dorrell

James C. R. Whittington

Chelsea Finn

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Siamese Masked Autoencoders.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

3D Copy-Paste: Physically Plausible Object Insertion for Monocular 3D Detection.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Model-Based Control with Sparse Neural Dynamics.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Benchmarking Rigid Body Contact Models.

[BibT_eX]

[DOI]

Michelle Guo

Yifeng Jiang

Andrew Everett Spielberg

C. Karen Liu

Proceedings of the Learning for Dynamics and Control Conference, 2023

Primitive Skill-Based Robot Learning from Human Evaluative Feedback.

[BibT_eX]

[DOI]

IROS, 2023

Task-Driven Graph Attention for Hierarchical Relational Object Navigation.

[BibT_eX]

[DOI]

Ruohan Zhang

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

STAP: Sequencing Task-Agnostic Policies.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

Modeling Dynamic Environments with Scene Graph Memory.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2023

Motion Question Answering via Modular Motion Programs.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Machine Learning, 2023

Programmatically Grounded, Compositionally Generalizable Robotic Manipulation.

[BibT_eX]

[DOI]

Proceedings of the Eleventh International Conference on Learning Representations, 2023

A Control-Centric Benchmark for Video Prediction.

[BibT_eX]

[DOI]

Stephen Tian

Chelsea Finn

Proceedings of the Eleventh International Conference on Learning Representations, 2023

An Extensible Multi-modal Multi-task Object Dataset with Materials.

[BibT_eX]

[DOI]

Trevor Scott Standley

Proceedings of the Eleventh International Conference on Learning Representations, 2023

MaskViT: Masked Visual Pre-Training for Video Prediction.

[BibT_eX]

[DOI]

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Learning Vortex Dynamics for Fluid Inference and Prediction.

[BibT_eX]

[DOI]

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Rendering Humans from Object-Occluded Monocular Videos.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

VQ3D: Learning a 3D-Aware Generative Model on ImageNet.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Tree-Structured Shading Decomposition.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Can Visual Scratchpads With Diagrammatic Abstractions Augment LLM Reasoning?

[BibT_eX]

[DOI]

Proceedings of the Proceedings on "I Can't Believe It's Not Better: Failure Modes in the Age of Foundation Models" at NeurIPS 2023 Workshops, 2023

Seeing a Rose in Five Thousand Ways.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Accidental Light Probes.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understanding.

[BibT_eX]

[DOI]

Le Xue

Mingfei Gao

Chen Xing

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

PyPose: A Library for Robot Learning with Physics-based Optimization.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Multi-Object Manipulation via Object-Centric Neural Scattering Functions.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

3D Neural Field Generation Using Triplane Diffusion.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Putting People in Their Place: Affordance-Aware Human Insertion into Scenes.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

NS3D: Neuro-Symbolic Grounding of 3D Objects and Relations.

[BibT_eX]

[DOI]

Joy Hsu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

The Object Folder Benchmark : Multisensory Learning with Neural and Real Objects.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

REALIMPACT: A Dataset of Impact Sound Fields for Real Objects.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

CIRCLE: Capture In Rich Contextual Environments.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

NOIR: Neural Signal Operated Intelligent Robots for Everyday Activities.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2023

Compositional Diffusion-Based Continuous Constraint Solvers.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2023

Learning Sequential Acquisition Policies for Robot-Assisted Feeding.

[BibT_eX]

[DOI]

Priya Sundaresan

Dorsa Sadigh

Proceedings of the Conference on Robot Learning, 2023

RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2023

Composable Part-Based Manipulation.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2023

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2023

Learning to Design and Use Tools for Robotic Manipulation.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2023

Intuitions about physical scenes and objects in Virtual Reality (VR).

[BibT_eX]

[DOI]

Proceedings of the 45th Annual Meeting of the Cognitive Science Society, 2023

Quantifying the Effect of Visual Impairments on Daily Activities in Virtual, Interactive Environments.

[BibT_eX]

[DOI]

Proceedings of the 45th Annual Meeting of the Cognitive Science Society, 2023

Learning Rational Subgoals from Demonstrations and Instructions.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

ULIP: Learning Unified Representation of Language, Image and Point Cloud for 3D Understanding.

[BibT_eX]

[DOI]

Le Xue

Mingfei Gao

Chen Xing

CoRR, 2022

TAPS: Task-Agnostic Policy Sequencing.

[BibT_eX]

[DOI]

CoRR, 2022

Retrospectives on the Embodied AI Workshop.

[BibT_eX]

[DOI]

CoRR, 2022

PyPose: A Library for Robot Learning with Physics-based Optimization.

[BibT_eX]

[DOI]

CoRR, 2022

BEHAVIOR in Habitat 2.0: Simulator-Independent Logical Task Description for Benchmarking Embodied AI Agents.

[BibT_eX]

[DOI]

Ziang Liu

Fei Xia

CoRR, 2022

Scene Synthesis from Human Motion.

[BibT_eX]

[DOI]

Proceedings of the SIGGRAPH Asia 2022 Conference Papers, 2022

RoboCraft: Learning to See, Simulate, and Shape Elasto-Plastic Objects with Graph Networks.

[BibT_eX]

[DOI]

Proceedings of the Robotics: Science and Systems XVIII, New York City, NY, USA, June 27, 2022

IKEA-Manual: Seeing Shape Assembly Step by Step.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Interaction Modeling with Multiplex Attention.

[BibT_eX]

[DOI]

Mykel J. Kochenderfer

Nick Haber

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

CLEVRER-Humans: Describing Physical and Causal Events the Human Way.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

MOMA-LRG: Language-Refined Graphs for Multi-Object Multi-Actor Activity Parsing.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Geoclidean: Few-Shot Generalization in Euclidean Geometry.

[BibT_eX]

[DOI]

Joy Hsu

Noah D. Goodman

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Unsupervised Learning of Shape Programs with Repeatable Implicit Parts.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

E-MAPP: Efficient Multi-Agent Reinforcement Learning with Parallel Program Guidance.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Sparse and Local Networks for Hypergraph Reasoning.

[BibT_eX]

[DOI]

Guangxuan Xiao

Proceedings of the Learning on Graphs Conference, 2022

Unsupervised Discovery of Object Radiance Fields.

[BibT_eX]

[DOI]

Leonidas J. Guibas

Proceedings of the Tenth International Conference on Learning Representations, 2022

SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations.

[BibT_eX]

[DOI]

Proceedings of the Tenth International Conference on Learning Representations, 2022

Vision-Based Manipulators Need to Also See from Their Hands.

[BibT_eX]

[DOI]

Proceedings of the Tenth International Conference on Learning Representations, 2022

Video Extrapolation in Space and Time.

[BibT_eX]

[DOI]

Yunzhi Zhang

Proceedings of the Computer Vision - ECCV 2022, 2022

Translating a Visual LEGO Manual to a Machine-Executable Plan.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2022, 2022

Unsupervised Segmentation in Real-World Images via Spelke Object Inference.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2022, 2022

Rotationally Equivariant 3D Object Detection.

[BibT_eX]

[DOI]

Li Yi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Programmatic Concept Learning for Human Motion Description and Synthesis.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Revisiting the "Video" in Video-Language Understanding.

[BibT_eX]

[DOI]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

A Dual Representation Framework for Robot Learning with Human Guidance.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2022

See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2022

BEHAVIOR-1K: A Benchmark for Embodied AI with 1, 000 Everyday Activities and Realistic Simulation.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 2022

2021

SDEdit: Image Synthesis and Editing with Stochastic Differential Equations.

[BibT_eX]

[DOI]

CoRR, 2021

Learning to see the physical world.

[BibT_eX]

[DOI]

AI Matters, 2021

When is particle filtering efficient for planning in partially observed linear dynamical systems?

[BibT_eX]

[DOI]

Proceedings of the Thirty-Seventh Conference on Uncertainty in Artificial Intelligence, 2021

DASH: Modularized Human Manipulation Simulation with Vision and Language for Embodied AI.

[BibT_eX]

[DOI]

Proceedings of the SCA '21: The ACM SIGGRAPH / Eurographics Symposium on Computer Animation, 2021

Grammar-Based Grounded Lexicon Learning.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Temporal and Object Quantification Networks.

[BibT_eX]

[DOI]

Tomer D. Ullman

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, 2021

Unsupervised Discovery of 3D Physical Objects from Video.

[BibT_eX]

[DOI]

Proceedings of the 9th International Conference on Learning Representations, 2021

Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning.

[BibT_eX]

[DOI]

Zhenfang Chen

Kwan-Yee Kenneth Wong

Joshua B. Tenenbaum

Chuang Gan

Proceedings of the 9th International Conference on Learning Representations, 2021

3D Shape Generation and Completion through Point-Voxel Diffusion.

[BibT_eX]

[DOI]

Linqi Zhou

Yilun Du

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Learning Temporal Dynamics from Cycles in Narrated Video.

[BibT_eX]

[DOI]

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Neural Radiance Flow for 4D View Synthesis and Video Processing.

[BibT_eX]

[DOI]

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

De-Rendering the World's Revolutionary Artefacts.

[BibT_eX]

[DOI]

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Repopulating Street Scenes.

[BibT_eX]

[DOI]

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Hierarchical Motion Understanding via Motion Programs.

[BibT_eX]

[DOI]

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control.

[BibT_eX]

[DOI]

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis.

[BibT_eX]

[DOI]

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Single-Shot Scene Reconstruction.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments.

[BibT_eX]

[DOI]

Sanjana Srivastava

Chengshu Li

Michael Lingelbach

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

DiffImpact: Differentiable Rendering and Identification of Impact Sounds.

[BibT_eX]

[DOI]

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks.

[BibT_eX]

[DOI]

Chengshu Li

Fei Xia

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

Language-Mediated, Object-Centric Representation Learning.

[BibT_eX]

[DOI]

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

Augmenting Policy Learning with Routines Discovered from a Single Demonstration.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Augmenting Policy Learning with Routines Discovered from a Demonstration.

[BibT_eX]

[DOI]

CoRR, 2020

Object-Centric Diagnosis of Visual Reasoning.

[BibT_eX]

[DOI]

CoRR, 2020

Object-Centric Neural Scene Rendering.

[BibT_eX]

[DOI]

CoRR, 2020

Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection.

[BibT_eX]

[DOI]

CoRR, 2020

Unsupervised Discovery of 3D Physical Objects from Video.

[BibT_eX]

[DOI]

CoRR, 2020

When is Particle Filtering Efficient for POMDP Sequential Planning?

[BibT_eX]

[DOI]

CoRR, 2020

Learning Generative Models of 3D Structures.

[BibT_eX]

[DOI]

Comput. Graph. Forum, 2020

Multi-Plane Program Induction with 3D Box Priors.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Learning Physical Graph Representations from Visual Scenes.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPs.

[BibT_eX]

[DOI]

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, 2020

Accurate Vision-based Manipulation through Contact Reasoning.

[BibT_eX]

[DOI]

Proceedings of the 2020 IEEE International Conference on Robotics and Automation, 2020

Look, Listen, and Act: Towards Audio-Visual Embodied Navigation.

[BibT_eX]

[DOI]

Proceedings of the 2020 IEEE International Conference on Robotics and Automation, 2020

Visual Grounding of Learned Physical Models.

[BibT_eX]

[DOI]

Proceedings of the 37th International Conference on Machine Learning, 2020

Deep Audio Priors Emerge From Harmonic Convolutional Networks.

[BibT_eX]

[DOI]

Proceedings of the 8th International Conference on Learning Representations, 2020

CLEVRER: Collision Events for Video Representation and Reasoning.

[BibT_eX]

[DOI]

Proceedings of the 8th International Conference on Learning Representations, 2020

Learning Compositional Koopman Operators for Model-Based Control.

[BibT_eX]

[DOI]

Proceedings of the 8th International Conference on Learning Representations, 2020

Probabilistic Video Prediction From Noisy Data With a Posterior Confidence.

[BibT_eX]

[DOI]

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

End-to-End Optimization of Scene Layout.

[BibT_eX]

[DOI]

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

Perspective Plane Program Induction From a Single Image.

[BibT_eX]

[DOI]

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

Learning 3D Dynamic Scene Representations for Robot Manipulation.

[BibT_eX]

[DOI]

Proceedings of the 4th Conference on Robot Learning, 2020

The fine structure of surprise in intuitive physics: when, why, and how much?

[BibT_eX]

[DOI]

Proceedings of the 42th Annual Meeting of the Cognitive Science Society, 2020

2019

See, feel, act: Hierarchical learning for complex manipulation skills with multisensory fusion.

[BibT_eX]

[DOI]

Sci. Robotics, 2019

Visual Dynamics: Stochastic Future Generation via Layered Cross Convolutional Networks.

[BibT_eX]

[DOI]

IEEE Trans. Pattern Anal. Mach. Intell., 2019

Video Enhancement with Task-Oriented Flow.

[BibT_eX]

[DOI]

Int. J. Comput. Vis., 2019

Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs.

[BibT_eX]

[DOI]

CoRR, 2019

DensePhysNet: Learning Dense Physical Object Representations Via Multi-Step Dynamic Interactions.

[BibT_eX]

[DOI]

Proceedings of the Robotics: Science and Systems XV, 2019

Modeling Expectation Violation in Intuitive Physics with Coarse Probabilistic Object Representations.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Visual Concept-Metaconcept Learning.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Propagation Networks for Model-Based Control Under Partial Observation.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Robotics and Automation, 2019

ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Robotics.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Robotics and Automation, 2019

Combining Physical Simulators and Object-Based Networks for Control.

[BibT_eX]

[DOI]

Proceedings of the International Conference on Robotics and Automation, 2019

Neurally-Guided Structure Inference.

[BibT_eX]

[DOI]

Proceedings of the 36th International Conference on Machine Learning, 2019

Unsupervised Discovery of Parts, Structure, and Dynamics.

[BibT_eX]

[DOI]

Proceedings of the 7th International Conference on Learning Representations, 2019

Learning to Infer and Execute 3D Shape Programs.

[BibT_eX]

[DOI]

Proceedings of the 7th International Conference on Learning Representations, 2019

Stochastic Prediction of Multi-Agent Interactions from Partial Observations.

[BibT_eX]

[DOI]

Proceedings of the 7th International Conference on Learning Representations, 2019

The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision.

[BibT_eX]

[DOI]

Proceedings of the 7th International Conference on Learning Representations, 2019

Learning to Describe Scenes with Programs.

[BibT_eX]

[DOI]

Proceedings of the 7th International Conference on Learning Representations, 2019

Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids.

[BibT_eX]

[DOI]

Proceedings of the 7th International Conference on Learning Representations, 2019

Reasoning About Physical Interactions with Object-Oriented Prediction and Planning.

[BibT_eX]

[DOI]

Proceedings of the 7th International Conference on Learning Representations, 2019

Program-Guided Image Manipulators.

[BibT_eX]

[DOI]

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

Entity Abstraction in Visual Model-Based Reinforcement Learning.

[BibT_eX]

[DOI]

Proceedings of the 3rd Annual Conference on Robot Learning, 2019

Real-time inference of physical properties in dynamic scenes.

[BibT_eX]

[DOI]

Proceedings of the 41th Annual Meeting of the Cognitive Science Society, 2019

2018

3D Interpreter Networks for Viewer-Centered Wireframe Modeling.

[BibT_eX]

[DOI]

Int. J. Comput. Vis., 2018

Learning Sight from Sound: Ambient Sound Provides Supervision for Visual Learning.

[BibT_eX]

[DOI]

Int. J. Comput. Vis., 2018

Visual Object Networks: Image Generation with Disentangled 3D Representation.

[BibT_eX]

[DOI]

CoRR, 2018

MoSculp: Interactive Visualization of Shape and Time.

[BibT_eX]

[DOI]

Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, 2018

Unsupervised Learning of Latent Physical Properties Using Perception-Prediction Networks.

[BibT_eX]

[DOI]

Proceedings of the Thirty-Fourth Conference on Uncertainty in Artificial Intelligence, 2018

Visual Object Networks: Image Generation with Disentangled 3D Representations.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Learning to Reconstruct Shapes from Unseen Classes.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

3D-Aware Scene Manipulation via Inverse Graphics.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Learning to Exploit Stability for 3D Scene Parsing.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

3D Shape Perception from Monocular Vision, Touch, and Shape Priors.

[BibT_eX]

[DOI]

Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2018

Augmenting Physical Simulators with Stochastic Neural Networks: Case Study of Planar Pushing and Bouncing.

[BibT_eX]

[DOI]

Joshua B. Tenenbaum

Alberto Rodriguez

Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2018

Seeing Tree Structure from Vibration.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2018, 2018

Learning Shape Priors for Single-View 3D Completion And Reconstruction.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2018, 2018

Physical Primitive Decomposition.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2018, 2018

Inverting Audio-Visual Simulation for Shape and Material Perception.

[BibT_eX]

[DOI]

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018

Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling.

[BibT_eX]

[DOI]

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Attention Clusters: Purely Attention Based Local Feature Integration for Video Classification.

[BibT_eX]

[DOI]

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

2017

Shape and Material from Sound.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Self-Supervised Intrinsic Image Decomposition.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

MarrNet: 3D Shape Reconstruction via 2.5D Sketches.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Learning to See Physics via Visual De-animation.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Generative Modeling of Audible Shapes for Object Perception.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Computer Vision, 2017

Raster-to-Vector: Revisiting Floorplan Transformation.

[BibT_eX]

[DOI]

Proceedings of the IEEE International Conference on Computer Vision, 2017

Synthesizing 3D Shapes via Modeling Multi-view Depth Maps and Silhouettes with Deep Generative Networks.

[BibT_eX]

[DOI]

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

Neural Scene De-rendering.

[BibT_eX]

[DOI]

Joshua B. Tenenbaum

Pushmeet Kohli

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

2016

Deep Multi-Modal Image Correspondence Learning.

[BibT_eX]

[DOI]

CoRR, 2016

Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, 2016

Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, 2016

Ambient Sound Provides Supervision for Visual Learning.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2016, 2016

Single Image 3D Interpreter Network.

[BibT_eX]

[DOI]

Proceedings of the Computer Vision - ECCV 2016, 2016

A Comparative Evaluation of Approximate Probabilistic Simulation and Deep Neural Networks as Accounts of Human Physical Scene Understanding.

[BibT_eX]

[DOI]

Proceedings of the 38th Annual Meeting of the Cognitive Science Society, 2016

Physics 101: Learning Physical Object Properties from Unlabeled Videos.

[BibT_eX]

[DOI]

Proceedings of the British Machine Vision Conference 2016, 2016

2015

Unsupervised Object Class Discovery via Saliency-Guided Multiple Class Learning.

[BibT_eX]

[DOI]

IEEE Trans. Pattern Anal. Mach. Intell., 2015

Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning.

[BibT_eX]

[DOI]

Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, 2015

Deep multiple instance learning for image classification and auto-annotation.

[BibT_eX]

[DOI]

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015

2014

MILCut: A Sweeping Line Multiple Instance Learning Paradigm for Interactive Image Segmentation.

[BibT_eX]

[DOI]

Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014

Harvesting Motion Patterns in Still Images from the Internet.

[BibT_eX]

[DOI]

Proceedings of the 36th Annual Meeting of the Cognitive Science Society, 2014

Reverse Image Segmentation: A High-Level Solution to a Low-Level Task.

[BibT_eX]

[DOI]

Junyan Zhu

Zhuowen Tu

Proceedings of the British Machine Vision Conference, 2014

2013

Harvesting Mid-level Visual Concepts from Large-Scale Internet Images.

[BibT_eX]

[DOI]

Quannan Li