Chuang Gan

According to our database, Chuang Gan authored at least 229 papers between 2013 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

UniMuMo: Unified Text, Music and Motion Generation.

Han Yang, Kun Su, Yutong Zhang, Jiaben Chen, Kaizhi Qian, Gaowen Liu, Chuang Gan

CoRR, 2024

Compositional Physical Reasoning of Objects and Events from Videos.

Zhenfang Chen, Shilong Dong, Kexin Yi, Yunzhu Li, Mingyu Ding, Antonio Torralba, Joshua B. Tenenbaum, Chuang Gan

CoRR, 2024

Disentangled Acoustic Fields For Multimodal Physical Scene Understanding.

Jie Yin, Andrew Luo, Yilun Du, Anoop Cherian, Tim K. Marks, Jonathan Le Roux, Chuang Gan

CoRR, 2024

ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs.

Irene Huang, Wei Lin, Muhammad Jehanzeb Mirza, Jacob A. Hansen, Sivan Doveh, Victor Ion Butoi, Roei Herzig, Assaf Arbelle, Hilde Kuehne, Trevor Darrell, Chuang Gan, Aude Oliva, Rogério Feris, Leonid Karlinsky

CoRR, 2024

CoNav: A Benchmark for Human-Centered Collaborative Navigation.

Changhao Li, Xinyu Sun, Peihao Chen, Jugang Fan, Zixu Wang, Yanxia Liu, Jin-Hui Zhu, Chuang Gan, Mingkui Tan

CoRR, 2024

Physically Compatible 3D Object Modeling from a Single Image.

Minghao Guo, Bohan Wang, Pingchuan Ma, Tianyuan Zhang, Crystal Elaine Owens, Chuang Gan, Joshua B. Tenenbaum, Kaiming He, Wojciech Matusik

CoRR, 2024

RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text.

Jiaben Chen, Xin Yan, Yihang Chen, Siyuan Cen, Qinwei Ma, Haoyu Zhen, Kaizhi Qian, Lie Lu, Chuang Gan

CoRR, 2024

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving.

Yujun Lin, Haotian Tang, Shang Yang, Zhekai Zhang, Guangxuan Xiao, Chuang Gan, Song Han

CoRR, 2024

Virtual Foundry Graphnet for Metal Sintering Deformation Prediction.

Rachel Chen, Juheon Lee, Chuang Gan, Zijiang Yang, Mohammad Amin Nabian, Jun Zeng

CoRR, 2024

COMBO: Compositional World Models for Embodied Multi-Agent Cooperation.

Hongxin Zhang, Zeyuan Wang, Qiushi Lyu, Zheyuan Zhang, Sunli Chen, Tianmin Shu, Yilun Du, Chuang Gan

CoRR, 2024

Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision.

Zhiqing Sun, Longhui Yu, Yikang Shen, Weiyang Liu, Yiming Yang, Sean Welleck, Chuang Gan

CoRR, 2024

Improving Reinforcement Learning from Human Feedback with Efficient Reward Model Ensemble.

Shun Zhang, Zhenfang Chen, Sunli Chen, Yikang Shen, Zhiqing Sun, Chuang Gan

CoRR, 2024

AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration.

Ji Lin, Jiaming Tang, Haotian Tang, Shang Yang, Wei-Ming Chen, Wei-Chen Wang, Guangxuan Xiao, Xingyu Dang, Chuang Gan, Song Han

Proceedings of the Seventh Annual Conference on Machine Learning and Systems, 2024

ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning.

Qiao Gu, Ali Kuwajerwala, Sacha Morin, Krishna Murthy Jatavallabhula, Bipasha Sen, Aditya Agarwal, Corban Rivera, William Paul, Kirsty Ellis, Rama Chellappa, Chuang Gan, Celso Miguel de Melo, Joshua B. Tenenbaum, Antonio Torralba, Florian Shkurti, Liam Paull

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

RoboDreamer: Learning Compositional World Models for Robot Imagination.

Siyuan Zhou, Yilun Du, Jiaben Chen, Yandong Li, Dit-Yan Yeung, Chuang Gan

Proceedings of the Forty-first International Conference on Machine Learning, 2024

ContPhy: Continuum Physical Concept Learning and Reasoning from Videos.

Zhicheng Zheng, Xin Yan, Zhenfang Chen, Jingzhou Wang, Qin Zhi Eddie Lim, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the Forty-first International Conference on Machine Learning, 2024

3D-VLA: A 3D Vision-Language-Action Generative World Model.

Haoyu Zhen, Xiaowen Qiu, Peihao Chen, Jincheng Yang, Xin Yan, Yilun Du, Yining Hong, Chuang Gan

Proceedings of the Forty-first International Conference on Machine Learning, 2024

RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation.

Yufei Wang, Zhou Xian, Feng Chen, Tsun-Hsuan Wang, Yian Wang, Katerina Fragkiadaki, Zackory Erickson, David Held, Chuang Gan

Proceedings of the Forty-first International Conference on Machine Learning, 2024

LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery.

Pingchuan Ma, Tsun-Hsuan Wang, Minghao Guo, Zhiqing Sun, Joshua B. Tenenbaum, Daniela Rus, Chuang Gan, Wojciech Matusik

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Speech Self-Supervised Learning Using Diffusion Model Synthetic Data.

Heting Gao, Kaizhi Qian, Junrui Ni, Chuang Gan, Mark A. Hasegawa-Johnson, Shiyu Chang, Yang Zhang

Proceedings of the Forty-first International Conference on Machine Learning, 2024

HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments.

Qinhong Zhou, Sunli Chen, Yisong Wang, Haozhe Xu, Weihua Du, Hongxin Zhang, Yilun Du, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Building Cooperative Embodied Agents Modularly with Large Language Models.

Hongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou, Yilun Du, Joshua B. Tenenbaum, Tianmin Shu, Chuang Gan

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Thin-Shell Object Manipulations With Differentiable Physics Simulations.

Yian Wang, Juntian Zheng, Zhehuan Chen, Zhou Xian, Gu Zhang, Chao Liu, Chuang Gan

Proceedings of the Twelfth International Conference on Learning Representations, 2024

SALMON: Self-Alignment with Instructable Reward Models.

Zhiqing Sun, Yikang Shen, Hongxin Zhang, Qinhong Zhou, Zhenfang Chen, David Daniel Cox, Yiming Yang, Chuang Gan

Proceedings of the Twelfth International Conference on Learning Representations, 2024

DIFFTACTILE: A Physics-based Differentiable Tactile Simulator for Contact-rich Robotic Manipulation.

Zilin Si, Gu Zhang, Qingwei Ben, Branden Romero, Zhou Xian, Chao Liu, Chuang Gan

Proceedings of the Twelfth International Conference on Learning Representations, 2024

CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding.

Junyan Li, Delin Chen, Yining Hong, Zhenfang Chen, Peihao Chen, Yikang Shen, Chuang Gan

Proceedings of the Twelfth International Conference on Learning Representations, 2024

GENOME: Generative Neuro-Symbolic Visual Reasoning by Growing and Reusing Modules.

Zhenfang Chen, Rui Sun, Wenjun Liu, Yining Hong, Chuang Gan

Proceedings of the Twelfth International Conference on Learning Representations, 2024

FlexAttention for Efficient High-Resolution Vision-Language Models.

Junyan Li, Delin Chen, Tianle Cai, Peihao Chen, Yining Hong, Zhenfang Chen, Yikang Shen, Chuang Gan

Proceedings of the Computer Vision - ECCV 2024, 2024

RILA: Reflective and Imaginative Language Agent for Zero-Shot Semantic Audio-Visual Navigation.

Zeyuan Yang, Jiageng Lin, Peihao Chen, Anoop Cherian, Tim K. Marks, Jonathan Le Roux, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge.

Andong Wang, Bo Wu, Sunli Chen, Zhenfang Chen, Haotian Guan, Wei-Ning Lee, Li Erran Li, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance.

Phuc D. A. Nguyen, Tuan Duc Ngo, Evangelos Kalogerakis, Chuang Gan, Anh Tuan Tran, Cuong Pham, Khoi Nguyen

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World.

Yining Hong, Zishuo Zheng, Peihao Chen, Yian Wang, Junyan Li, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Multi-Agent Alternate Q-Learning.

Kefan Su, Siyuan Zhou, Jiechuan Jiang, Chuang Gan, Xiangjun Wang, Zongqing Lu

Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems, 2024

Aligning Large Multimodal Models with Factually Augmented RLHF.

Zhiqing Sun, Sheng Shen, Shengcao Cao, Haotian Liu, Chunyuan Li, Yikang Shen, Chuang Gan, Liangyan Gui, Yu-Xiong Wang, Yiming Yang, Kurt Keutzer, Trevor Darrell

Proceedings of the Findings of the Association for Computational Linguistics, 2024

Visual Chain-of-Thought Prompting for Knowledge-Based Visual Reasoning.

Zhenfang Chen, Qinhong Zhou, Yikang Shen, Yining Hong, Zhiqing Sun, Dan Gutfreund, Chuang Gan

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Bird-Count: a multi-modality benchmark and system for bird population counting in the wild.

Hongchang Wang, Huaxiang Lu, Huimin Guo, Haifang Jian, Chuang Gan, Wu Liu

Multim. Tools Appl., December, 2023

TransCenter: Transformers With Dense Representations for Multiple-Object Tracking.

Yihong Xu, Yutong Ban, Guillaume Delorme, Chuang Gan, Daniela Rus, Xavier Alameda-Pineda

IEEE Trans. Pattern Anal. Mach. Intell., June, 2023

Self-supervised audiovisual representation learning for remote sensing data.

Konrad Heidler, Lichao Mou, Di Hu, Pu Jin, Guangyao Li, Chuang Gan, Ji-Rong Wen, Xiao Xiang Zhu

Int. J. Appl. Earth Obs. Geoinformation, February, 2023

DCIR: Dynamic Consistency Intrinsic Reward for Multi-Agent Reinforcement Learning.

Kunyang Lin, Yufeng Wang, Peihao Chen, Runhao Zeng, Siyuan Zhou, Mingkui Tan, Chuang Gan

CoRR, 2023

RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation.

Yufei Wang, Zhou Xian, Feng Chen, Tsun-Hsuan Wang, Yian Wang, Zackory Erickson, David Held, Chuang Gan

CoRR, 2023

Autonomous Tree-search Ability of Large Language Models.

Zheyu Zhang, Zhuorui Ye, Yikang Shen, Chuang Gan

CoRR, 2023

SALMON: Self-Alignment with Principle-Following Reward Models.

Zhiqing Sun, Yikang Shen, Hongxin Zhang, Qinhong Zhou, Zhenfang Chen, David D. Cox, Yiming Yang, Chuang Gan

CoRR, 2023

Generalizable Long-Horizon Manipulations with Large Language Models.

Haoyu Zhou, Mingyu Ding, Weikun Peng, Masayoshi Tomizuka, Lin Shao, Chuang Gan

CoRR, 2023

A²Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models.

Peihao Chen, Xinyu Sun, Hongyan Zhi, Runhao Zeng, Thomas H. Li, Gaowen Liu, Mingkui Tan, Chuang Gan

CoRR, 2023

An Efficient General-Purpose Modular Vision Model via Multi-Task Heterogeneous Training.

Zitian Chen, Mingyu Ding, Yikang Shen, Wei Zhan, Masayoshi Tomizuka, Erik G. Learned-Miller, Chuang Gan

CoRR, 2023

ModuleFormer: Learning Modular Large Language Models From Uncurated Data.

Yikang Shen, Zheyu Zhang, Tianyou Cao, Shawn Tan, Zhenfang Chen, Chuang Gan

CoRR, 2023

SafeDiffuser: Safe Planning with Diffusion Probabilistic Models.

Wei Xiao, Tsun-Hsuan Wang, Chuang Gan, Daniela Rus

CoRR, 2023

EC^2: Emergent Communication for Embodied Control.

Yao Mu, Shunyu Yao, Mingyu Ding, Ping Luo, Chuang Gan

CoRR, 2023

See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning.

Zhenfang Chen, Qinhong Zhou, Yikang Shen, Yining Hong, Hao Zhang, Chuang Gan

CoRR, 2023

ClawSAT: Towards Both Robust and Accurate Code Models.

Jinghan Jia, Shashank Srikant, Tamara Mitrovska, Chuang Gan, Shiyu Chang, Sijia Liu, Una-May O'Reilly

Proceedings of the IEEE International Conference on Software Analysis, 2023

RoboNinja: Learning an Adaptive Cutting Policy for Multi-Material Objects.

Zhenjia Xu, Zhou Xian, Xingyu Lin, Cheng Chi, Zhiao Huang, Chuang Gan, Shuran Song

Proceedings of the Robotics: Science and Systems XIX, Daegu, 2023

Adaptive Online Replanning with Diffusion Models.

Siyuan Zhou, Yilun Du, Shun Zhang, Mengdi Xu, Yikang Shen, Wei Xiao, Dit-Yan Yeung, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

DiffuseBot: Breeding Soft Robots With Physics-Augmented Generative Diffusion Models.

Tsun-Hsuan Johnson Wang, Juntian Zheng, Pingchuan Ma, Yilun Du, Byungchul Kim, Andrew Spielberg, Joshua B. Tenenbaum, Chuang Gan, Daniela Rus

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties.

Hsiao-Yu Tung, Mingyu Ding, Zhenfang Chen, Daniel Bear, Chuang Gan, Josh Tenenbaum, Dan Yamins, Judith E. Fan, Kevin A. Smith

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision.

Zhiqing Sun, Yikang Shen, Qinhong Zhou, Hongxin Zhang, Zhenfang Chen, David D. Cox, Yiming Yang, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics.

Zhiao Huang, Feng Chen, Yewen Pu, Chunru Lin, Hao Su, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

3D-LLM: Injecting the 3D World into Large Language Models.

Yining Hong, Haoyu Zhen, Peihao Chen, Shuhong Zheng, Yilun Du, Zhenfang Chen, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

PockEngine: Sparse and Efficient Fine-tuning in a Pocket.

Ligeng Zhu, Lanxiang Hu, Ji Lin, Wei-Ming Chen, Wei-Chen Wang, Chuang Gan, Song Han

Proceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture, 2023

Deep Masked Graph Matching for Correspondence Identification in Collaborative Perception.

Peng Gao, Qingzhao Zhu, Hongsheng Lu, Chuang Gan, Hao Zhang

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

Reparameterized Policy Learning for Multimodal Trajectory Optimization.

Zhiao Huang, Litian Liang, Zhan Ling, Xuanlin Li, Chuang Gan, Hao Su

Proceedings of the International Conference on Machine Learning, 2023

On the Forward Invariance of Neural ODEs.

Wei Xiao, Tsun-Hsuan Wang, Ramin M. Hasani, Mathias Lechner, Yutong Ban, Chuang Gan, Daniela Rus

Proceedings of the International Conference on Machine Learning, 2023

Learning Neural Constitutive Laws from Motion Observations for Generalizable PDE Dynamics.

Pingchuan Ma, Peter Yichen Chen, Bolei Deng, Joshua B. Tenenbaum, Tao Du, Chuang Gan, Wojciech Matusik

Proceedings of the International Conference on Machine Learning, 2023

Planning with Large Language Models for Code Generation.

Shun Zhang, Zhenfang Chen, Yikang Shen, Mingyu Ding, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Hyper-Decision Transformer for Efficient Online Policy Adaptation.

Mengdi Xu, Yuchen Lu, Yikang Shen, Shun Zhang, Ding Zhao, Chuang Gan

Proceedings of the Eleventh International Conference on Learning Representations, 2023

FluidLab: A Differentiable Environment for Benchmarking Complex Fluid Manipulation.

Zhou Xian, Bo Zhu, Zhenjia Xu, Hsiao-Yu Tung, Antonio Torralba, Katerina Fragkiadaki, Chuang Gan

Proceedings of the Eleventh International Conference on Learning Representations, 2023

SoftZoo: A Soft Robot Co-design Benchmark For Locomotion In Diverse Environments.

Tsun-Hsuan Wang, Pingchuan Ma, Andrew Everett Spielberg, Zhou Xian, Hao Zhang, Joshua B. Tenenbaum, Daniela Rus, Chuang Gan

Proceedings of the Eleventh International Conference on Learning Representations, 2023

PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification.

Xuan Li, Yi-Ling Qiao, Peter Yichen Chen, Krishna Murthy Jatavallabhula, Ming C. Lin, Chenfanfu Jiang, Chuang Gan

Proceedings of the Eleventh International Conference on Learning Representations, 2023

DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics.

Sizhe Li, Zhiao Huang, Tao Chen, Tao Du, Hao Su, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the Eleventh International Conference on Learning Representations, 2023

TextPSG: Panoptic Scene Graph Generation from Textual Descriptions.

Chengyang Zhao, Yikang Shen, Zhenfang Chen, Mingyu Ding, Chuang Gan

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Learning Vision-and-Language Navigation from YouTube Videos.

Kunyang Lin, Peihao Chen, Diwei Huang, Thomas H. Li, Mingkui Tan, Chuang Gan

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

EfficientViT: Lightweight Multi-Scale Attention for High-Resolution Dense Prediction.

Han Cai, Junyan Li, Muyan Hu, Chuang Gan, Song Han

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Enabling Encrypted Delta Compression for Outsourced Storage Systems via Preserving Similarity.

Chuang Gan, Yuchong Hu, Leyan Zhao, Xin Zhao, Pengyu Gong, Wenhao Zhang, Lin Wang, Dan Feng

Proceedings of the 41st IEEE International Conference on Computer Design, 2023

Sparse Universal Transformer.

Shawn Tan, Yikang Shen, Zhenfang Chen, Aaron C. Courville, Chuang Gan

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Masked Motion Encoding for Self-Supervised Video Representation Learning.

Xinyu Sun, Peihao Chen, Liangwei Chen, Changhao Li, Thomas H. Li, Mingkui Tan, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos.

Kun Su, Kaizhi Qian, Eli Shlizerman, Antonio Torralba, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

EC²: Emergent Communication for Embodied Control.

Yao Mu, Shunyu Yao, Mingyu Ding, Ping Luo, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Learning Situation Hyper-Graphs for Video Question Answering.

Aisha Urooj Khan, Hilde Kuehne, Bo Wu, Kim Chheu, Walid Bousselham, Chuang Gan, Niels da Vitoria Lobo, Mubarak Shah

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

3D Concept Learning and Reasoning from Multi-View Images.

Yining Hong, Chunru Lin, Yilun Du, Zhenfang Chen, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention.

Mingyu Ding, Yikang Shen, Lijie Fan, Zhenfang Chen, Zitian Chen, Ping Luo, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners.

Zitian Chen, Yikang Shen, Mingyu Ding, Zhenfang Chen, Hengshuang Zhao, Erik G. Learned-Miller, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

JECC: Commonsense Reasoning Tasks Derived from Interactive Fictions.

Mo Yu, Yi Gu, Xiaoxiao Guo, Yufei Feng, Xiaodan Zhu, Michael A. Greenspan, Murray Campbell, Chuang Gan

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

Text-instance graph: Exploring the relational semantics for text-based visual question answering.

Xiangpeng Li, Bo Wu, Jingkuan Song, Lianli Gao, Pengpeng Zeng, Chuang Gan

Pattern Recognit., 2022

Graph Convolutional Module for Temporal Action Localization in Videos.

Runhao Zeng, Wenbing Huang, Mingkui Tan, Yu Rong, Peilin Zhao, Junzhou Huang, Chuang Gan

IEEE Trans. Pattern Anal. Mach. Intell., 2022

Purely Attention Based Local Feature Integration for Video Classification.

Xiang Long, Gerard de Melo, Dongliang He, Fu Li, Zhizhen Chi, Shilei Wen, Chuang Gan

IEEE Trans. Pattern Anal. Mach. Intell., 2022

TSM: Temporal Shift Module for Efficient and Scalable Video Understanding on Edge Devices.

Ji Lin, Chuang Gan, Kuan Wang, Song Han

IEEE Trans. Pattern Anal. Mach. Intell., 2022

Mod-Squad: Designing Mixture of Experts As Modular Multi-Task Learners.

Zitian Chen, Yikang Shen, Mingyu Ding, Zhenfang Chen, Hengshuang Zhao, Erik G. Learned-Miller, Chuang Gan

CoRR, 2022

Retrospectives on the Embodied AI Workshop.

Matt Deitke, Dhruv Batra, Yonatan Bisk, Tommaso Campari, Angel X. Chang, Devendra Singh Chaplot, Changan Chen, Claudia Pérez-D'Arpino, Kiana Ehsani, Ali Farhadi, Li Fei-Fei, Anthony G. Francis, Chuang Gan, Kristen Grauman, David Hall, Winson Han, Unnat Jain, Aniruddha Kembhavi, Jacob Krantz, Stefan Lee, Chengshu Li, Sagnik Majumder, Oleksandr Maksymets, Roberto Martín-Martín, Roozbeh Mottaghi, Sonia Raychaudhuri, Mike Roberts, Silvio Savarese, Manolis Savva, Mohit Shridhar, Niko Sünderhauf, Andrew Szot, Ben Talbot, Joshua B. Tenenbaum, Jesse Thomason, Alexander Toshev, Joanne Truong, Luca Weihs, Jiajun Wu

CoRR, 2022

M³Video: Masked Motion Modeling for Self-Supervised Video Representation Learning.

Xinyu Sun, Peihao Chen, Liangwei Chen, Thomas H. Li, Mingkui Tan, Chuang Gan

CoRR, 2022

MA2QL: A Minimalist Approach to Fully Decentralized Multi-Agent Reinforcement Learning.

Kefan Su, Siyuan Zhou, Chuang Gan, Xiangjun Wang, Zongqing Lu

CoRR, 2022

EfficientViT: Enhanced Linear Attention for High-Resolution Low-Computation Visual Recognition.

Han Cai, Chuang Gan, Song Han

CoRR, 2022

Certifiably robust interpretation via Rényi differential privacy.

Ao Liu, Xiaoyu Chen, Sijia Liu, Lirong Xia, Chuang Gan

Artif. Intell., 2022

SNAKE: Shape-aware Neural 3D Keypoint Field.

Chengliang Zhong, Peixing You, Xiaoxue Chen, Hao Zhao, Fuchun Sun, Guyue Zhou, Xiaodong Mu, Chuang Gan, Wenbing Huang

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Learning Neural Acoustic Fields.

Andrew F. Luo, Yilun Du, Michael J. Tarr, Josh Tenenbaum, Antonio Torralba, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

3D Concept Grounding on Neural Fields.

Yining Hong, Yilun Du, Chunru Lin, Josh Tenenbaum, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Learning Physical Dynamics with Subequivariant Graph Neural Networks.

Jiaqi Han, Wenbing Huang, Hengbo Ma, Jiachen Li, Josh Tenenbaum, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigation.

Peihao Chen, Dongyu Ji, Kunyang Lin, Runhao Zeng, Thomas H. Li, Mingkui Tan, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Learning Active Camera for Multi-Object Navigation.

Peihao Chen, Dongyu Ji, Kunyang Lin, Weiwen Hu, Wenbing Huang, Thomas H. Li, Mingkui Tan, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

On-Device Training Under 256KB Memory.

Ji Lin, Ligeng Zhu, Wei-Ming Chen, Wei-Chen Wang, Chuang Gan, Song Han

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Gait Recognition in the Wild with Multi-hop Temporal Switch.

Jinkai Zheng, Xinchen Liu, Xiaoyan Gu, Yaoqi Sun, Chuang Gan, Jiyong Zhang, Wu Liu, Chenggang Yan

Proceedings of the MM '22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10, 2022

Noisy Agents: Self-supervised Exploration by Predicting Auditory Events.

Chuang Gan, Xiaoyu Chen, Phillip Isola, Antonio Torralba, Joshua B. Tenenbaum

Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2022

The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark Towards Physically Realistic Embodied AI.

Chuang Gan, Siyuan Zhou, Jeremy Schwartz, Seth Alter, Abhishek Bhandwaldar, Dan Gutfreund, Daniel L. K. Yamins, James J. DiCarlo, Josh H. McDermott, Antonio Torralba, Joshua B. Tenenbaum

Proceedings of the 2022 International Conference on Robotics and Automation, 2022

Prompting Decision Transformer for Few-Shot Policy Generalization.

Mengdi Xu, Yikang Shen, Shun Zhang, Yuchen Lu, Ding Zhao, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the International Conference on Machine Learning, 2022

Linking Emergent and Natural Languages via Corpus Transfer.

Shunyu Yao, Mo Yu, Yang Zhang, Karthik R. Narasimhan, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the Tenth International Conference on Learning Representations, 2022

FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations.

Lingjie Mei, Jiayuan Mao, Ziqi Wang, Chuang Gan, Joshua B. Tenenbaum

Proceedings of the Tenth International Conference on Learning Representations, 2022

DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools.

Xingyu Lin, Zhiao Huang, Yunzhu Li, Joshua B. Tenenbaum, David Held, Chuang Gan

Proceedings of the Tenth International Conference on Learning Representations, 2022

Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics.

Sizhe Li, Zhiao Huang, Tao Du, Hao Su, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the Tenth International Conference on Learning Representations, 2022

ComPhy: Compositional Physical Reasoning of Objects and Events from Videos.

Zhenfang Chen, Kexin Yi, Yunzhu Li, Mingyu Ding, Antonio Torralba, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the Tenth International Conference on Learning Representations, 2022

Network Augmentation for Tiny Deep Learning.

Han Cai, Chuang Gan, Ji Lin, Song Han

Proceedings of the Tenth International Conference on Learning Representations, 2022

RISP: Rendering-Invariant State Predictor with Differentiable Simulation and Rendering for Cross-Domain Parameter Estimation.

Pingchuan Ma, Tao Du, Joshua B. Tenenbaum, Wojciech Matusik, Chuang Gan

Proceedings of the Tenth International Conference on Learning Representations, 2022

Revisiting the Roles of "Text" in Text Games.

Yi Gu, Shunyu Yao, Chuang Gan, Josh Tenenbaum, Mo Yu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Prototype-Guided Continual Adaptation for Class-Incremental Unsupervised Domain Adaptation.

Hongbin Lin, Yifan Zhang, Zhen Qiu, Shuaicheng Niu, Chuang Gan, Yanxia Liu, Mingkui Tan

Proceedings of the Computer Vision - ECCV 2022, 2022

Weakly Supervised Grounding for VQA in Vision-Language Transformers.

Aisha Urooj Khan, Hilde Kuehne, Chuang Gan, Niels da Vitoria Lobo, Mubarak Shah

Proceedings of the Computer Vision - ECCV 2022, 2022

AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentation.

Xueyi Liu, Xiaomeng Xu, Anyi Rao, Chuang Gan, Li Yi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction.

Yining Hong, Kaichun Mo, Li Yi, Leonidas J. Guibas, Antonio Torralba, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Finding Fallen Objects Via Asynchronous Audio-Visual Integration.

Chuang Gan, Yi Gu, Siyuan Zhou, Jeremy Schwartz, Seth Alter, James Traer, Dan Gutfreund, Joshua B. Tenenbaum, Josh H. McDermott, Antonio Torralba

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Planning with Spatial-Temporal Abstraction from Point Clouds for Deformable Object Manipulation.

Xingyu Lin, Carl Qi, Yunchu Zhang, Zhiao Huang, Katerina Fragkiadaki, Yunzhu Li, Chuang Gan, David Held

Proceedings of the Conference on Robot Learning, 2022

Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following.

Mingyu Ding, Yan Xu, Zhenfang Chen, David Daniel Cox, Ping Luo, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the Conference on Robot Learning, 2022

2021

A Real-Time Action Representation With Temporal Encoding and Deep Compression.

Kun Liu, Wu Liu, Huadong Ma, Mingkui Tan, Chuang Gan

IEEE Trans. Circuits Syst. Video Technol., 2021

A novel domain activation mapping-guided network (DA-GNT) for visual tracking.

Zhengzheng Tu, Ajian Zhou, Chuang Gan, Bo Jiang, Amir Hussain, Bin Luo

Neurocomputing, 2021

MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning.

Ji Lin, Wei-Ming Chen, Han Cai, Chuang Gan, Song Han

CoRR, 2021

TSM: Temporal Shift Module for Efficient and Scalable Video Understanding on Edge Device.

Ji Lin, Chuang Gan, Kuan Wang, Song Han

CoRR, 2021

Global Rhythm Style Transfer Without Text Transcriptions.

Kaizhi Qian, Yang Zhang, Shiyu Chang, Jinjun Xiong, Chuang Gan, David D. Cox, Mark Hasegawa-Johnson

CoRR, 2021

Cross-Modal Attention Consistency for Video-Audio Unsupervised Learning.

Shaobo Min, Qi Dai, Hongtao Xie, Chuang Gan, Yongdong Zhang, Jingdong Wang

CoRR, 2021

TransCenter: Transformers with Dense Queries for Multiple-Object Tracking.

Yihong Xu, Yutong Ban, Guillaume Delorme, Chuang Gan, Daniela Rus, Xavier Alameda-Pineda

CoRR, 2021

The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AI.

Chuang Gan, Siyuan Zhou, Jeremy Schwartz, Seth Alter, Abhishek Bhandwaldar, Dan Gutfreund, Daniel L. K. Yamins, James J. DiCarlo, Josh H. McDermott, Antonio Torralba, Joshua B. Tenenbaum

CoRR, 2021

The 1st International Workshop on Machine Reasoning: International Machine Reasoning Conference (MRC 2021).

Yongfeng Zhang, Min Zhang, Hanxiong Chen, Xu Chen, Xianjie Chen, Chuang Gan, Tong Sun, Xin Luna Dong

Proceedings of the WSDM '21, 2021

STAR: A Benchmark for Situated Reasoning in Real-World Videos.

Bo Wu, Shoubin Yu, Zhenfang Chen, Josh Tenenbaum, Chuang Gan

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

Memory-efficient Patch-based Inference for Tiny Deep Learning.

Ji Lin, Wei-Ming Chen, Han Cai, Chuang Gan, Song Han

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoning.

Yining Hong, Li Yi, Josh Tenenbaum, Antonio Torralba, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation.

Chuang Gan, Jeremy Schwartz, Seth Alter, Damian Mrowca, Martin Schrimpf, James Traer, Julian De Freitas, Jonas Kubilius, Abhishek Bhandwaldar, Nick Haber, Megumi Sano, Kuno Kim, Elias Wang, Michael Lingelbach, Aidan Curtis, Kevin T. Feigelis, Daniel Bear, Dan Gutfreund, David D. Cox, Antonio Torralba, James J. DiCarlo, Josh Tenenbaum, Josh H. McDermott, Dan Yamins

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

When does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?

Lijie Fan, Sijia Liu, Pin-Yu Chen, Gaoyuan Zhang, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language.

Mingyu Ding, Zhenfang Chen, Tao Du, Ping Luo, Josh Tenenbaum, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

STST: Spatial-Temporal Specialized Transformer for Skeleton-based Action Recognition.

Yuhan Zhang, Bo Wu, Wen Li, Lixin Duan, Chuang Gan

Proceedings of the MM '21: ACM Multimedia Conference, Virtual Event, China, October 20, 2021

Counterfactual Debiasing Inference for Compositional Action Recognition.

Pengzhan Sun, Bo Wu, Xunsong Li, Wen Li, Lixin Duan, Chuang Gan

Proceedings of the MM '21: ACM Multimedia Conference, Virtual Event, China, October 20, 2021

OPEn: An Open-ended Physics Environment for Learning Without a Task.

Chuang Gan, Abhishek Bhandwaldar, Antonio Torralba, Joshua B. Tenenbaum, Phillip Isola

Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2021

MAGCN: A Multi-Adaptive Graph Convolutional Network for Traffic Forecasting.

Qingyuan Zhan, Guixing Wu, Chuang Gan

Proceedings of the International Joint Conference on Neural Networks, 2021

Temporal and Object Quantification Networks.

Jiayuan Mao, Zhezheng Luo, Chuang Gan, Joshua B. Tenenbaum, Jiajun Wu, Leslie Pack Kaelbling, Tomer D. Ullman

Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, 2021

AGENT: A Benchmark for Core Psychological Reasoning.

Tianmin Shu, Abhishek Bhandwaldar, Chuang Gan, Kevin A. Smith, Shari Liu, Dan Gutfreund, Elizabeth S. Spelke, Joshua B. Tenenbaum, Tomer D. Ullman

Proceedings of the 38th International Conference on Machine Learning, 2021

Global Prosody Style Transfer Without Text Transcriptions.

Kaizhi Qian, Yang Zhang, Shiyu Chang, Jinjun Xiong, Chuang Gan, David D. Cox, Mark Hasegawa-Johnson

Proceedings of the 38th International Conference on Machine Learning, 2021

Adversarial Option-Aware Hierarchical Imitation Learning.

Mingxuan Jing, Wenbing Huang, Fuchun Sun, Xiaojian Ma, Tao Kong, Chuang Gan, Lei Li

Proceedings of the 38th International Conference on Machine Learning, 2021

Learning Task Decomposition with Ordered Memory Policy Network.

Yuchen Lu, Yikang Shen, Siyuan Zhou, Aaron C. Courville, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the 9th International Conference on Learning Representations, 2021

PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics.

Zhiao Huang, Yuanming Hu, Tao Du, Siyuan Zhou, Hao Su, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the 9th International Conference on Learning Representations, 2021

Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning.

Zhenfang Chen, Jiayuan Mao, Jiajun Wu, Kwan-Yee Kenneth Wong, Joshua B. Tenenbaum, Chuang Gan

Proceedings of the 9th International Conference on Learning Representations, 2021

On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning.

Ren Wang, Kaidi Xu, Sijia Liu, Pin-Yu Chen, Tsui-Wei Weng, Chuang Gan, Meng Wang

Proceedings of the 9th International Conference on Learning Representations, 2021

Curious Representation Learning for Embodied Intelligence.

Yilun Du, Chuang Gan, Phillip Isola

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Found a Reason for me? Weakly-supervised Grounded Visual Question Answering using Capsules.

Aisha Urooj Khan, Hilde Kuehne, Kevin Duarte, Chuang Gan, Niels da Vitoria Lobo, Mubarak Shah

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Augmenting Policy Learning with Routines Discovered from a Single Demonstration.

Zelin Zhao, Chuang Gan, Jiajun Wu, Xiaoxiao Guo, Joshua B. Tenenbaum

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

MVFNet: Multi-View Fusion Network for Efficient Video Recognition.

Wenhao Wu, Dongliang He, Tianwei Lin, Fu Li, Chuang Gan, Errui Ding

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning.

Peihao Chen, Deng Huang, Dongliang He, Xiang Long, Runhao Zeng, Shilei Wen, Mingkui Tan, Chuang Gan

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Relation Attention for Temporal Action Localization.

Peihao Chen, Chuang Gan, Guangyao Shen, Wenbing Huang, Runhao Zeng, Mingkui Tan

IEEE Trans. Multim., 2020

Generating Visually Aligned Sound From Videos.

Peihao Chen, Yang Zhang, Mingkui Tan, Hongdong Xiao, Deng Huang, Chuang Gan

IEEE Trans. Image Process., 2020

Augmenting Policy Learning with Routines Discovered from a Demonstration.

Zelin Zhao, Chuang Gan, Jiajun Wu, Xiaoxiao Guo, Joshua B. Tenenbaum

CoRR, 2020

Object-Centric Diagnosis of Visual Reasoning.

Jianwei Yang, Jiayuan Mao, Jiajun Wu, Devi Parikh, David D. Cox, Joshua B. Tenenbaum, Chuang Gan

CoRR, 2020

Synthetic Training for Monocular Human Mesh Recovery.

Yu Sun, Qian Bao, Wu Liu, Wenpeng Gao, Yili Fu, Chuang Gan, Tao Mei

CoRR, 2020

Tiny Transfer Learning: Towards Memory-Efficient On-Device Learning.

Han Cai, Chuang Gan, Ligeng Zhu, Song Han

CoRR, 2020

ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation.

Chuang Gan, Jeremy Schwartz, Seth Alter, Martin Schrimpf, James Traer, Julian De Freitas, Jonas Kubilius, Abhishek Bhandwaldar, Nick Haber, Megumi Sano, Kuno Kim, Elias Wang, Damian Mrowca, Michael Lingelbach, Aidan Curtis, Kevin T. Feigelis, Daniel M. Bear, Dan Gutfreund, David D. Cox, James J. DiCarlo, Josh H. McDermott, Joshua B. Tenenbaum, Daniel L. K. Yamins

CoRR, 2020

Language Guided Networks for Cross-modal Moment Retrieval.

Kun Liu, Xun Yang, Tat-Seng Chua, Huadong Ma, Chuang Gan

CoRR, 2020

MCUNet: Tiny Deep Learning on IoT Devices.

Ji Lin, Wei-Ming Chen, Yujun Lin, John Cohn, Chuang Gan, Song Han

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

TinyTL: Reduce Memory, Not Parameters for Efficient On-Device Learning.

Han Cai, Chuang Gan, Ligeng Zhu, Song Han

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Cross-Modal Relation-Aware Networks for Audio-Visual Event Localization.

Haoming Xu, Runhao Zeng, Qingyao Wu, Mingkui Tan, Chuang Gan

Proceedings of the MM '20: The 28th ACM International Conference on Multimedia, 2020

HUMA'20: 1st International Workshop on Human-Centric Multimedia Analysis.

Wu Liu, Chuang Gan, Jingkuan Song, Dingwen Zhang, Wenbing Huang, John Smith

Proceedings of the MM '20: The 28th ACM International Conference on Multimedia, 2020

Deep Concept-wise Temporal Convolutional Networks for Action Localization.

Xin Li, Tianwei Lin, Xiao Liu, Wangmeng Zuo, Chao Li, Xiang Long, Dongliang He, Fu Li, Shilei Wen, Chuang Gan

Proceedings of the MM '20: The 28th ACM International Conference on Multimedia, 2020

Look, Listen, and Act: Towards Audio-Visual Embodied Navigation.

Chuang Gan, Yiwei Zhang, Jiajun Wu, Boqing Gong, Joshua B. Tenenbaum

Proceedings of the 2020 IEEE International Conference on Robotics and Automation, 2020

Deep Audio Priors Emerge From Harmonic Convolutional Networks.

Zhoutong Zhang, Yunyun Wang, Chuang Gan, Jiajun Wu, Joshua B. Tenenbaum, Antonio Torralba, William T. Freeman

Proceedings of the 8th International Conference on Learning Representations, 2020

CLEVRER: Collision Events for Video Representation and Reasoning.

Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum

Proceedings of the 8th International Conference on Learning Representations, 2020

Once-for-All: Train One Network and Specialize it for Efficient Deployment.

Han Cai, Chuang Gan, Tianzhe Wang, Zhekai Zhang, Song Han

Proceedings of the 8th International Conference on Learning Representations, 2020

Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning.

Xiaoxiao Guo, Mo Yu, Yupeng Gao, Chuang Gan, Murray Campbell, Shiyu Chang

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

DataMix: Efficient Privacy-Preserving Edge-Cloud Inference.

Zhijian Liu, Zhanghao Wu, Chuang Gan, Ligeng Zhu, Song Han

Proceedings of the Computer Vision - ECCV 2020, 2020

Foley Music: Learning to Generate Music from Videos.

Chuang Gan, Deng Huang, Peihao Chen, Joshua B. Tenenbaum, Antonio Torralba

Proceedings of the Computer Vision - ECCV 2020, 2020

Dense Regression Network for Video Grounding.

Runhao Zeng, Haoming Xu, Wenbing Huang, Peihao Chen, Mingkui Tan, Chuang Gan

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

Music Gesture for Visual Sound Separation.

Chuang Gan, Deng Huang, Hang Zhao, Joshua B. Tenenbaum, Antonio Torralba

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

HAT: Hardware-Aware Transformers for Efficient Natural Language Processing.

Hanrui Wang, Zhanghao Wu, Zhijian Liu, Han Cai, Ligeng Zhu, Chuang Gan, Song Han

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

Location-Aware Graph Convolutional Networks for Video Question Answering.

Deng Huang, Peihao Chen, Runhao Zeng, Qing Du, Mingkui Tan, Chuang Gan

Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019

Breaking Winner-Takes-All: Iterative-Winners-Out Networks for Weakly Supervised Temporal Action Localization.

Runhao Zeng, Chuang Gan, Peihao Chen, Wenbing Huang, Qingyao Wu, Mingkui Tan

IEEE Trans. Image Process., 2019

Toward Efficient Action Recognition: Principal Backpropagation for Training Two-Stream Networks.

Wen-bing Huang, Lijie Fan, Mehrtash Harandi, Lin Ma, Huaping Liu, Wei Liu, Chuang Gan

IEEE Trans. Image Process., 2019

TruNet: Short Videos Generation from Long Videos via Story-Preserving Truncation.

Fan Yang, Xiao Liu, Dongliang He, Chuang Gan, Jian Wang, Chao Li, Fu Li, Shilei Wen

CoRR, 2019

Training Kinetics in 15 Minutes: Large-scale Distributed Training on Videos.

Ji Lin, Chuang Gan, Song Han

CoRR, 2019

Once for All: Train One Network and Specialize it for Efficient Deployment.

Han Cai, Chuang Gan, Song Han

CoRR, 2019

Interpreting Adversarial Examples by Activation Promotion and Suppression.

Kaidi Xu, Sijia Liu, Gaoyuan Zhang, Mengshu Sun, Pu Zhao, Quanfu Fan, Chuang Gan, Xue Lin

CoRR, 2019

Cross-channel Communication Networks.

Jianwei Yang, Zhile Ren, Chuang Gan, Hongyuan Zhu, Devi Parikh

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Imitation Learning from Observations by Minimizing Inverse Dynamics Disagreement.

Chao Yang, Xiaojian Ma, Wenbing Huang, Fuchun Sun, Huaping Liu, Junzhou Huang, Chuang Gan

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Visual Concept-Metaconcept Learning.

Chi Han, Jiayuan Mao, Chuang Gan, Josh Tenenbaum, Jiajun Wu

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Facial Image-to-Video Translation by a Hidden Affine Transformation.

Guangyao Shen, Wenbing Huang, Chuang Gan, Mingkui Tan, Junzhou Huang, Wenwu Zhu, Boqing Gong

Proceedings of the 27th ACM International Conference on Multimedia, 2019

Watch, Reason and Code: Learning to Represent Videos Using Program.

Xuguang Duan, Qi Wu, Chuang Gan, Yiwei Zhang, Wenbing Huang, Anton van den Hengel, Wenwu Zhu

Proceedings of the 27th ACM International Conference on Multimedia, 2019

The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision.

Jiayuan Mao, Chuang Gan, Pushmeet Kohli, Joshua B. Tenenbaum, Jiajun Wu

Proceedings of the 7th International Conference on Learning Representations, 2019

Defensive Quantization: When Efficiency Meets Robustness.

Ji Lin, Chuang Gan, Song Han

Proceedings of the 7th International Conference on Learning Representations, 2019

The Sound of Motions.

Hang Zhao, Chuang Gan, Wei-Chiu Ma, Antonio Torralba

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

Graph Convolutional Networks for Temporal Action Localization.

Runhao Zeng, Wenbing Huang, Chuang Gan, Mingkui Tan, Yu Rong, Peilin Zhao, Junzhou Huang

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

TSM: Temporal Shift Module for Efficient Video Understanding.

Ji Lin, Chuang Gan, Song Han

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

Self-Supervised Moving Vehicle Tracking With Stereo Sound.

Chuang Gan, Hang Zhao, Peihao Chen, David D. Cox, Antonio Torralba

Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

Self-supervised Audio-visual Co-segmentation.

Andrew Rouditchenko, Hang Zhao, Chuang Gan, Josh H. McDermott, Antonio Torralba

Proceedings of the IEEE International Conference on Acoustics, 2019

Self-Supervised Segmentation and Source Separation on Videos.

Andrew Rouditchenko, Hang Zhao, Chuang Gan, Josh H. McDermott, Antonio Torralba

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019

Beyond RNNs: Positional Self-Attention with Co-Attention for Video Question Answering.

Xiangpeng Li, Jingkuan Song, Lianli Gao, Xianglong Liu, Wenbing Huang, Xiangnan He, Chuang Gan

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

StNet: Local and Global Spatial-Temporal Modeling for Action Recognition.

Dongliang He, Zhichao Zhou, Chuang Gan, Fu Li, Xiao Liu, Yandong Li, Limin Wang, Shilei Wen

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

Controllable Image-to-Video Translation: A Case Study on Facial Expression Generation.

Lijie Fan, Wenbing Huang, Chuang Gan, Junzhou Huang, Boqing Gong

Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, 2019

2018

Video Captioning with Multi-Faceted Attention.

Xiang Long, Chuang Gan, Gerard de Melo

Trans. Assoc. Comput. Linguistics, 2018

Temporal Shift Module for Efficient Video Understanding.

Ji Lin, Chuang Gan, Song Han

CoRR, 2018

Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding.

Kexin Yi, Jiajun Wu, Chuang Gan, Antonio Torralba, Pushmeet Kohli, Josh Tenenbaum

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Weakly Supervised Dense Event Captioning in Videos.

Xuguang Duan, Wen-bing Huang, Chuang Gan, Jingdong Wang, Wenwu Zhu, Junzhou Huang

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Unsupervised Domain Adaptation for 3D Keypoint Estimation via View Consistency.

Xingyi Zhou, Arjun Karpur, Chuang Gan, Linjie Luo, Qixing Huang

Proceedings of the Computer Vision - ECCV 2018, 2018

The Sound of Pixels.

Hang Zhao, Chuang Gan, Andrew Rouditchenko, Carl Vondrick, Josh H. McDermott, Antonio Torralba

Proceedings of the Computer Vision - ECCV 2018, 2018

Attention Clusters: Purely Attention Based Local Feature Integration for Video Classification.

Xiang Long, Chuang Gan, Gerard de Melo, Jiajun Wu, Xiao Liu, Shilei Wen

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Geometry Guided Convolutional Neural Networks for Self-Supervised Video Representation Learning.

Chuang Gan, Boqing Gong, Kun Liu, Hao Su, Leonidas J. Guibas

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

End-to-End Learning of Motion Representation for Video Understanding.

Lijie Fan, Wen-bing Huang, Chuang Gan, Stefano Ermon, Boqing Gong, Junzhou Huang

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Sparse, Smart Contours to Represent and Edit Images.

Tali Dekel, Chuang Gan, Dilip Krishnan, Ce Liu, William T. Freeman

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Multimodal Keyless Attention Fusion for Video Classification.

Xiang Long, Chuang Gan, Gerard de Melo, Xiao Liu, Yandong Li, Fu Li, Shilei Wen

Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, 2018

T-C3D: Temporal Convolutional 3D Network for Real-Time Action Recognition.

Kun Liu, Wu Liu, Chuang Gan, Mingkui Tan, Huadong Ma

Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, 2018

2017

A Multisource Domain Generalization Approach to Visual Attribute Detection.

Chuang Gan, Tianbao Yang, Boqing Gong

Proceedings of the Domain Adaptation in Computer Vision Applications., 2017

Smart, Sparse Contours to Represent and Edit Images.

Tali Dekel, Chuang Gan, Dilip Krishnan, Ce Liu, William T. Freeman

CoRR, 2017

Unsupervised Domain Adaptation for 3D Keypoint Prediction from a Single Depth Scan.

Xingyi Zhou, Arjun Karpur, Chuang Gan, Linjie Luo, Qixing Huang

CoRR, 2017

Revisiting the Effectiveness of Off-the-shelf Temporal Modeling Approaches for Large-scale Video Classification.

Yunlong Bian, Chuang Gan, Xiao Liu, Fu Li, Xiang Long, Yandong Li, Heng Qi, Jie Zhou, Shilei Wen, Yuanqing Lin

CoRR, 2017

Temporal Modeling Approaches for Large-scale Youtube-8M Video Understanding.

Fu Li, Chuang Gan, Xiao Liu, Yunlong Bian, Xiang Long, Yandong Li, Zhichao Li, Jie Zhou, Shilei Wen

CoRR, 2017

Recurrent Topic-Transition GAN for Visual Paragraph Generation.

Xiaodan Liang, Zhiting Hu, Hao Zhang, Chuang Gan, Eric P. Xing

Proceedings of the IEEE International Conference on Computer Vision, 2017

VQS: Linking Segmentations to Questions and Answers for Supervised Attention in VQA and Question-Focused Semantic Segmentation.

Chuang Gan, Yandong Li, Haoxiang Li, Chen Sun, Boqing Gong

Proceedings of the IEEE International Conference on Computer Vision, 2017

Semantic Compositional Networks for Visual Captioning.

Zhe Gan, Chuang Gan, Xiaodong He, Yunchen Pu, Kenneth Tran, Jianfeng Gao, Lawrence Carin, Li Deng

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

StyleNet: Generating Attractive Visual Captions with Styles.

Chuang Gan, Zhe Gan, Xiaodong He, Jianfeng Gao, Li Deng

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

DECK: Discovering Event Composition Knowledge from Web Images for Zero-Shot Event Detection and Recounting in Videos.

Chuang Gan, Chen Sun, Ram Nevatia

Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017

2016

Recognizing an Action Using Its Name: A Knowledge-Based Approach.

Chuang Gan, Yi Yang, Linchao Zhu, Deli Zhao, Yueting Zhuang

Int. J. Comput. Vis., 2016

Strategies for Searching Video Content with Text Queries or Video Examples.

Shoou-I Yu, Yi Yang, Zhongwen Xu, Shicheng Xu, Deyu Meng, Zexi Mao, Zhigang Ma, Ming Lin, Xuanchong Li, Huan Li, Zhen-Zhong Lan, Lu Jiang, Alexander G. Hauptmann, Chuang Gan, Xingzhong Du, Xiaojun Chang

CoRR, 2016

Webly-Supervised Video Recognition by Mutually Voting for Relevant Web Images and Web Video Frames.

Chuang Gan, Chen Sun, Lixin Duan, Boqing Gong

Proceedings of the Computer Vision - ECCV 2016, 2016

You Lead, We Exceed: Labor-Free Video Concept Learning by Jointly Exploiting Web Videos and Images.

Chuang Gan, Ting Yao, Kuiyuan Yang, Yi Yang, Tao Mei

Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, 2016

Learning Attributes Equals Multi-Source Domain Generalization.

Chuang Gan, Tianbao Yang, Boqing Gong

Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, 2016

Concepts Not Alone: Exploring Pairwise Relationships for Zero-Shot Video Activity Recognition.

Chuang Gan, Ming C. Lin, Yi Yang, Gerard de Melo, Alexander G. Hauptmann

Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, 2016

2015

CMU Informedia@TRECVID 2015: MED/SIN/LNK/SED.

Shoou-I Yu, Lu Jiang, Zhongwen Xu, Zhenzhong Lan, Shicheng Xu, Xiaojun Chang, Xuanchong Li, Zexi Mao, Chuang Gan, Yajie Miao, Xingzhong Du, Yang Cai, Lara J. Martin, Nikolas Wolfe, Anurag Kumar, Huan Li, Ming Lin, Zhigang Ma, Yi Yang, Deyu Meng, Shiguang Shan, Pinar Duygulu Sahin, Susanne Burger, Florian Metze, Rita Singh, Bhiksha Raj, Teruko Mitamura, Richard M. Stern, Alexander G. Hauptmann

Proceedings of the 2015 TREC Video Retrieval Evaluation, 2015

Automatic Concept Discovery from Parallel Text and Visual Corpora.

Chen Sun, Chuang Gan, Ram Nevatia

Proceedings of the 2015 IEEE International Conference on Computer Vision, 2015

DevNet: A Deep Event Network for multimedia event detection and evidence recounting.

Chuang Gan, Naiyan Wang, Yi Yang, Dit-Yan Yeung, Alexander G. Hauptmann

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015

Exploring Semantic Inter-Class Relationships (SIR) for Zero-Shot Action Recognition.

Chuang Gan, Ming Lin, Yi Yang, Yueting Zhuang, Alexander G. Hauptmann

Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015

2014

Informedia @ TRECVID 2014.

Shoou-I Yu, Lu Jiang, Zhongwen Xu, Zhenzhong Lan, Shicheng Xu, Xiaojun Chang, Xuanchong Li, Zexi Mao, Chuang Gan, Yajie Miao, Xingzhong Du, Yang Cai, Lara J. Martin, Nikolas Wolfe, Anurag Kumar, Huan Li, Ming Lin, Zhigang Ma, Yi Yang, Deyu Meng, Shiguang Shan, Pinar Duygulu Sahin, Susanne Burger, Florian Metze, Rita Singh, Bhiksha Raj, Teruko Mitamura, Richard M. Stern, Alexander G. Hauptmann, Anil Armagan, Yicheng Zhao

Proceedings of the 2014 TREC Video Retrieval Evaluation, 2014

2013

Salient object detection in image sequences via spatial-temporal cue.

Chuang Gan, Zengchang Qin, Jia Xu, Tao Wan

Proceedings of the 2013 Visual Communications and Image Processing, 2013