Jiasen Lu

According to our database, Jiasen Lu authored at least 34 papers between 2011 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

MM-Ego: Towards Building Egocentric Multimodal LLMs.

Hanrong Ye, Haotian Zhang, Erik A. Daxberger, Lin Chen, Zongyu Lin, Yanghao Li, Bowen Zhang, Haoxuan You, Dan Xu, Zhe Gan, Jiasen Lu, Yinfei Yang

CoRR, 2024

Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Multimodal Models.

Matt Deitke, Christopher Clark, Sangho Lee, Rohun Tripathi, Yue Yang, Jae Sung Park, Mohammadreza Salehi, Niklas Muennighoff, Kyle Lo, Luca Soldaini, Jiasen Lu, Taira Anderson, Erin Bransom, Kiana Ehsani, Huong Ngo, Yen-Sung Chen, Ajay Patel, Mark Yatskar, Chris Callison-Burch, Andrew Head, Rose Hendrix, Favyen Bastani, Eli VanderBilt, Nathan Lambert, Yvonne Chou, Arnavi Chheda, Jenna Sparks, Sam Skjonsberg, Michael Schmitz, Aaron Sarnat, Byron Bischoff, Pete Walsh, Chris Newell, Piper Wolters, Tanmay Gupta, Kuo-Hao Zeng, Jon Borchardt, Dirk Groeneveld, Jen Dumas, Crystal Nam, Sophie Lebrecht, Caitlin Wittlif, Carissa Schoenick, Oscar Michel, Ranjay Krishna, Luca Weihs, Noah A. Smith, Hannaneh Hajishirzi, Ross B. Girshick, Ali Farhadi, Aniruddha Kembhavi

CoRR, 2024

SoupLM: Model Integration in Large Language and Multi-Modal Models.

Yue Bai, Zichen Zhang, Jiasen Lu, Yun Fu

CoRR, 2024

Preserving Identity with Variational Score for General-purpose 3D Editing.

Duong H. Le, Tuan Pham, Aniruddha Kembhavi, Stephan Mandt, Wei-Chiu Ma, Jiasen Lu

CoRR, 2024

Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action.

Jiasen Lu, Christopher Clark, Sangho Lee, Zichen Zhang, Savya Khosla, Ryan Marten, Derek Hoiem, Aniruddha Kembhavi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

Cross-Domain Graph Convolutions for Adversarial Unsupervised Domain Adaptation.

Ronghang Zhu, Xiaodong Jiang, Jiasen Lu, Sheng Li

IEEE Trans. Neural Networks Learn. Syst., August, 2023

UNIFIED-IO: A Unified Model for Vision, Language, and Multi-modal Tasks.

Jiasen Lu, Christopher Clark, Rowan Zellers, Roozbeh Mottaghi, Aniruddha Kembhavi

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

ASC me to Do Anything: Multi-task Training for Embodied AI.

Jiasen Lu, Jordi Salvador, Roozbeh Mottaghi, Aniruddha Kembhavi

CoRR, 2022

MERLOT RESERVE: Neural Script Knowledge through Vision and Language and Sound.

Rowan Zellers, Jiasen Lu, Ximing Lu, Youngjae Yu, Yanpeng Zhao, Mohammadreza Salehi, Aditya Kusupati, Jack Hessel, Ali Farhadi, Yejin Choi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Multi-Modal Answer Validation for Knowledge-Based VQA.

Jialin Wu, Jiasen Lu, Ashish Sabharwal, Roozbeh Mottaghi

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

A Simple Long-Tailed Recognition Baseline via Vision-Language Model.

Teli Ma, Shijie Geng, Mengmeng Wang, Jing Shao, Jiasen Lu, Hongsheng Li, Peng Gao, Yu Qiao

CoRR, 2021

Container: Context Aggregation Network.

Peng Gao, Jiasen Lu, Hongsheng Li, Roozbeh Mottaghi, Aniruddha Kembhavi

CoRR, 2021

Container: Context Aggregation Networks.

Peng Gao, Jiasen Lu, Hongsheng Li, Roozbeh Mottaghi, Aniruddha Kembhavi

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Transferable Feature Learning on Graphs Across Visual Domains.

Ronghang Zhu, Xiaodong Jiang, Jiasen Lu, Sheng Li

Proceedings of the 2021 IEEE International Conference on Multimedia and Expo, 2021

2020

Visually Grounded Language Understanding and Generation.

Jiasen Lu

PhD thesis, 2020

Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data.

Michael Cogswell, Jiasen Lu, Rishabh Jain, Stefan Lee, Devi Parikh, Dhruv Batra

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers.

Jaemin Cho, Jiasen Lu, Dustin Schwenk, Hannaneh Hajishirzi, Aniruddha Kembhavi

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

Spatially Aware Multimodal Transformers for TextVQA.

Yash Kant, Dhruv Batra, Peter Anderson, Alexander G. Schwing, Devi Parikh, Jiasen Lu, Harsh Agrawal

Proceedings of the Computer Vision - ECCV 2020, 2020

12-in-1: Multi-Task Vision and Language Representation Learning.

Jiasen Lu, Vedanuj Goswami, Marcus Rohrbach, Devi Parikh, Stefan Lee

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

2019

Emergence of Compositional Language with Deep Generational Transmission.

Michael Cogswell, Jiasen Lu, Stefan Lee, Devi Parikh, Dhruv Batra

CoRR, 2019

ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks.

Jiasen Lu, Dhruv Batra, Devi Parikh, Stefan Lee

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Self-Monitoring Navigation Agent via Auxiliary Progress Estimation.

Chih-Yao Ma, Jiasen Lu, Zuxuan Wu, Ghassan AlRegib, Zsolt Kira, Richard Socher, Caiming Xiong

Proceedings of the 7th International Conference on Learning Representations, 2019

2018

Graph R-CNN for Scene Graph Generation.

Jianwei Yang, Jiasen Lu, Stefan Lee, Dhruv Batra, Devi Parikh

Proceedings of the Computer Vision - ECCV 2018, 2018

Neural Baby Talk.

Jiasen Lu, Jianwei Yang, Dhruv Batra, Devi Parikh

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition.

Jianwei Yang, Jiasen Lu, Stefan Lee, Dhruv Batra, Devi Parikh

Proceedings of the 2nd Annual Conference on Robot Learning, 2018

2017

VQA: Visual Question Answering - www.visualqa.org.

Aishwarya Agrawal, Jiasen Lu, Stanislaw Antol, Margaret Mitchell, C. Lawrence Zitnick, Devi Parikh, Dhruv Batra

Int. J. Comput. Vis., 2017

Best of Both Worlds: Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model.

Jiasen Lu, Anitha Kannan, Jianwei Yang, Devi Parikh, Dhruv Batra

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

ParlAI: A Dialog Research Software Platform.

Alexander H. Miller, Will Feng, Dhruv Batra, Antoine Bordes, Adam Fisch, Jiasen Lu, Devi Parikh, Jason Weston

Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017

Knowing When to Look: Adaptive Attention via a Visual Sentinel for Image Captioning.

Jiasen Lu, Caiming Xiong, Devi Parikh, Richard Socher

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

2016

Hierarchical Question-Image Co-Attention for Visual Question Answering.

Jiasen Lu, Jianwei Yang, Dhruv Batra, Devi Parikh

Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, 2016

2015

VQA: Visual Question Answering.

Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, Devi Parikh

Proceedings of the 2015 IEEE International Conference on Computer Vision, 2015

Human action segmentation with hierarchical supervoxel consistency.

Jiasen Lu, Ran Xu, Jason J. Corso

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015

2012

Palmprint and Face Multi-Modal Biometric Recognition Based on SDA-GSVD and Its Kernelization.

Xiao-Yuan Jing, Sheng Li, Wen-Qian Li, Yong-Fang Yao, Chao Lan, Jiasen Lu, Jing-Yu Yang

Sensors, 2012

2011

Supervised local sparsity preserving projection for face feature extraction.

Xiao-Yuan Jing, Sheng Li, Songhao Zhu, Qian Liu, Jingyu Yang, Jiasen Lu

Proceedings of the First Asian Conference on Pattern Recognition, 2011