Ran Xu

According to our database, Ran Xu authored at least 52 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

xGen-MM-Vid (BLIP-3-Video): You Only Need 32 Tokens to Represent a Video Even in VLMs.

Michael S. Ryoo, Honglu Zhou, Shrikant Kendre, Can Qin, Le Xue, Manli Shu, Silvio Savarese, Ran Xu, Caiming Xiong, Juan Carlos Niebles

CoRR, 2024

Trust but Verify: Programmatic VLM Evaluation in the Wild.

Viraj Prabhu, Senthil Purushwalkam, An Yan, Caiming Xiong, Ran Xu

CoRR, 2024

xLAM: A Family of Large Action Models to Empower AI Agent Systems.

Jianguo Zhang, Tian Lan, Ming Zhu, Zuxin Liu, Thai Hoang, Shirley Kokane, Weiran Yao, Juntao Tan, Akshara Prabhakar, Haolin Chen, Zhiwei Liu, Yihao Feng, Tulika Manoj Awalgaonkar, Rithesh Murthy, Eric Hu, Zeyuan Chen, Ran Xu, Juan Carlos Niebles, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong

CoRR, 2024

xGen-VideoSyn-1: High-fidelity Text-to-Video Synthesis with Compressed Representations.

Can Qin, Congying Xia, Krithika Ramakrishnan, Michael S. Ryoo, Lifu Tu, Yihao Feng, Manli Shu, Honglu Zhou, Anas Awadalla, Jun Wang, Senthil Purushwalkam, Le Xue, Yingbo Zhou, Huan Wang, Silvio Savarese, Juan Carlos Niebles, Zeyuan Chen, Ran Xu, Caiming Xiong

CoRR, 2024

xGen-MM (BLIP-3): A Family of Open Large Multimodal Models.

Le Xue, Manli Shu, Anas Awadalla, Jun Wang, An Yan, Senthil Purushwalkam, Honglu Zhou, Viraj Prabhu, Yutong Dai, Michael S. Ryoo, Shrikant Kendre, Jieyu Zhang, Can Qin, Shu Zhang, Chia-Chih Chen, Ning Yu, Juntao Tan, Tulika Manoj Awalgaonkar, Shelby Heinecke, Huan Wang, Yejin Choi, Ludwig Schmidt, Zeyuan Chen, Silvio Savarese, Juan Carlos Niebles, Caiming Xiong, Ran Xu

CoRR, 2024

MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens.

Anas Awadalla, Le Xue, Oscar Lo, Manli Shu, Hannah Lee, Etash Kumar Guha, Matt Jordan, Sheng Shen, Mohamed Awadalla, Silvio Savarese, Caiming Xiong, Ran Xu, Yejin Choi, Ludwig Schmidt

CoRR, 2024

MobileAIBench: Benchmarking LLMs and LMMs for On-Device Use Cases.

Rithesh Murthy, Liangwei Yang, Juntao Tan, Tulika Manoj Awalgaonkar, Yilun Zhou, Shelby Heinecke, Sachin Desai, Jason Wu, Ran Xu, Sarah Tan, Jianguo Zhang, Zhiwei Liu, Shirley Kokane, Zuxin Liu, Ming Zhu, Huan Wang, Caiming Xiong, Silvio Savarese

CoRR, 2024

Text2Data: Low-Resource Data Generation with Textual Control.

Shiyu Wang, Yihao Feng, Tian Lan, Ning Yu, Yu Bai, Ran Xu, Huan Wang, Caiming Xiong, Silvio Savarese

CoRR, 2024

TrustLLM: Trustworthiness in Large Language Models.

Lichao Sun, Yue Huang, Haoran Wang, Siyuan Wu, Qihui Zhang, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Zhengliang Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, Bhavya Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Hao Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, Manolis Kellis, Marinka Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, John C. Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, Michael Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, Suman Jana, Tianlong Chen, Tianming Liu, Tianyi Zhou, William Wang, Xiang Li, Xiangliang Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yue Zhao

CoRR, 2024

Hierarchical Point Attention for Indoor 3D Object Detection.

Manli Shu, Le Xue, Ning Yu, Roberto Martín-Martín, Caiming Xiong, Tom Goldstein, Juan Carlos Niebles, Ran Xu

Proceedings of the IEEE International Conference on Robotics and Automation, 2024

Position: TrustLLM: Trustworthiness in Large Language Models.

Yue Huang, Lichao Sun, Haoran Wang, Siyuan Wu, Qihui Zhang, Yuan Li, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Hanchi Sun, Zhengliang Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, Bertie Vidgen, Bhavya Kailkhura, Caiming Xiong, Chaowei Xiao, Chunyuan Li, Eric P. Xing, Furong Huang, Hao Liu, Heng Ji, Hongyi Wang, Huan Zhang, Huaxiu Yao, Manolis Kellis, Marinka Zitnik, Meng Jiang, Mohit Bansal, James Zou, Jian Pei, Jian Liu, Jianfeng Gao, Jiawei Han, Jieyu Zhao, Jiliang Tang, Jindong Wang, Joaquin Vanschoren, John C. Mitchell, Kai Shu, Kaidi Xu, Kai-Wei Chang, Lifang He, Lifu Huang, Michael Backes, Neil Zhenqiang Gong, Philip S. Yu, Pin-Yu Chen, Quanquan Gu, Ran Xu, Rex Ying, Shuiwang Ji, Suman Jana, Tianlong Chen, Tianming Liu, Tianyi Zhou, William Wang, Xiang Li, Xiangliang Zhang, Xiao Wang, Xing Xie, Xun Chen, Xuyu Wang, Yan Liu, Yanfang Ye, Yinzhi Cao, Yong Chen, Yue Zhao

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization.

Weiran Yao, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Yihao Feng, Le Xue, Rithesh R. N., Zeyuan Chen, Jianguo Zhang, Devansh Arpit, Ran Xu, Phil Mui, Huan Wang, Caiming Xiong, Silvio Savarese

Proceedings of the Twelfth International Conference on Learning Representations, 2024

LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer.

Ning Yu, Chia-Chih Chen, Zeyuan Chen, Rui Meng, Gang Wu, Paul Josel, Juan Carlos Niebles, Caiming Xiong, Ran Xu

Proceedings of the Computer Vision - ECCV 2024, 2024

SQ-LLaVA: Self-Questioning for Large Vision-Language Assistant.

Guohao Sun, Can Qin, Jiamian Wang, Zeyuan Chen, Ran Xu, Zhiqiang Tao

Proceedings of the Computer Vision - ECCV 2024, 2024

X-InstructBLIP: A Framework for Aligning Image, 3D, Audio, Video to LLMs and its Emergent Cross-Modal Reasoning.

Artemis Panagopoulou, Le Xue, Ning Yu, Junnan Li, Dongxu Li, Shafiq Joty, Ran Xu, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles

Proceedings of the Computer Vision - ECCV 2024, 2024

ULIP-2: Towards Scalable Multimodal Pre-Training for 3D Understanding.

Le Xue, Ning Yu, Shu Zhang, Artemis Panagopoulou, Junnan Li, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Silvio Savarese

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

HIVE: Harnessing Human Feedback for Instructional Visual Editing.

Shu Zhang, Xinyi Yang, Yihao Feng, Can Qin, Chia-Chih Chen, Ning Yu, Zeyuan Chen, Huan Wang, Silvio Savarese, Stefano Ermon, Caiming Xiong, Ran Xu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

FOFO: A Benchmark to Evaluate LLMs' Format-Following Capability.

Congying Xia, Chen Xing, Jiangshu Du, Xinyi Yang, Yihao Feng, Ran Xu, Wenpeng Yin, Caiming Xiong

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

X-InstructBLIP: A Framework for aligning X-Modal instruction-aware representations to LLMs and Emergent Cross-modal Reasoning.

Artemis Panagopoulou, Le Xue, Ning Yu, Junnan Li, Dongxu Li, Shafiq Joty, Ran Xu, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles

CoRR, 2023

BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents.

Zhiwei Liu, Weiran Yao, Jianguo Zhang, Le Xue, Shelby Heinecke, Rithesh Murthy, Yihao Feng, Zeyuan Chen, Juan Carlos Niebles, Devansh Arpit, Ran Xu, Phil Mui, Huan Wang, Caiming Xiong, Silvio Savarese

CoRR, 2023

Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization.

Weiran Yao, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Yihao Feng, Le Xue, Rithesh Murthy, Zeyuan Chen, Jianguo Zhang, Devansh Arpit, Ran Xu, Phil Mui, Huan Wang, Caiming Xiong, Silvio Savarese

CoRR, 2023

REX: Rapid Exploration and eXploitation for AI Agents.

Rithesh Murthy, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Le Xue, Weiran Yao, Yihao Feng, Zeyuan Chen, Akash Gokul, Devansh Arpit, Ran Xu, Phil Mui, Huan Wang, Caiming Xiong, Silvio Savarese

CoRR, 2023

ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding.

Le Xue, Ning Yu, Shu Zhang, Junnan Li, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Silvio Savarese

CoRR, 2023

Model-Agnostic Hierarchical Attention for 3D Object Detection.

Manli Shu, Le Xue, Ning Yu, Roberto Martín-Martín, Juan Carlos Niebles, Caiming Xiong, Ran Xu

CoRR, 2023

UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild.

Can Qin, Shu Zhang, Ning Yu, Yihao Feng, Xinyi Yang, Yingbo Zhou, Huan Wang, Juan Carlos Niebles, Caiming Xiong, Silvio Savarese, Stefano Ermon, Yun Fu, Ran Xu

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Robustness Evaluation of Transformer-Based Form Field Extractors via Form Attacks.

Le Xue, Mingfei Gao, Zeyuan Chen, Caiming Xiong, Ran Xu

Proceedings of the Document Analysis and Recognition - ICDAR 2023, 2023

GlueGen: Plug and Play Multi-modal Encoders for X-to-image Generation.

Can Qin, Ning Yu, Chen Xing, Shu Zhang, Zeyuan Chen, Stefano Ermon, Yun Fu, Caiming Xiong, Ran Xu

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimation.

Qichen Fu, Xingyu Liu, Ran Xu, Juan Carlos Niebles, Kris M. Kitani

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understanding.

Le Xue, Mingfei Gao, Chen Xing, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Silvio Savarese

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Mask-Free OVIS: Open-Vocabulary Instance Segmentation without Manual Mask Annotations.

Vibashan VS, Ning Yu, Chen Xing, Can Qin, Mingfei Gao, Juan Carlos Niebles, Vishal M. Patel, Ran Xu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Tackling Data Heterogeneity in Federated Learning with Class Prototypes.

Yutong Dai, Zeyuan Chen, Junnan Li, Shelby Heinecke, Lichao Sun, Ran Xu

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

ULIP: Learning Unified Representation of Language, Image and Point Cloud for 3D Understanding.

Le Xue, Mingfei Gao, Chen Xing, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Silvio Savarese

CoRR, 2022

Burn After Reading: Online Adaptation for Cross-domain Streaming Data.

Luyu Yang, Mingfei Gao, Zeyuan Chen, Ran Xu, Abhinav Shrivastava, Chetan Ramaiah

Proceedings of the Computer Vision - ECCV 2022, 2022

Open Vocabulary Object Detection with Pseudo Bounding-Box Labels.

Mingfei Gao, Chen Xing, Juan Carlos Niebles, Junnan Li, Ran Xu, Wenhao Liu, Caiming Xiong

Proceedings of the Computer Vision - ECCV 2022, 2022

Use All The Labels: A Hierarchical Multi-Label Contrastive Learning Framework.

Shu Zhang, Ran Xu, Caiming Xiong, Chetan Ramaiah

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

DocQueryNet: Value Retrieval with Arbitrary Queries for Form-like Documents.

Mingfei Gao, Le Xue, Chetan Ramaiah, Chen Xing, Ran Xu, Caiming Xiong

Proceedings of the 29th International Conference on Computational Linguistics, 2022

TAG: Boosting Text-VQA via Text-aware Visual Question-answer Generation.

Jun Wang, Mingfei Gao, Yuqian Hu, Ramprasaath R. Selvaraju, Chetan Ramaiah, Ran Xu, Joseph F. JáJá, Larry Davis

Proceedings of the 33rd British Machine Vision Conference 2022, 2022

2021

Value Retrieval with Arbitrary Queries for Form-like Documents.

Mingfei Gao, Le Xue, Chetan Ramaiah, Chen Xing, Ran Xu, Caiming Xiong

CoRR, 2021

Towards Open Vocabulary Object Detection without Human-provided Bounding Boxes.

Mingfei Gao, Chen Xing, Juan Carlos Niebles, Junnan Li, Ran Xu, Wenhao Liu, Caiming Xiong

CoRR, 2021

Field Extraction from Forms with Unlabeled Data.

Mingfei Gao, Zeyuan Chen, Nikhil Naik, Kazuma Hashimoto, Caiming Xiong, Ran Xu

CoRR, 2021

Proposal Learning for Semi-Supervised Object Detection.

Peng Tang, Chetan Ramaiah, Yan Wang, Ran Xu, Caiming Xiong

Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 2021

WOAD: Weakly Supervised Online Action Detection in Untrimmed Videos.

Mingfei Gao, Yingbo Zhou, Ran Xu, Richard Socher, Caiming Xiong

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

Proposal Learning for Semi-Supervised Object Detection.

Peng Tang, Chetan Ramaiah, Ran Xu, Caiming Xiong

CoRR, 2020

2019

Context-aware Active Multi-Step Reinforcement Learning.

Gang Chen, Dingcheng Li, Ran Xu

CoRR, 2019

2018

Deep ranking structural support vector machine for image tagging.

Gang Chen, Ran Xu, Zhi Yang

Pattern Recognit. Lett., 2018

2016

Sequential Labeling with Online Deep Learning: Exploring Model Initialization.

Gang Chen, Ran Xu, Sargur N. Srihari

Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2016

2015

Human action segmentation with hierarchical supervoxel consistency.

Jiasen Lu, Ran Xu, Jason J. Corso

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015

Jointly Modeling Deep Video and Compositional Text to Bridge Vision and Language in a Unified Framework.

Ran Xu, Caiming Xiong, Wei Chen, Jason J. Corso

Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015

2014

Compositional Structure Learning for Action Understanding.

Ran Xu, Gang Chen, Caiming Xiong, Wei Chen, Jason J. Corso

CoRR, 2014

Actionness Ranking with Lattice Conditional Ordinal Random Fields.

Wei Chen, Caiming Xiong, Ran Xu, Jason J. Corso

Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014

2012

Random forests for metric learning with implicit pairwise position dependence.

Caiming Xiong, David M. Johnson, Ran Xu, Jason J. Corso

Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2012

Combining Skeletal Pose with Local Motion for Human Activity Recognition.

Ran Xu, Priyanshu Agarwal, Suren Kumar, Venkat N. Krovi, Jason J. Corso

Proceedings of the Articulated Motion and Deformable Objects, 2012