Junnan Li

According to our database, Junnan Li authored at least 56 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

What Are We Measuring When We Evaluate Large Vision-Language Models? An Analysis of Latent Factors and Biases.

Anthony Meng Huat Tiong, Junqi Zhao, Boyang Li, Junnan Li, Steven C. H. Hoi, Caiming Xiong

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

X-InstructBLIP: A Framework for Aligning Image, 3D, Audio, Video to LLMs and its Emergent Cross-Modal Reasoning.

Artemis Panagopoulou, Le Xue, Ning Yu, Junnan Li, Dongxu Li, Shafiq Joty, Ran Xu, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles

Proceedings of the Computer Vision - ECCV 2024, 2024

ULIP-2: Towards Scalable Multimodal Pre-Training for 3D Understanding.

Le Xue, Ning Yu, Shu Zhang, Artemis Panagopoulou, Junnan Li, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Silvio Savarese

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

Improving Tail-Class Representation with Centroid Contrastive Learning.

Anthony Meng Huat Tiong, Junnan Li, Guosheng Lin, Boyang Li, Caiming Xiong, Steven C. H. Hoi

Pattern Recognit. Lett., April, 2023

X-InstructBLIP: A Framework for aligning X-Modal instruction-aware representations to LLMs and Emergent Cross-modal Reasoning.

Artemis Panagopoulou, Le Xue, Ning Yu, Junnan Li, Dongxu Li, Shafiq Joty, Ran Xu, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles

CoRR, 2023

CodeTF: One-stop Transformer Library for State-of-the-art Code LLM.

Nghi D. Q. Bui, Hung Le, Yue Wang, Junnan Li, Akhilesh Deepak Gotmare, Steven C. H. Hoi

CoRR, 2023

ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding.

Le Xue, Ning Yu, Shu Zhang, Junnan Li, Roberto Martín-Martín, Jiajun Wu, Caiming Xiong, Ran Xu, Juan Carlos Niebles, Silvio Savarese

CoRR, 2023

Efficient Text-to-Code Retrieval with Cascaded Fast and Slow Transformer Models.

Akhilesh Deepak Gotmare, Junnan Li, Shafiq Joty, Steven C. H. Hoi

Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, 2023

BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editing.

Dongxu Li, Junnan Li, Steven C. H. Hoi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning.

Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, Steven C. H. Hoi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models.

Junnan Li, Dongxu Li, Silvio Savarese, Steven C. H. Hoi

Proceedings of the International Conference on Machine Learning, 2023

Masked Unsupervised Self-training for Label-free Image Classification.

Junnan Li, Silvio Savarese, Steven C. H. Hoi

Proceedings of the Eleventh International Conference on Learning Representations, 2023

CodeT5+: Open Code Large Language Models for Code Understanding and Generation.

Yue Wang, Hung Le, Akhilesh Gotmare, Nghi D. Q. Bui, Junnan Li, Steven C. H. Hoi

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

From Images to Textual Prompts: Zero-shot Visual Question Answering with Frozen Large Language Models.

Jiaxian Guo, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Boyang Li, Dacheng Tao, Steven C. H. Hoi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

LAVIS: A One-stop Library for Language-Vision Intelligence.

Dongxu Li, Junnan Li, Hung Le, Guangsen Wang, Silvio Savarese, Steven C. H. Hoi

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics: System Demonstrations, 2023

Tackling Data Heterogeneity in Federated Learning with Class Prototypes.

Yutong Dai, Zeyuan Chen, Junnan Li, Shelby Heinecke, Lichao Sun, Ran Xu

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

From Images to Textual Prompts: Zero-shot VQA with Frozen Large Language Models.

Jiaxian Guo, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Boyang Li, Dacheng Tao, Steven C. H. Hoi

CoRR, 2022

BotSIM: An End-to-End Bot Simulation Toolkit for Commercial Task-Oriented Dialog Systems.

Guangsen Wang, Shafiq R. Joty, Junnan Li, Steven C. H. Hoi

CoRR, 2022

LAVIS: A Library for Language-Vision Intelligence.

Dongxu Li, Junnan Li, Hung Le, Guangsen Wang, Silvio Savarese, Steven C. H. Hoi

CoRR, 2022

Masked Unsupervised Self-training for Zero-shot Image Classification.

Junnan Li, Silvio Savarese, Steven C. H. Hoi

CoRR, 2022

BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation.

Junnan Li, Dongxu Li, Caiming Xiong, Steven C. H. Hoi

Proceedings of the International Conference on Machine Learning, 2022

Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Training.

Anthony Meng Huat Tiong, Junnan Li, Boyang Li, Silvio Savarese, Steven C. H. Hoi

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

Open Vocabulary Object Detection with Pseudo Bounding-Box Labels.

Mingfei Gao, Chen Xing, Juan Carlos Niebles, Junnan Li, Ran Xu, Wenhao Liu, Caiming Xiong

Proceedings of the Computer Vision - ECCV 2022, 2022

Align and Prompt: Video-and-Language Pre-training with Entity Prompts.

Dongxu Li, Junnan Li, Hongdong Li, Juan Carlos Niebles, Steven C. H. Hoi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

2021

Towards Open Vocabulary Object Detection without Human-provided Bounding Boxes.

Mingfei Gao, Chen Xing, Juan Carlos Niebles, Junnan Li, Ran Xu, Wenhao Liu, Caiming Xiong

CoRR, 2021

Cascaded Fast and Slow Models for Efficient Semantic Code Search.

Akhilesh Deepak Gotmare, Junnan Li, Shafiq R. Joty, Steven C. H. Hoi

CoRR, 2021

Align before Fuse: Vision and Language Representation Learning with Momentum Distillation.

Junnan Li, Ramprasaath R. Selvaraju, Akhilesh Gotmare, Shafiq R. Joty, Caiming Xiong, Steven Chu-Hong Hoi

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Prototypical Contrastive Learning of Unsupervised Representations.

Junnan Li, Pan Zhou, Caiming Xiong, Steven C. H. Hoi

Proceedings of the 9th International Conference on Learning Representations, 2021

MoPro: Webly Supervised Learning with Momentum Prototypes.

Junnan Li, Caiming Xiong, Steven C. H. Hoi

Proceedings of the 9th International Conference on Learning Representations, 2021

Learning from Noisy Data with Robust Representation Learning.

Junnan Li, Caiming Xiong, Steven C. H. Hoi

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

CoMatch: Semi-supervised Learning with Contrastive Graph Regularization.

Junnan Li, Caiming Xiong, Steven C. H. Hoi

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

2020

Interact as You Intend: Intention-Driven Human-Object Interaction Detection.

Bingjie Xu, Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

IEEE Trans. Multim., 2020

Video Storytelling: Textual Summaries for Events.

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

IEEE Trans. Multim., 2020

Visual Social Relationship Recognition.

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

Int. J. Comput. Vis., 2020

Prototypical Contrastive Learning of Unsupervised Representations.

Junnan Li, Pan Zhou, Caiming Xiong, Richard Socher, Steven C. H. Hoi

CoRR, 2020

Improving out-of-distribution generalization via multi-task self-supervised pretraining.

Isabela Albuquerque, Nikhil Naik, Junnan Li, Nitish Shirish Keskar, Richard Socher

CoRR, 2020

Towards Noise-resistant Object Detection with Noisy Annotations.

Junnan Li, Caiming Xiong, Richard Socher, Steven C. H. Hoi

CoRR, 2020

GradMix: Multi-source Transfer across Domains and Tasks.

Junnan Li, Ziwei Xu, Yongkang Wang, Qi Zhao, Mohan S. Kankanhalli

Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 2020

Weakly-Supervised Multi-Person Action Recognition in 360° Videos.

Junnan Li, Jianquan Liu, Yongkang Wang, Shoji Nishimura, Mohan S. Kankanhalli

Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 2020

DivideMix: Learning with Noisy Labels as Semi-supervised Learning.

Junnan Li, Richard Socher, Steven C. H. Hoi

Proceedings of the 8th International Conference on Learning Representations, 2020

Learning on the Fly: An RNN-Based Online Throughput Prediction Framework for UAV Communications.

Yuxuan Jiang, Koichi Nihei, Junnan Li, Hiroshi Yoshida, Dai Kanetomo

Proceedings of the 2020 IEEE International Conference on Communications Workshops, 2020

The Devil Is in Classification: A Simple Framework for Long-Tail Instance Segmentation.

Tao Wang, Yu Li, Bingyi Kang, Junnan Li, Jun Hao Liew, Sheng Tang, Steven C. H. Hoi, Jiashi Feng

Proceedings of the Computer Vision - ECCV 2020, 2020

2019

A Multi-sensor Framework for Personal Presentation Analytics.

Tian Gan, Junnan Li, Yongkang Wong, Mohan S. Kankanhalli

ACM Trans. Multim. Comput. Commun. Appl., 2019

Deep Reinforcement Learning in Soft Viscoelastic Actuator of Dielectric Elastomer.

Lu Li, Junnan Li, Lei Qin, Jiawei Cao, Mohan S. Kankanhalli, Jian Zhu

IEEE Robotics Autom. Lett., 2019

LSTM-based multi-label video event detection.

An-An Liu, Zhuang Shao, Yongkang Wong, Junnan Li, Yuting Su, Mohan S. Kankanhalli

Multim. Tools Appl., 2019

Classification Calibration for Long-tail Instance Segmentation.

Tao Wang, Yu Li, Bingyi Kang, Junnan Li, Jun Hao Liew, Sheng Tang, Steven C. H. Hoi, Jiashi Feng

CoRR, 2019

Self-supervised Representation Learning Using 360° Data.

Junnan Li, Jianquan Liu, Yongkang Wong, Shoji Nishimura, Mohan S. Kankanhalli

Proceedings of the 27th ACM International Conference on Multimedia, 2019

Learning to Detect Human-Object Interactions With Knowledge.

Bingjie Xu, Yongkang Wong, Junnan Li, Qi Zhao, Mohan S. Kankanhalli

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

Learning to Learn From Noisy Labeled Data.

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

2018

Video Storytelling.

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

CoRR, 2018

Unsupervised Learning of View-invariant Action Representations.

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

2017

Hierarchical & multimodal video captioning: Discovering and transferring multimodal knowledge for vision to language.

An-An Liu, Ning Xu, Yongkang Wong, Junnan Li, Yuting Su, Mohan S. Kankanhalli

Comput. Vis. Image Underst., 2017

Attention Transfer from Web Images for Video Recognition.

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

Proceedings of the 2017 ACM on Multimedia Conference, 2017

Dual-Glance Model for Deciphering Social Relationships.

Junnan Li, Yongkang Wong, Qi Zhao, Mohan S. Kankanhalli

Proceedings of the IEEE International Conference on Computer Vision, 2017

2016

Demo Paper: PreSense - An Assistive Presentation Self-Quantification System.

Junnan Li, Yongkang Wong, Mohan S. Kankanhalli

Proceedings of the IEEE International Symposium on Multimedia, 2016

Multi-stream Deep Learning Framework for Automated Presentation Assessment.

Junnan Li, Yongkang Wong, Mohan S. Kankanhalli

Proceedings of the IEEE International Symposium on Multimedia, 2016