Xudong Lin

According to our database, Xudong Lin authored at least 41 papers between 2018 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Investigating Video Reasoning Capability of Large Language Models with Tropes in Movies.

Hung-Ting Su, Chun-Tong Chao, Ya-Ching Hsu, Xudong Lin, Yulei Niu, Hung-Yi Lee, Winston H. Hsu

CoRR, 2024

SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos.

Yulei Niu, Wenliang Guo, Long Chen, Xudong Lin, Shih-Fu Chang

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Unveiling Narrative Reasoning Limits of Large Language Models with Trope in Movie Synopses.

Hung-Ting Su, Ya-Ching Hsu, Xudong Lin, Xiang Qian Shi, Yulei Niu, Han-Yuan Hsu, Hung-yi Lee, Winston H. Hsu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Personalized Video Comment Generation.

Xudong Lin, Ali Zare, Shiyuan Huang, Ming-Hsuan Yang, Shih-Fu Chang, Li Zhang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

VIEWS: Entity-Aware News Video Captioning.

Hammad A. Ayyubi, Tianqi Liu, Arsha Nagrani, Xudong Lin, Mingda Zhang, Anurag Arnab, Feng Han, Yukun Zhu, Xuande Feng, Kevin Zhang, Jialu Liu, Shih-Fu Chang

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Training-free Deep Concept Injection Enables Language Models for Video Question Answering.

Xudong Lin, Manling Li, Richard S. Zemel, Heng Ji, Shih-Fu Chang

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

BLINK: Multimodal Large Language Models Can See but Not Perceive.

Xingyu Fu, Yushi Hu, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A. Smith, Wei-Chiu Ma, Ranjay Krishna

Proceedings of the Computer Vision - ECCV 2024, 2024

Beyond Grounding: Extracting Fine-Grained Event Hierarchies across Modalities.

Hammad A. Ayyubi, Christopher Thomas, Lovish Chum, Rahul Lokesh, Long Chen, Yulei Niu, Xudong Lin, Xuande Feng, Jaywon Koo, Sounak Ray, Shih-Fu Chang

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Video Summarization: Towards Entity-Aware Captions.

Hammad A. Ayyubi, Tianqi Liu, Arsha Nagrani, Xudong Lin, Mingda Zhang, Anurag Arnab, Feng Han, Yukun Zhu, Jialu Liu, Shih-Fu Chang

CoRR, 2023

TempCLR: Temporal Alignment Representation with Contrastive Learning.

Yuncong Yang, Jiawei Ma, Shiyuan Huang, Long Chen, Xudong Lin, Guangxing Han, Shih-Fu Chang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Learning to Decompose Visual Features with Latent Textual Prompts.

Feng Wang, Manling Li, Xudong Lin, Hairong Lv, Alexander G. Schwing, Heng Ji

Proceedings of the Eleventh International Conference on Learning Representations, 2023

All in One: Exploring Unified Video-Language Pre-Training.

Jinpeng Wang, Yixiao Ge, Rui Yan, Yuying Ge, Kevin Qinghong Lin, Satoshi Tsutsui, Xudong Lin, Guanyu Cai, Jianping Wu, Ying Shan, Xiaohu Qie, Mike Zheng Shou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Language Models are Causal Knowledge Extractors for Zero-shot Video Question Answering.

Hung-Ting Su, Yulei Niu, Xudong Lin, Winston H. Hsu, Shih-Fu Chang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

In Defense of Structural Symbolic Representation for Video Event-Relation Prediction.

Andrew Lu, Xudong Lin, Yulei Niu, Shih-Fu Chang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Supervised Masked Knowledge Distillation for Few-Shot Transformers.

Han Lin, Guangxing Han, Jiawei Ma, Shiyuan Huang, Xudong Lin, Shih-Fu Chang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval.

Xudong Lin, Simran Tiwari, Shiyuan Huang, Manling Li, Mike Zheng Shou, Heng Ji, Shih-Fu Chang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Non-Sequential Graph Script Induction via Multimedia Grounding.

Yu Zhou, Sha Li, Manling Li, Xudong Lin, Shih-Fu Chang, Mohit Bansal, Heng Ji

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Video Event Extraction via Tracking Visual States of Arguments.

Guang Yang, Manling Li, Jiajie Zhang, Xudong Lin, Heng Ji, Shih-Fu Chang

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

Video-Text Pre-training with Learned Regions for Retrieval.

Rui Yan, Mike Zheng Shou, Yixiao Ge, Jinpeng Wang, Xudong Lin, Guanyu Cai, Jinhui Tang

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Multimodal Event Graphs: Towards Event Centric Understanding of Multimodal World.

Hammad A. Ayyubi, Christopher Thomas, Lovish Chum, Rahul Lokesh, Yulei Niu, Xudong Lin, Long Chen, Jaywon Koo, Sounak Ray, Shih-Fu Chang

CoRR, 2022

Revitalize Region Feature for Democratizing Video-Language Pre-training.

Guanyu Cai, Yixiao Ge, Alex Jinpeng Wang, Rui Yan, Xudong Lin, Ying Shan, Lianghua He, Xiaohu Qie, Jianping Wu, Mike Zheng Shou

CoRR, 2022

All in One: Exploring Unified Video-Language Pre-training.

Alex Jinpeng Wang, Yixiao Ge, Rui Yan, Yuying Ge, Xudong Lin, Guanyu Cai, Jianping Wu, Ying Shan, Xiaohu Qie, Mike Zheng Shou

CoRR, 2022

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners.

Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Weakly-Supervised Temporal Article Grounding.

Long Chen, Yulei Niu, Brian Chen, Xudong Lin, Guangxing Han, Christopher Thomas, Hammad A. Ayyubi, Heng Ji, Shih-Fu Chang

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Object-aware Video-language Pre-training for Retrieval.

Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, Mike Zheng Shou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

CLIP-Event: Connecting Text and Images with Event Structures.

Manling Li, Ruochen Xu, Shuohang Wang, Luowei Zhou, Xudong Lin, Chenguang Zhu, Michael Zeng, Heng Ji, Shih-Fu Chang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Learning To Recognize Procedural Activities with Distant Supervision.

Xudong Lin, Fabio Petroni, Gedas Bertasius, Marcus Rohrbach, Shih-Fu Chang, Lorenzo Torresani

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding.

Revanth Gangi Reddy, Xilin Rui, Manling Li, Xudong Lin, Haoyang Wen, Jaemin Cho, Lifu Huang, Mohit Bansal, Avirup Sil, Shih-Fu Chang, Alexander G. Schwing, Heng Ji

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

Video-Text Pre-training with Learned Regions.

Rui Yan, Mike Zheng Shou, Yixiao Ge, Alex Jinpeng Wang, Xudong Lin, Guanyu Cai, Jinhui Tang

CoRR, 2021

RESIN: A Dockerized Schema-Guided Cross-document Cross-lingual Cross-media Information Extraction and Event Tracking System.

Haoyang Wen, Ying Lin, Tuan Manh Lai, Xiaoman Pan, Sha Li, Xudong Lin, Ben Zhou, Manling Li, Haoyu Wang, Hongming Zhang, Xiaodong Yu, Alexander Dong, Zhenhailong Wang, Yi Ren Fung, Piyush Mishra, Qing Lyu, Dídac Surís, Brian Chen, Susan Windisch Brown, Martha Palmer, Chris Callison-Burch, Carl Vondrick, Jiawei Han, Dan Roth, Shih-Fu Chang, Heng Ji

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Demonstrations, 2021

Joint Multimedia Event Extraction from Video and Article.

Brian Chen, Xudong Lin, Christopher Thomas, Manling Li, Shoya Yoshida, Lovish Chum, Heng Ji, Shih-Fu Chang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Co-Grounding Networks With Semantic Attention for Referring Expression Comprehension in Videos.

Sijie Song, Xudong Lin, Jiaying Liu, Zongming Guo, Shih-Fu Chang

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Vx2Text: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs.

Xudong Lin, Gedas Bertasius, Jue Wang, Shih-Fu Chang, Devi Parikh, Lorenzo Torresani

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

Context-Gated Convolution.

Xudong Lin, Lin Ma, Wei Liu, Shih-Fu Chang

Proceedings of the Computer Vision - ECCV 2020, 2020

2019

Flow-Distilled IP Two-Stream Networks for Compressed Video Action Recognition.

Shiyuan Huang, Xudong Lin, Svebor Karaman, Shih-Fu Chang

CoRR, 2019

LPAT: Learning to Predict Adaptive Threshold for Weakly-supervised Temporal Action Localization.

Xudong Lin, Zheng Shou, Shih-Fu Chang

CoRR, 2019

Unsupervised Rank-Preserving Hashing for Large-Scale Image Retrieval.

Svebor Karaman, Xudong Lin, Xuefeng Hu, Shih-Fu Chang

Proceedings of the 2019 on International Conference on Multimedia Retrieval, 2019

DMC-Net: Generating Discriminative Motion Cues for Fast Compressed Video Action Recognition.

Zheng Shou, Xudong Lin, Yannis Kalantidis, Laura Sevilla-Lara, Marcus Rohrbach, Shih-Fu Chang, Zhicheng Yan

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019

2018

Deep Variational Metric Learning.

Xudong Lin, Yueqi Duan, Qiyuan Dong, Jiwen Lu, Jie Zhou

Proceedings of the Computer Vision - ECCV 2018, 2018

Deep Adversarial Metric Learning.

Yueqi Duan, Wenzhao Zheng, Xudong Lin, Jiwen Lu, Jie Zhou

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

GraphBit: Bitwise Interaction Mining via Deep Reinforcement Learning.

Yueqi Duan, Ziwei Wang, Jiwen Lu, Xudong Lin, Jie Zhou

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018