Tao Jin

According to our database, Tao Jin authored at least 42 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Multi-Granularity Relational Attention Network for Audio-Visual Question Answering.

Linjun Li, Tao Jin, Wang Lin, Hao Jiang, Wenwen Pan, Jian Wang, Shuwen Xiao, Yan Xia, Weihao Jiang, Zhou Zhao

IEEE Trans. Circuits Syst. Video Technol., August, 2024

GTADT: Gated tone-sensitive acne grading via augmented domain transfer.

Min Tan, Ruirui Wang, Ankur Purwar, Tao Jin, Jun Yu, Alex C. Kot

Multim. Tools Appl., 2024

Speech Watermarking with Discrete Intermediate Representations.

Shengpeng Ji, Ziyue Jiang, Jialong Zuo, Minghui Fang, Yifu Chen, Tao Jin, Zhou Zhao

CoRR, 2024

A Wander Through the Multimodal Landscape: Efficient Transfer Learning via Low-rank Sequence Multimodal Adapter.

Zirun Guo, Xize Cheng, Yangyang Wu, Tao Jin

CoRR, 2024

Classifier-guided Gradient Modulation for Enhanced Multimodal Learning.

Zirun Guo, Tao Jin, Jingyuan Chen, Zhou Zhao

CoRR, 2024

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup.

Xize Cheng, Siqi Zheng, Zehan Wang, Minghui Fang, Ziang Zhang, Rongjie Huang, Ziyang Ma, Shengpeng Ji, Jialong Zuo, Tao Jin, Zhou Zhao

CoRR, 2024

EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration.

Ye Wang, Jiahao Xun, Mingjie Hong, Jieming Zhu, Tao Jin, Wang Lin, Haoyuan Li, Linjun Li, Yan Xia, Zhou Zhao, Zhenhua Dong

CoRR, 2024

SyncTalklip: Highly Synchronized Lip-Readable Speaker Generation with Multi-Task Learning.

Xiaoda Yang, Xize Cheng, Dongjie Fu, Minghui Fang, Jialung Zuo, Shengpeng Ji, Zhou Zhao, Tao Jin

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Low-rank Prompt Interaction for Continual Vision-Language Retrieval.

Weicai Yan, Ye Wang, Wang Lin, Zirun Guo, Zhou Zhao, Tao Jin

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Boosting Speech Recognition Robustness to Modality-Distortion with Contrast-Augmented Prompts.

Dongjie Fu, Xize Cheng, Xiaoda Yang, Hanting Wang, Zhou Zhao, Tao Jin

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Calibrating Prompt from History for Continual Vision-Language Retrieval and Grounding.

Tao Jin, Weicai Yan, Ye Wang, Sihang Cai, Qifan Shuai, Zhou Zhao

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration.

Ye Wang, Jiahao Xun, Minjie Hong, Jieming Zhu, Tao Jin, Wang Lin, Haoyuan Li, Linjun Li, Yan Xia, Zhou Zhao, Zhenhua Dong

Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2024

Non-confusing Generation of Customized Concepts in Diffusion Models.

Wang Lin, Jingyuan Chen, Jiaxin Shi, Yichen Zhu, Chen Liang, Junzhong Miao, Tao Jin, Zhou Zhao, Fei Wu, Shuicheng Yan, Hanwang Zhang

Proceedings of the Forty-first International Conference on Machine Learning, 2024

FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion.

Zehan Wang, Ziang Zhang, Xize Cheng, Rongjie Huang, Luping Liu, Zhenhui Ye, Haifeng Huang, Yang Zhao, Tao Jin, Peng Gao, Zhou Zhao

Proceedings of the Forty-first International Conference on Machine Learning, 2024

AudioVSR: Enhancing Video Speech Recognition with Audio Data.

Xiaoda Yang, Xize Cheng, Jiaqi Duan, Hongshun Qiu, Minjie Hong, Minghui Fang, Shengpeng Ji, Jialong Zuo, Zhiqing Hong, Zhimeng Zhang, Tao Jin

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

MPOD123: One Image to 3D Content Generation Using Mask-Enhanced Progressive Outline-to-Detail Optimization.

Jimin Xu, Tianbao Wang, Tao Jin, Shengyu Zhang, Dongjie Fu, Zhe Wang, Jiangjing Lyu, Chengfei Lv, Chaoyue Niu, Zhou Yu, Zhou Zhao, Fei Wu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Uni-Dubbing: Zero-Shot Speech Synthesis from Visual Articulation.

Songju Lei, Xize Cheng, Mengjiao Lyu, Jianqiao Hu, Jintao Tan, Runlin Liu, Lingyu Xiong, Tao Jin, Xiandong Li, Zhou Zhao

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment.

Tao Jin, Wang Lin, Ye Wang, Linjun Li, Xize Cheng, Zhou Zhao

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition.

Zirun Guo, Tao Jin, Zhou Zhao

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation.

Xize Cheng, Rongjie Huang, Linjun Li, Zehan Wang, Tao Jin, Aoxiong Yin, Feiyang Chen, Xinyu Duan, Baoxing Huai, Zhou Zhao

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Electromagnetic Imaging Boosted Visual Object Recognition Under Difficult Visual Conditions.

Min Tan, Tao Jin, Danhui Ye, Kuiwen Xu, Xiaoling Gu, Jun Yu

IEEE Trans. Geosci. Remote. Sens., 2023

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation.

Xize Cheng, Rongjie Huang, Linjun Li, Tao Jin, Zehan Wang, Aoxiong Yin, Minglei Li, Xinyu Duan, Changpeng Yang, Zhou Zhao

CoRR, 2023

Chat-3D v2: Bridging 3D Scene and Large Language Models with Object Identifiers.

Haifeng Huang, Zehan Wang, Rongjie Huang, Luping Liu, Xize Cheng, Yang Zhao, Tao Jin, Zhou Zhao

CoRR, 2023

Extending Multi-modal Contrastive Representations.

Zehan Wang, Ziang Zhang, Luping Liu, Yang Zhao, Haifeng Huang, Tao Jin, Zhou Zhao

CoRR, 2023

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition.

Xize Cheng, Linjun Li, Tao Jin, Rongjie Huang, Wang Lin, Zehan Wang, Huangdai Liu, Ye Wang, Aoxiong Yin, Zhou Zhao

CoRR, 2023

Rethinking Missing Modality Learning from a Decoding Perspective.

Tao Jin, Xize Cheng, Linjun Li, Wang Lin, Ye Wang, Zhou Zhao

Proceedings of the 31st ACM International Conference on Multimedia, 2023

Exploring Group Video Captioning with Efficient Relational Approximation.

Wang Lin, Tao Jin, Ye Wang, Wenwen Pan, Linjun Li, Xize Cheng, Zhou Zhao

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition.

Xize Cheng, Tao Jin, Rongjie Huang, Linjun Li, Wang Lin, Zehan Wang, Ye Wang, Huadai Liu, Aoxiong Yin, Zhou Zhao

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Weakly-Supervised Spoken Video Grounding via Semantic Interaction Learning.

Ye Wang, Wang Lin, Shengyu Zhang, Tao Jin, Linjun Li, Xize Cheng, Zhou Zhao

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Semantic-conditioned Dual Adaptation for Cross-domain Query-based Visual Segmentation.

Ye Wang, Tao Jin, Wang Lin, Xize Cheng, Linjun Li, Zhou Zhao

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

TAVT: Towards Transferable Audio-Visual Text Generation.

Wang Lin, Tao Jin, Wenwen Pan, Linjun Li, Xize Cheng, Ye Wang, Zhou Zhao

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Contrastive Token-Wise Meta-Learning for Unseen Performer Visual Temporal-Aligned Translation.

Linjun Li, Tao Jin, Xize Cheng, Ye Wang, Wang Lin, Rongjie Huang, Zhou Zhao

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment.

Xize Cheng, Tao Jin, Linjun Li, Wang Lin, Xinyu Duan, Zhou Zhao

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Interaction augmented transformer with decoupled decoding for video captioning.

Tao Jin, Zhou Zhao, Peng Wang, Jun Yu, Fei Wu

Neurocomputing, 2022

MC-SLT: Towards Low-Resource Signer-Adaptive Sign Language Translation.

Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng

Proceedings of the MM '22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10, 2022

Prior Knowledge and Memory Enriched Transformer for Sign Language Translation.

Tao Jin, Zhou Zhao, Meng Zhang, Xingshan Zeng

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, 2022

2021

Generalizable Multi-linear Attention Network.

Tao Jin, Zhou Zhao

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Contrastive Disentangled Meta-Learning for Signer-Independent Sign Language Translation.

Tao Jin, Zhou Zhao

Proceedings of the MM '21: ACM Multimedia Conference, Virtual Event, China, October 20, 2021

2020

SBAT: Video Captioning with Sparse Boundary-Aware Transformer.

Tao Jin, Siyu Huang, Ming Chen, Yingming Li, Zhongfei Zhang

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, 2020

Dual Low-Rank Multimodal Fusion.

Tao Jin, Siyu Huang, Yingming Li, Zhongfei Zhang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

2019

Recurrent convolutional video captioning with global and local attention.

Tao Jin, Yingming Li, Zhongfei Zhang

Neurocomputing, 2019

Low-Rank HOCA: Efficient High-Order Cross-Modal Attention for Video Captioning.

Tao Jin, Siyu Huang, Yingming Li, Zhongfei Zhang

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019