Tom Ko

According to our database, Tom Ko authored at least 60 papers between 2008 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Research.

Xinhao Mei, Chutong Meng, Haohe Liu, Qiuqiang Kong, Tom Ko, Chengqi Zhao, Mark D. Plumbley, Yuexian Zou, Wenwu Wang

IEEE ACM Trans. Audio Speech Lang. Process., 2024

Towards Achieving Human Parity on End-to-end Simultaneous Speech Translation via LLM Agent.

Shanbo Cheng, Zhichao Huang, Tom Ko, Hang Li, Ningxin Peng, Lu Xu, Qini Zhang

CoRR, 2024

PolyVoice: Language Models for Speech to Speech Translation.

Qianqian Dong, Zhiying Huang, Qi Tian, Chen Xu, Tom Ko, Yunlong Zhao, Siyuan Feng, Tang Li, Kexin Wang, Xuxin Cheng, Fengpeng Yue, Ye Bai, Xi Chen, Lu Lu, Zejun Ma, Yuping Wang, Mingxuan Wang, Yuxuan Wang

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Parameter-Efficient Transfer Learning for End-to-end Speech Translation.

Yunlong Zhao, Kexin Wang, Qianqian Dong, Tom Ko

Proceedings of the 2024 Joint International Conference on Computational Linguistics, 2024

RepCodec: A Speech Representation Codec for Speech Tokenization.

Zhichao Huang, Chutong Meng, Tom Ko

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Selective Prompting Tuning for Personalized Conversations with LLMs.

Qiushi Huang, Xubo Liu, Tom Ko, Bo Wu, Wenwu Wang, Yu Zhang, Lilian Tang

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Speech Translation with Large Language Models: An Industrial Practice.

Zhichao Huang, Rong Ye, Tom Ko, Qianqian Dong, Shanbo Cheng, Mingxuan Wang, Hang Li

CoRR, 2023

PolyVoice: Language Models for Speech to Speech Translation.

Qianqian Dong, Zhiying Huang, Qiao Tian, Chen Xu, Tom Ko, Yunlong Zhao, Siyuan Feng, Tang Li, Kexin Wang, Xuxin Cheng, Fengpeng Yue, Ye Bai, Xi Chen, Lu Lu, Zejun Ma, Yuping Wang, Mingxuan Wang, Yuxuan Wang

CoRR, 2023

Findings of the IWSLT 2023 Evaluation Campaign.

Sweta Agrawal, Antonios Anastasopoulos, Luisa Bentivogli, Ondrej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Mingda Chen, William Chen, Khalid Choukri, Alexandra Chronopoulou, Anna Currey, Thierry Declerck, Qianqian Dong, Kevin Duh, Yannick Estève, Marcello Federico, Souhir Gahbiche, Barry Haddow, Benjamin Hsu, Phu Mon Htut, Hirofumi Inaguma, Dávid Javorský, John Judge, Yasumasa Kano, Tom Ko, Rishu Kumar, Pengwei Li, Xutai Ma, Prashant Mathur, Evgeny Matusov, Paul McNamee, John P. McCrae, Kenton Murray, Maria Nadejde, Satoshi Nakamura, Matteo Negri, Ha Nguyen, Jan Niehues, Xing Niu, Atul Kr. Ojha, John E. Ortega, Proyag Pal, Juan Pino, Lonneke van der Plas, Peter Polák, Elijah Rippeth, Elizabeth Salesky, Jiatong Shi, Matthias Sperber, Sebastian Stüker, Katsuhito Sudoh, Yun Tang, Brian Thompson, Kevin Tran, Marco Turchi, Alex Waibel, Mingxuan Wang, Shinji Watanabe, Rodolfo Zevallos

Proceedings of the 20th International Conference on Spoken Language Translation, 2023

GigaST: A 10, 000-hour Pseudo Speech Translation Corpus.

Rong Ye, Chengqi Zhao, Tom Ko, Chutong Meng, Tao Wang, Mingxuan Wang, Jun Cao

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning.

Chutong Meng, Junyi Ao, Tom Ko, Mingxuan Wang, Haizhou Li

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Visually-Aware Audio Captioning With Adaptive Audio-Visual Attention.

Xubo Liu, Qiushi Huang, Xinhao Mei, Haohe Liu, Qiuqiang Kong, Jianyuan Sun, Shengchen Li, Tom Ko, Yu Zhang, H. Lilian Tang, Mark D. Plumbley, Volkan Kiliç, Wenwu Wang

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Recent Advances in Direct Speech-to-text Translation.

Chen Xu, Rong Ye, Qianqian Dong, Chengqi Zhao, Tom Ko, Mingxuan Wang, Tong Xiao, Jingbo Zhu

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023

M³ST: Mix at Three Levels for Speech Translation.

Xuxin Cheng, Qianqian Dong, Fengpeng Yue, Tom Ko, Mingxuan Wang, Yuexian Zou

Proceedings of the IEEE International Conference on Acoustics, 2023

Learning Retrieval Augmentation for Personalized Dialogue Generation.

Qiushi Huang, Shuai Fu, Xubo Liu, Wenwu Wang, Tom Ko, Yu Zhang, Lilian Tang

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Leveraging per Image-Token Consistency for Vision-Language Pre-training.

Yunhao Gou, Tom Ko, Hansi Yang, James T. Kwok, Yu Zhang, Mingxuan Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

DUB: Discrete Unit Back-translation for Speech Translation.

Dong Zhang, Rong Ye, Tom Ko, Mingxuan Wang, Yaqian Zhou

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

MOSPC: MOS Prediction Based on Pairwise Comparison.

Kexin Wang, Yunlong Zhao, Qianqian Dong, Tom Ko, Mingxuan Wang

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2023

CTC-based Non-autoregressive Speech Translation.

Chen Xu, Xiaoqian Liu, Xiaowen Liu, Qingxuan Sun, Yuhao Zhang, Murun Yang, Qianqian Dong, Tom Ko, Mingxuan Wang, Tong Xiao, Anxiang Ma, Jingbo Zhu

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Personalized Dialogue Generation with Persona-Adaptive Attention.

Qiushi Huang, Yu Zhang, Tom Ko, Xubo Liu, Bo Wu, Wenwu Wang, H. Lilian Tang

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

M3ST: Mix at Three Levels for Speech Translation.

Xuxin Cheng, Qianqian Dong, Fengpeng Yue, Tom Ko, Mingxuan Wang, Yuexian Zou

CoRR, 2022

LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT.

Rui Wang, Qibing Bai, Junyi Ao, Long Zhou, Zhixiang Xiong, Zhihua Wei, Yu Zhang, Tom Ko, Haizhou Li

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Leveraging Pseudo-labeled Data to Improve Direct Speech-to-Speech Translation.

Qianqian Dong, Fengpeng Yue, Tom Ko, Mingxuan Wang, Qibing Bai, Yu Zhang

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

A Study of Modeling Rising Intonation in Cantonese Neural Speech Synthesis.

Qibing Bai, Tom Ko, Yu Zhang

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data.

Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Exploring Machine Speech Chain For Domain Adaptation.

Fengpeng Yue, Yan Deng, Lei He, Tom Ko, Yu Zhang

Proceedings of the IEEE International Conference on Acoustics, 2022

Multi-View Self-Attention Based Transformer for Speaker Recognition.

Rui Wang, Junyi Ao, Long Zhou, Shujie Liu, Zhihua Wei, Tom Ko, Qing Li, Yu Zhang

Proceedings of the IEEE International Conference on Acoustics, 2022

SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing.

Junyi Ao, Rui Wang, Long Zhou, Chengyi Wang, Shuo Ren, Yu Wu, Shujie Liu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

SpeechT5: Unified-Modal Encoder-Decoder Pre-training for Spoken Language Processing.

Junyi Ao, Rui Wang, Long Zhou, Shujie Liu, Shuo Ren, Yu Wu, Tom Ko, Qing Li, Yu Zhang, Zhihua Wei, Yao Qian, Jinyu Li, Furu Wei

CoRR, 2021

Exploring Machine Speech Chain for Domain Adaptation and Few-Shot Speaker Adaptation.

Fengpeng Yue, Yan Deng, Lei He, Tom Ko

CoRR, 2021

An Investigation of Positional Encoding in Transformer-based End-to-end Speech Recognition.

Fengpeng Yue, Tom Ko

Proceedings of the 12th International Symposium on Chinese Spoken Language Processing, 2021

Improving Attention-based End-to-end ASR by Incorporating an N-gram Neural Network.

Junyi Ao, Tom Ko

Proceedings of the 12th International Symposium on Chinese Spoken Language Processing, 2021

Auto-KWS 2021 Challenge: Task, Datasets, and Baselines.

Jingsong Wang, Yuxuan He, Chunyu Zhao, Qijie Shao, Wei-Wei Tu, Tom Ko, Hung-yi Lee, Lei Xie

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

Token-Level Supervised Contrastive Learning for Punctuation Restoration.

Qiushi Huang, Tom Ko, H. Lilian Tang, Xubo Liu, Bo Wu

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

A Meta-Learning Approach for User-Defined Spoken Term Classification with Varying Classes and Examples.

Yangbin Chen, Tom Ko, Jianping Wang

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

An Encoder-Decoder Based Audio Captioning System with Transfer and Reinforcement Learning.

Xinhao Mei, Qiushi Huang, Xubo Liu, Gengyun Chen, Jingqian Wu, Yusong Wu, Jinzheng Zhao, Shengchen Li, Tom Ko, H. Lilian Tang, Xi Shao, Mark D. Plumbley, Wenwu Wang

Proceedings of the 6th Workshop on Detection and Classification of Acoustic Scenes and Events 2021 (DCASE 2021), 2021

CL4AC: A Contrastive Loss for Audio Captioning.

Xubo Liu, Qiushi Huang, Xinhao Mei, Tom Ko, H. Lilian Tang, Mark D. Plumbley, Wenwu Wang

Proceedings of the 6th Workshop on Detection and Classification of Acoustic Scenes and Events 2021 (DCASE 2021), 2021

2020

AutoSpeech 2020: The Second Automated Machine Learning Challenge for Speech Classification.

Jingsong Wang, Tom Ko, Zhen Xu, Xiawei Guo, Souxiang Liu, Wei-Wei Tu, Lei Xie

Proceedings of the 21st Annual Conference of the International Speech Communication Association, 2020

An Investigation of Few-Shot Learning in Spoken Term Classification.

Yangbin Chen, Tom Ko, Lifeng Shang, Xiao Chen, Xin Jiang, Qing Li

Proceedings of the 21st Annual Conference of the International Speech Communication Association, 2020

MetaMix: Improved Meta-Learning with Interpolation-based Consistency Regularization.

Yangbin Chen, Yun Ma, Tom Ko, Jianping Wang, Qing Li

Proceedings of the 25th International Conference on Pattern Recognition, 2020

Prototypical Networks for Small Footprint Text-Independent Speaker Verification.

Tom Ko, Yangbin Chen, Qing Li

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

2019

Mixup Learning Strategies for Text-Independent Speaker Verification.

Yingke Zhu, Tom Ko, Brian Mak

Proceedings of the 20th Annual Conference of the International Speech Communication Association, 2019

2018

Meta Learning for Few-shot Keyword Spotting.

Yangbin Chen, Tom Ko, Lifeng Shang, Xiao Chen, Xin Jiang, Qing Li

CoRR, 2018

Self-Attentive Speaker Embeddings for Text-Independent Speaker Verification.

Yingke Zhu, Tom Ko, David Snyder, Brian Mak, Daniel Povey

Proceedings of the 19th Annual Conference of the International Speech Communication Association, 2018

Long Distance Voice Channel Diagnosis Using Deep Neural Networks.

Zhen Qin, Tom Ko, Guangjian Tian

Proceedings of the 19th Annual Conference of the International Speech Communication Association, 2018

2017

A study on data augmentation of reverberant speech for robust speech recognition.

Tom Ko, Vijayaditya Peddinti, Daniel Povey, Michael L. Seltzer, Sanjeev Khudanpur

Proceedings of the 2017 IEEE International Conference on Acoustics, 2017

2016

An empirical exploration of CTC acoustic models.

Yajie Miao, Mohammad Gowayyed, Xingyu Na, Tom Ko, Florian Metze, Alexander Waibel

Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

2015

Audio augmentation for speech recognition.

Tom Ko, Vijayaditya Peddinti, Daniel Povey, Sanjeev Khudanpur

Proceedings of the 16th Annual Conference of the International Speech Communication Association, 2015

JHU ASpIRE system: Robust LVCSR with TDNNS, iVector adaptation and RNN-LMS.

Vijayaditya Peddinti, Guoguo Chen, Vimal Manohar, Tom Ko, Daniel Povey, Sanjeev Khudanpur

Proceedings of the 2015 IEEE Workshop on Automatic Speech Recognition and Understanding, 2015

2014

Eigentrigraphemes for under-resourced languages.

Tom Ko, Brian Kan-Wing Mak

Speech Commun., 2014

Modeling inter-cluster and intra-cluster discrimination among triphones.

Tom Ko, Brian Kan-Wing Mak, Dongpeng Chen

Proceedings of the 9th International Symposium on Chinese Spoken Language Processing, 2014

Subspace Gaussian mixture model with state-dependent subspace dimensions.

Tom Ko, Brian Mak, Cheung-Chi Leung

Proceedings of the IEEE International Conference on Acoustics, 2014

2013

Eigentriphones for Context-Dependent Acoustic Modeling.

Tom Ko, Brian Mak

IEEE Trans. Speech Audio Process., 2013

2012

Derivation of eigentriphones by weighted principal component analysis.

Tom Ko, Brian Mak

Proceedings of the 2012 IEEE International Conference on Acoustics, 2012

2011

A Fully Automated Derivation of State-Based Eigentriphones for Triphone Modeling with No Tied States Using Regularization.

Tom Ko, Brian Mak

Proceedings of the 12th Annual Conference of the International Speech Communication Association, 2011

Eigentriphones: A basis for context-dependent acoustic modeling.

Tom Ko, Brian Mak

Proceedings of the IEEE International Conference on Acoustics, 2011

2010

Problems of modeling phone deletion in conversational speech for speech recognition.

Brian Mak, Tom Ko

Proceedings of the 7th International Symposium on Chinese Spoken Language Processing, 2010

Improving speech recognition by explicit modeling of phone deletions.

Tom Ko, Brian Mak

Proceedings of the IEEE International Conference on Acoustics, 2010

2009

Automatic estimation of decoding parameters using large-margin iterative linear programming.

Brian Mak, Tom Ko

Proceedings of the 10th Annual Conference of the International Speech Communication Association, 2009

2008

Min-max discriminative training of decoding parameters using iterative linear programming.

Brian Mak, Tom Ko

Proceedings of the 9th Annual Conference of the International Speech Communication Association, 2008