Dongchao Yang

According to our database, Dongchao Yang authored at least 52 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

InstructTTS: Modelling Expressive TTS in Discrete Latent Space With Natural Language Style Prompt.

Dongchao Yang, Songxiang Liu, Rongjie Huang, Chao Weng, Helen Meng

IEEE ACM Trans. Audio Speech Lang. Process., 2024

Codec-SUPERB @ SLT 2024: A lightweight benchmark for neural audio codec models.

Haibin Wu, Xuanjun Chen, Yi-Cheng Lin, Kai-Wei Chang, Jiawei Du, Ke-Han Lu, Alexander H. Liu, Ho-Lam Chung, Yuan-Kuei Wu, Dongchao Yang, Songxiang Liu, Yi-Chiao Wu, Xu Tan, James R. Glass, Shinji Watanabe, Hung-yi Lee

CoRR, 2024

AudioComposer: Towards Fine-grained Audio Generation with Natural Language Descriptions.

Yuanyuan Wang, Hangting Chen, Dongchao Yang, Zhiyong Wu, Helen Meng, Xixin Wu

CoRR, 2024

Speaking from Coarse to Fine: Improving Neural Codec Language Model via Multi-Scale Speech Coding and Generation.

Haohan Guo, Fenglong Xie, Dongchao Yang, Xixin Wu, Helen Meng

CoRR, 2024

SoCodec: A Semantic-Ordered Multi-Stream Speech Codec for Efficient Language Model Based Text-to-Speech Synthesis.

Haohan Guo, Fenglong Xie, Kun Xie, Dongchao Yang, Dake Guo, Xixin Wu, Helen Meng

CoRR, 2024

SimpleSpeech 2: Towards Simple and Efficient Text-to-Speech with Flow-based Scalar Latent Transformer Diffusion Models.

Dongchao Yang, Rongjie Huang, Yuanyuan Wang, Haohan Guo, Dading Chong, Songxiang Liu, Xixin Wu, Helen Meng

CoRR, 2024

UniAudio 1.5: Large Language Model-driven Audio Codec is A Few-shot Audio Task Learner.

Dongchao Yang, Haohan Guo, Yuanyuan Wang, Rongjie Huang, Xiang Li, Xu Tan, Xixin Wu, Helen Meng

CoRR, 2024

CoLM-DSR: Leveraging Neural Codec Language Modeling for Multi-Modal Dysarthric Speech Reconstruction.

Xueyuan Chen, Dongchao Yang, Dingdong Wang, Xixin Wu, Zhiyong Wu, Helen Meng

CoRR, 2024

Addressing Index Collapse of Large-Codebook Speech Tokenizer with Dual-Decoding Product-Quantized Variational Auto-Encoder.

Haohan Guo, Fenglong Xie, Dongchao Yang, Hui Lu, Xixin Wu, Helen Meng

CoRR, 2024

SimpleSpeech: Towards Simple and Efficient Text-to-Speech with Scalar Latent Transformer Diffusion Models.

Dongchao Yang, Dingdong Wang, Haohan Guo, Xueyuan Chen, Xixin Wu, Helen Meng

CoRR, 2024

RALL-E: Robust Codec Language Modeling with Chain-of-Thought Prompting for Text-to-Speech Synthesis.

Detai Xin, Xu Tan, Kai Shen, Zeqian Ju, Dongchao Yang, Yuancheng Wang, Shinnosuke Takamichi, Hiroshi Saruwatari, Shujie Liu, Jinyu Li, Sheng Zhao

CoRR, 2024

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models.

Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Yanqing Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiang-Yang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao

CoRR, 2024

VoiceTuner: Self-Supervised Pre-training and Efficient Fine-tuning For Voice Generation.

Rongjie Huang, Yongqi Wang, Ruofan Hu, Xiaoshan Xu, Zhiqing Hong, Dongchao Yang, Xize Cheng, Zehan Wang, Ziyue Jiang, Zhenhui Ye, Luping Liu, Siqi Zheng, Zhou Zhao

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

UniAudio: Towards Universal Audio Generation with Large Language Models.

Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Haohan Guo, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Zhou Zhao, Xixin Wu, Helen M. Meng

Proceedings of the Forty-first International Conference on Machine Learning, 2024

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models.

Zeqian Ju, Yuancheng Wang, Kai Shen, Xu Tan, Detai Xin, Dongchao Yang, Eric Liu, Yichong Leng, Kaitao Song, Siliang Tang, Zhizheng Wu, Tao Qin, Xiangyang Li, Wei Ye, Shikun Zhang, Jiang Bian, Lei He, Jinyu Li, Sheng Zhao

Proceedings of the Forty-first International Conference on Machine Learning, 2024

InstructSpeech: Following Speech Editing Instructions via Large Language Models.

Rongjie Huang, Ruofan Hu, Yongqi Wang, Zehan Wang, Xize Cheng, Ziyue Jiang, Zhenhui Ye, Dongchao Yang, Luping Liu, Peng Gao, Zhou Zhao

Proceedings of the Forty-first International Conference on Machine Learning, 2024

PromptTTS 2: Describing and Generating Voices with Text Prompt.

Yichong Leng, Zhifang Guo, Kai Shen, Zeqian Ju, Xu Tan, Eric Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiangyang Li, Sheng Zhao, Tao Qin, Jiang Bian

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Consistent and Relevant: Rethink the Query Embedding in General Sound Separation.

Yuanyuan Wang, Hangting Chen, Dongchao Yang, Jianwei Yu, Chao Weng, Zhiyong Wu, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2024

DPM-TSE: A Diffusion Probabilistic Model for Target Sound Extraction.

Jiarui Hai, Helin Wang, Dongchao Yang, Karan Thakkar, Najim Dehak, Mounya Elhilali

Proceedings of the IEEE International Conference on Acoustics, 2024

Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners.

Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Jinchuan Tian, Zhenhui Ye, Luping Liu, Zehan Wang, Ziyue Jiang, Xuankai Chang, Jiatong Shi, Chao Weng, Zhou Zhao, Dong Yu

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head.

Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Yuexian Zou, Zhou Zhao, Shinji Watanabe

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Diffsound: Discrete Diffusion Model for Text-to-Sound Generation.

Dongchao Yang, Jianwei Yu, Helin Wang, Wen Wang, Chao Weng, Yuexian Zou, Dong Yu

IEEE ACM Trans. Audio Speech Lang. Process., 2023

UniAudio: An Audio Foundation Model Toward Universal Audio Generation.

Dongchao Yang, Jinchuan Tian, Xu Tan, Rongjie Huang, Songxiang Liu, Xuankai Chang, Jiatong Shi, Sheng Zhao, Jiang Bian, Xixin Wu, Zhou Zhao, Shinji Watanabe, Helen Meng

CoRR, 2023

PromptTTS 2: Describing and Generating Voices with Text Prompt.

Yichong Leng, Zhifang Guo, Kai Shen, Xu Tan, Zeqian Ju, Yanqing Liu, Yufei Liu, Dongchao Yang, Leying Zhang, Kaitao Song, Lei He, Xiang-Yang Li, Sheng Zhao, Tao Qin, Jiang Bian

CoRR, 2023

Make-A-Voice: Unified Voice Synthesis With Discrete Representation.

Rongjie Huang, Chunlei Zhang, Yongqi Wang, Dongchao Yang, Luping Liu, Zhenhui Ye, Ziyue Jiang, Chao Weng, Zhou Zhao, Dong Yu

CoRR, 2023

Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation.

Jiawei Huang, Yi Ren, Rongjie Huang, Dongchao Yang, Zhenhui Ye, Chen Zhang, Jinglin Liu, Xiang Yin, Zejun Ma, Zhou Zhao

CoRR, 2023

HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codec.

Dongchao Yang, Songxiang Liu, Rongjie Huang, Jinchuan Tian, Chao Weng, Yuexian Zou

CoRR, 2023

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head.

Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Zhou Zhao, Shinji Watanabe

CoRR, 2023

InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Prompt.

Dongchao Yang, Songxiang Liu, Rongjie Huang, Guangzhi Lei, Chao Weng, Helen Meng, Dong Yu

CoRR, 2023

NoreSpeech: Knowledge Distillation based Conditional Diffusion Model for Noise-robust Expressive TTS.

Dongchao Yang, Songxiang Liu, Helin Wang, Jianwei Yu, Chao Weng, Yuexian Zou

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Background-aware Modeling for Weakly Supervised Sound Event Detection.

Yifei Xin, Dongchao Yang, Yuexian Zou

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models.

Rongjie Huang, Jiawei Huang, Dongchao Yang, Yi Ren, Luping Liu, Mingze Li, Zhenhui Ye, Jinglin Liu, Xiang Yin, Zhou Zhao

Proceedings of the International Conference on Machine Learning, 2023

Improving Text-Audio Retrieval by Text-Aware Attention Pooling and Prior Matrix Revised Loss.

Yifei Xin, Dongchao Yang, Yuexian Zou

Proceedings of the IEEE International Conference on Acoustics, 2023

Improving Weakly Supervised Sound Event Detection with Causal Intervention.

Yifei Xin, Dongchao Yang, Fan Cui, Yujun Wang, Yuexian Zou

Proceedings of the IEEE International Conference on Acoustics, 2023

NADiffuSE: Noise-aware Diffusion-based Model for Speech Enhancement.

Wen Wang, Dongchao Yang, Qichen Ye, Bowen Cao, Yuexian Zou

Proceedings of the Asia Pacific Signal and Information Processing Association Annual Summit and Conference, 2023

2022

A Two-student Learning Framework for Mixed Supervised Target Sound Detection.

Dongchao Yang, Helin Wang, Yuexian Zou, Wenwu Wang

CoRR, 2022

A Mobile Robot Design for Efficient and Large-Scale Solar Panel Cleaning.

Teng Li, Dongchao Yang, Chen Chen, Zecui Zeng, Geng Huang, Bo Tao, Jiahe Li

Proceedings of the IEEE International Conference on Robotics and Biomimetics, 2022

Target Confusion in End-to-end Speaker Extraction: Analysis and Approaches.

Zifeng Zhao, Dongchao Yang, Rongzhi Gu, Haoran Zhang, Yuexian Zou

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Speaker-Aware Mixture of Mixtures Training for Weakly Supervised Speaker Extraction.

Zifeng Zhao, Rongzhi Gu, Dongchao Yang, Jinchuan Tian, Yuexian Zou

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

RaDur: A Reference-aware and Duration-robust Network for Target Sound Detection.

Dongchao Yang, Helin Wang, Zhongjie Ye, Yuexian Zou, Wenwu Wang

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Audio Pyramid Transformer with Domain Adaption for Weakly Supervised Sound Event Detection and Audio Classification.

Yifei Xin, Dongchao Yang, Yuexian Zou

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Improving Target Sound Extraction with Timestamp Information.

Helin Wang, Dongchao Yang, Chao Weng, Jianwei Yu, Yuexian Zou

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

A Mutual Learning Framework for Few-Shot Sound Event Detection.

Dongchao Yang, Helin Wang, Yuexian Zou, Zhongjie Ye, Wenwu Wang

Proceedings of the IEEE International Conference on Acoustics, 2022

A Mixed Supervised Learning Framework For Target Sound Detection.

Dongchao Yang, Helin Wang, Wenwu Wang, Yuexian Zou

Proceedings of the 7th Workshop on Detection and Classification of Acoustic Scenes and Events 2022, 2022

Detect What You Want: Target Sound Detection.

Helin Wang, Dongchao Yang, Yuexian Zou, Fan Cui, Yujun Wang

Proceedings of the 7th Workshop on Detection and Classification of Acoustic Scenes and Events 2022, 2022

Omnidirectional Motion Control Method of Quadruped Robot Based on 3D-CPG Oscillator Group.

Bo Tao, Dongchao Yang, Geng Huang, Zecui Zeng, Chen Chen, Teng Li

Proceedings of the Robotics in Natural Settings, 2022

2021

Detect what you want: Target Sound Detection.

Dongchao Yang, Helin Wang, Yuexian Zou, Chao Weng

CoRR, 2021

Unsupervised Multi-Target Domain Adaptation for Acoustic Scene Classification.

Dongchao Yang, Helin Wang, Yuexian Zou

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

YOLOv3 with Asymmetric Intersection over Union Based Loss Function for Human Detection.

Heng Zhu, Dongchao Yang, Geng Huang, Qingyuan Wu, Teng Li, Bo Tao

Proceedings of the ICMLSC '21: 2021 The 5th International Conference on Machine Learning and Soft Computing, 2021

Improving the Performance of Automated Audio Captioning via Integrating the Acoustic and Semantic Information.

Zhongjie Ye, Helin Wang, Dongchao Yang, Yuexian Zou

Proceedings of the 6th Workshop on Detection and Classification of Acoustic Scenes and Events 2021 (DCASE 2021), 2021

2020

Towards Data Distillation for End-to-end Spoken Conversational Question Answering.

Chenyu You, Nuo Chen, Fenglin Liu, Dongchao Yang, Yuexian Zou

CoRR, 2020

A petal-array capacitive tactile sensor with micro-pin for robotic fingertip sensing.

Bin Fang, Yang Chen, Fuchun Sun, Dongchao Yang, Xu Zhang, Ziwei Xia, Huaping Liu

Proceedings of the 3rd IEEE International Conference on Soft Robotics, 2020