Shiyin Kang

According to our database, Shiyin Kang authored at least 63 papers between 2009 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

An End-to-End Approach for Chord-Conditioned Song Generation.

Shuochen Gao, Shun Lei, Fan Zhuo, Hangyu Liu, Feng Liu, Boshi Tang, Qiaochu Huang, Shiyin Kang, Zhiyong Wu

CoRR, 2024

SongCreator: Lyrics-based Universal Song Generation.

Shun Lei, Yixuan Zhou, Boshi Tang, Max W. Y. Lam, Feng Liu, Hangyu Liu, Jingcheng Wu, Shiyin Kang, Zhiyong Wu, Helen Meng

CoRR, 2024

Foundation Models for Music: A Survey.

Yinghao Ma, Anders Øland, Anton Ragni, Bleiz Macsen Del Sette, Charalampos Saitis, Chris Donahue, Chenghua Lin, Christos Plachouras, Emmanouil Benetos, Elio Quinton, Elona Shatri, Fabio Morreale, Ge Zhang, György Fazekas, Gus Xia, Huan Zhang, Ilaria Manco, Jiawen Huang, Julien Guinot, Liwei Lin, Luca Marinelli, Max W. Y. Lam, Megha Sharma, Qiuqiang Kong, Roger B. Dannenberg, Ruibin Yuan, Shangda Wu, Shih-Lun Wu, Shuqi Dai, Shun Lei, Shiyin Kang, Simon Dixon, Wenhu Chen, Wenhao Huang, Xingjian Du, Xingwei Qu, Xu Tan, Yizhi Li, Zeyue Tian, Zhiyong Wu, Zhizheng Wu, Ziyang Ma, Ziyu Wang

CoRR, 2024

ChatMusician: Understanding and Generating Music Intrinsically with LLM.

Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Ziyang Ma, Liumeng Xue, Ziyu Wang, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Pengfei Li, Jingcheng Wu, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Emmanouil Benetos, Jie Fu, Gus Xia, Roger B. Dannenberg, Wei Xue, Shiyin Kang, Yike Guo

CoRR, 2024

SCNet: Sparse Compression Network for Music Source Separation.

Weinan Tong, Jiaxu Zhu, Jun Chen, Shiyin Kang, Tao Jiang, Yang Li, Zhiyong Wu, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2024

Multi-View Midivae: Fusing Track- and Bar-View Representations for Long Multi-Track Symbolic Music Generation.

Zhiwei Lin, Jun Chen, Boshi Tang, Binzhu Sha, Jing Yang, Yaolong Ju, Fan Fan, Shiyin Kang, Zhiyong Wu, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2024

Generating Stereophonic Music with Single-Stage Language Models.

Xingda Li, Fan Zhuo, Dan Luo, Jun Chen, Shiyin Kang, Zhiyong Wu, Tao Jiang, Yang Li, Han Fang, Yahui Zhou

Proceedings of the IEEE International Conference on Acoustics, 2024

Improving Language Model-Based Zero-Shot Text-to-Speech Synthesis with Multi-Scale Acoustic Prompts.

Shun Lei, Yixuan Zhou, Liyang Chen, Dan Luo, Zhiyong Wu, Xixin Wu, Shiyin Kang, Tao Jiang, Yahui Zhou, Yuxing Han, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2024

ChatMusician: Understanding and Generating Music Intrinsically with LLM.

Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Liumeng Xue, Ziyang Ma, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Jie Fu, Emmanouil Benetos, Gus Xia, Roger B. Dannenberg, Wei Xue, Shiyin Kang, Yike Guo

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

MSStyleTTS: Multi-Scale Style Modeling With Hierarchical Context Information for Expressive Speech Synthesis.

Shun Lei, Yixuan Zhou, Liyang Chen, Zhiyong Wu, Xixin Wu, Shiyin Kang, Helen Meng

IEEE ACM Trans. Audio Speech Lang. Process., 2023

AdaMesh: Personalized Facial Expressions and Head Poses for Speech-Driven 3D Facial Animation.

Liyang Chen, Weihong Bao, Shun Lei, Boshi Tang, Zhiyong Wu, Shiyin Kang, Haozhi Huang

CoRR, 2023

Towards Spontaneous Style Modeling with Semi-supervised Pre-training for Conversational Text-to-Speech Synthesis.

Weiqin Li, Shun Lei, Qiaochu Huang, Yixuan Zhou, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

GTN-Bailando: Genre Consistent long-Term 3D Dance Generation Based on Pre-Trained Genre Token Network.

Haolin Zhuang, Shun Lei, Long Xiao, Weiqin Li, Liyang Chen, Sicheng Yang, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2023

CB-Conformer: Contextual Biasing Conformer for Biased Word Recognition.

Yaoxun Xu, Baiji Liu, Qiaochu Huang, Xingchen Song, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2023

TFCnet: Time-Frequency Domain Corrector for Speech Separation.

Weinan Tong, Jiaxu Zhu, Jun Chen, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2023

Context-Aware Coherent Speaking Style Prediction with Hierarchical Transformers for Audiobook Speech Synthesis.

Shun Lei, Yixuan Zhou, Liyang Chen, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2023

2022

Disentangleing Content and Fine-grained Prosody Information via Hybrid ASR Bottleneck Features for Voice Conversion.

Xintao Zhao, Feng Liu, Changhe Song, Zhiyong Wu, Shiyin Kang, Deyi Tuo, Helen Meng

CoRR, 2022

Efficient Text Analysis with Pre-Trained Neural Network Models.

Jia Cui, Heng Lu, Wenjie Wang, Shiyin Kang, Liqiang He, Guangzhi Li, Dong Yu

Proceedings of the IEEE Spoken Language Technology Workshop, 2022

Towards Improving the Expressiveness of Singing Voice Synthesis with BERT Derived Semantic Information.

Shaohuan Zhou, Shun Lei, Weiya You, Deyi Tuo, Yuren You, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Towards Multi-Scale Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis.

Shun Lei, Yixuan Zhou, Liyang Chen, Jiankun Hu, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Improving Mandarin Prosodic Structure Prediction with Multi-level Contextual Information.

Jie Chen, Changhe Song, Deyi Tuo, Xixin Wu, Shiyin Kang, Zhiyong Wu, Helen Meng

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

Disentangling Content and Fine-Grained Prosody Information Via Hybrid ASR Bottleneck Features for Voice Conversion.

Xintao Zhao, Feng Liu, Changhe Song, Zhiyong Wu, Shiyin Kang, Deyi Tuo, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2022

Towards Expressive Speaking Style Modelling with Hierarchical Context Information for Mandarin Speech Synthesis.

Shun Lei, Yixuan Zhou, Liyang Chen, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2022

FullSubNet+: Channel Attention Fullsubnet with Complex Spectrograms for Speech Enhancement.

Jun Chen, Zilin Wang, Deyi Tuo, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2022

2021

Exemplar-Based Emotive Speech Synthesis.

Xixin Wu, Yuewen Cao, Hui Lu, Songxiang Liu, Shiyin Kang, Zhiyong Wu, Xunying Liu, Helen Meng

IEEE ACM Trans. Audio Speech Lang. Process., 2021

Exploring Cross-lingual Singing Voice Synthesis Using Speech Data.

Yuewen Cao, Songxiang Liu, Shiyin Kang, Na Hu, Peng Liu, Xunying Liu, Dan Su, Dong Yu, Helen Meng

Proceedings of the 12th International Symposium on Chinese Spoken Language Processing, 2021

Adversarially Learning Disentangled Speech Representations for Robust Multi-Factor Voice Conversion.

Jie Wang, Jingbei Li, Xintao Zhao, Zhiyong Wu, Shiyin Kang, Helen Meng

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

VAENAR-TTS: Variational Auto-Encoder Based Non-AutoRegressive Text-to-Speech Synthesis.

Hui Lu, Zhiyong Wu, Xixin Wu, Xu Li, Shiyin Kang, Xunying Liu, Helen Meng

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

The Huya Multi-Speaker and Multi-Style Speech Synthesis System for M2voc Challenge 2020.

Jie Wang, Yuren You, Feng Liu, Deyi Tuo, Shiyin Kang, Zhiyong Wu, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2021

Speaker Independent and Multilingual/Mixlingual Speech-Driven Talking Head Generation Using Phonetic Posteriorgrams.

Huirong Huang, Zhiyong Wu, Shiyin Kang, Dongyang Dai, Jia Jia, Tianxiao Fu, Deyi Tuo, Guangzhi Lei, Peng Liu, Dan Su, Dong Yu, Helen Meng

Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2021

2020

On the localness modeling for the self-attention based end-to-end speech synthesis.

Shan Yang, Heng Lu, Shiyin Kang, Liumeng Xue, Jinba Xiao, Dan Su, Lei Xie, Dong Yu

Neural Networks, 2020

DurIAN: Duration Informed Attention Network for Speech Synthesis.

Chengzhu Yu, Heng Lu, Na Hu, Meng Yu, Chao Weng, Kun Xu, Peng Liu, Deyi Tuo, Shiyin Kang, Guangzhi Lei, Dan Su, Dong Yu

Proceedings of the 21st Annual Conference of the International Speech Communication Association, 2020

Transferring Source Style in Non-Parallel Voice Conversion.

Songxiang Liu, Yuewen Cao, Shiyin Kang, Na Hu, Xunying Liu, Dan Su, Dong Yu, Helen Meng

Proceedings of the 21st Annual Conference of the International Speech Communication Association, 2020

Audio-Visual Recognition of Overlapped Speech for the LRS2 Dataset.

Jianwei Yu, Shi-Xiong Zhang, Jian Wu, Shahram Ghorbani, Bo Wu, Shiyin Kang, Shansong Liu, Xunying Liu, Helen Meng, Dong Yu

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

End-To-End Accent Conversion Without Using Native Utterances.

Songxiang Liu, Disong Wang, Yuewen Cao, Lifa Sun, Xixin Wu, Shiyin Kang, Zhiyong Wu, Xunying Liu, Dan Su, Dong Yu, Helen Meng

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

Code-Switched Speech Synthesis Using Bilingual Phonetic Posteriorgram with Only Monolingual Corpora.

Yuewen Cao, Songxiang Liu, Xixin Wu, Shiyin Kang, Peng Liu, Zhiyong Wu, Xunying Liu, Dan Su, Dong Yu, Helen Meng

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

2019

DurIAN: Duration Informed Attention Network For Multimodal Synthesis.

Chengzhu Yu, Heng Lu, Na Hu, Meng Yu, Chao Weng, Kun Xu, Peng Liu, Deyi Tuo, Shiyin Kang, Guangzhi Lei, Dan Su, Dong Yu

CoRR, 2019

Maximizing Mutual Information for Tacotron.

Peng Liu, Xixin Wu, Shiyin Kang, Guangzhi Li, Dan Su, Dong Yu

CoRR, 2019

One-Shot Voice Conversion with Global Speaker Embeddings.

Hui Lu, Zhiyong Wu, Dongyang Dai, Runnan Li, Shiyin Kang, Jia Jia, Helen Meng

Proceedings of the 20th Annual Conference of the International Speech Communication Association, 2019

Multimedia Simultaneous Translation System for Minority Language Communication with Mandarin.

Shen Huang, Bojie Hu, Shan Huang, Pengfei Hu, Jian Kang, Zhiqiang Lv, Jinghao Yan, Qi Ju, Shiyin Kang, Deyi Tuo, Guangzhi Li, Nurmemet Yolwas

Proceedings of the 20th Annual Conference of the International Speech Communication Association, 2019

Disambiguation of Chinese Polyphones in an End-to-End Framework with Semantic Features Extracted by Pre-Trained BERT.

Dongyang Dai, Zhiyong Wu, Shiyin Kang, Xixin Wu, Jia Jia, Dan Su, Dong Yu, Helen Meng

Proceedings of the 20th Annual Conference of the International Speech Communication Association, 2019

Quasi-fully Convolutional Neural Network with Variational Inference for Speech Synthesis.

Mu Wang, Xixin Wu, Zhiyong Wu, Shiyin Kang, Deyi Tuo, Guangzhi Li, Dan Su, Dong Yu, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2019

A Compact Framework for Voice Conversion Using Wavenet Conditioned on Phonetic Posteriorgrams.

Hui Lu, Zhiyong Wu, Runnan Li, Shiyin Kang, Jia Jia, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2019

Automatic Prosodic Structure Labeling using DNN-BGRU-CRF Hybrid Neural Network.

Yao Du, Zhiyong Wu, Shiyin Kang, Dan Su, Dong Yu, Helen Meng

Proceedings of the 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2019

Prosodic Structure Prediction using Deep Self-attention Neural Network.

Yao Du, Zhiyong Wu, Shiyin Kang, Dan Su, Dong Yu, Helen Meng

Proceedings of the 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2019

2018

Speech Super-Resolution Using Parallel WaveNet.

Mu Wang, Zhiyong Wu, Shiyin Kang, Xixin Wu, Jia Jia, Dan Su, Dong Yu, Helen Meng

Proceedings of the 11th International Symposium on Chinese Spoken Language Processing, 2018

Rapid Style Adaptation Using Residual Error Embedding for Expressive Speech Synthesis.

Xixin Wu, Yuewen Cao, Mu Wang, Songxiang Liu, Shiyin Kang, Zhiyong Wu, Xunying Liu, Dan Su, Dong Yu, Helen Meng

Proceedings of the 19th Annual Conference of the International Speech Communication Association, 2018

Neural Network Language Modeling with Letter-Based Features and Importance Sampling.

Hainan Xu, Ke Li, Yiming Wang, Jian Wang, Shiyin Kang, Xie Chen, Daniel Povey, Sanjeev Khudanpur

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

Feature Based Adaptation for Speaking Style Synthesis.

Xixin Wu, Lifa Sun, Shiyin Kang, Songxiang Liu, Zhiyong Wu, Xunying Liu, Helen Meng

Proceedings of the 2018 IEEE International Conference on Acoustics, 2018

2016

Personalized, Cross-Lingual TTS Using Phonetic Posteriorgrams.

Lifa Sun, Hao Wang, Shiyin Kang, Kun Li, Helen M. Meng

Proceedings of the 17th Annual Conference of the International Speech Communication Association, 2016

Phonetic posteriorgrams for many-to-one voice conversion without parallel data training.

Lifa Sun, Kun Li, Hao Wang, Shiyin Kang, Helen M. Meng

Proceedings of the IEEE International Conference on Multimedia and Expo, 2016

Learning cross-lingual information with multilingual BLSTM for speech synthesis of low-resource languages.

Quanjie Yu, Peng Liu, Zhiyong Wu, Shiyin Kang, Helen Meng, Lianhong Cai

Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

2015

Deep Learning for Acoustic Modeling in Parametric Speech Generation: A systematic review of existing techniques and future trends.

Zhen-Hua Ling, Shiyin Kang, Heiga Zen, Andrew W. Senior, Mike Schuster, Xiaojun Qian, Helen M. Meng, Li Deng

IEEE Signal Process. Mag., 2015

Integrating acoustic and state-transition models for free phone recognition in L2 English speech using multi-distribution deep neural networks.

Kun Li, Xiaojun Qian, Shiyin Kang, Pengfei Liu, Helen Meng

Proceedings of the ISCA International Workshop on Speech and Language Technology in Education, 2015

Voice conversion using deep Bidirectional Long Short-Term Memory based Recurrent Neural Networks.

Lifa Sun, Shiyin Kang, Kun Li, Helen M. Meng

Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

A deep recurrent approach for acoustic-to-articulatory inversion.

Peng Liu, Quanjie Yu, Zhiyong Wu, Shiyin Kang, Helen M. Meng, Lianhong Cai

Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

2014

Statistical parametric speech synthesis using weighted multi-distribution deep belief network.

Shiyin Kang, Helen M. Meng

Proceedings of the 15th Annual Conference of the International Speech Communication Association, 2014

2013

Lexical stress detection for L2 English speech using deep belief networks.

Kun Li, Xiaojun Qian, Shiyin Kang, Helen Meng

Proceedings of the 14th Annual Conference of the International Speech Communication Association, 2013

Multi-distribution deep belief network for speech synthesis.

Shiyin Kang, Xiaojun Qian, Helen Meng

Proceedings of the IEEE International Conference on Acoustics, 2013

2010

HMM based TTS for mixed language text.

Zhiwei Shuang, Shiyin Kang, Yong Qin, Li-Rong Dai, Lianhong Cai

Proceedings of the 11th Annual Conference of the International Speech Communication Association, 2010

Comparison of Syllable/Phone HMM Based Mandarin TTS.

Quansheng Duan, Shiyin Kang, Zhiyong Wu, Lianhong Cai, Zhiwei Shuang, Yong Qin

Proceedings of the 20th International Conference on Pattern Recognition, 2010

2009

Syllable HMM based Mandarin TTS and comparison with concatenative TTS.

Zhiwei Shuang, Shiyin Kang, Qin Shi, Yong Qin, Lianhong Cai

Proceedings of the 10th Annual Conference of the International Speech Communication Association, 2009

Voiced/unvoiced decision algorithm for HMM-based speech synthesis.

Shiyin Kang, Zhiwei Shuang, Quansheng Duan, Yong Qin, Lianhong Cai

Proceedings of the 10th Annual Conference of the International Speech Communication Association, 2009