Excitation signal Extraction for Guitar tones. - Nelson Lee 001; Zhiyao Duan; Julius O. Smith III (ICMC, 2007)

Multi-Pitch Estimation Based on Partial Event and Support Transfer. - Zhiyao Duan; Dan Zhang 007; Changshui Zhang; Zhenwei Shi (ICME, 2007)

Audio tonality mode classification without tonic annotations. - Zhiyao Duan; Lie Lu; Changshui Zhang (ICME, 2008)

Collective Annotation of Music from Multiple Semantic Categories. - Zhiyao Duan; Lie Lu; Changshui Zhang (ISMIR, 2008)

Unsupervised Single-Channel Music Source Separation by Average Harmonic Structure Modeling. - Zhiyao Duan; Yungang Zhang; Changshui Zhang; Zhenwei Shi (IEEE Trans. Speech Audio Process., 2008)

Harmonically Informed Multi-Pitch Tracking. - Zhiyao Duan; Jinyu Han; Bryan Pardo (ISMIR, 2009)

Song-level multi-pitch tracking by heavily constrained clustering. - Zhiyao Duan; Jinyu Han; Bryan Pardo (ICASSP, 2010)

Multiple Fundamental Frequency Estimation by Modeling Spectral Peaks and Non-Peak Regions. - Zhiyao Duan; Bryan Pardo; Changshui Zhang (IEEE Trans. Speech Audio Process., 2010)

A state space model for online polyphonic audio-score alignment. - Zhiyao Duan; Bryan Pardo (ICASSP, 2011)

Aligning Semi-Improvised Music Audio with Its Lead Sheet. - Zhiyao Duan; Bryan Pardo (ISMIR, 2011)

Soundprism: An Online System for Score-Informed Source Separation of Music Audio. - Zhiyao Duan; Bryan Pardo (IEEE J. Sel. Top. Signal Process., 2011)

Online PLCA for Real-Time Semi-supervised Source Separation. - Zhiyao Duan; Gautham J. Mysore; Paris Smaragdis (LVA/ICA, 2012)

Speech Enhancement by Online Non-negative Spectrogram Decomposition in Non-stationary Noise Environments. - Zhiyao Duan; Gautham J. Mysore; Paris Smaragdis (INTERSPEECH, 2012)

A novel cepstral representation for timbre modeling of sound sources in polyphonic mixtures. - Zhiyao Duan; Bryan Pardo; Laurent Daudet (ICASSP, 2014)

Note-level Music Transcription by Maximum Likelihood Sampling. - Zhiyao Duan; David Temperley (ISMIR, 2014)

Multi-pitch Streaming of Harmonic Sound Mixtures. - Zhiyao Duan; Jinyu Han; Bryan Pardo (IEEE ACM Trans. Audio Speech Lang. Process., 2014)

Combining rhythm-based and pitch-based methods for background and melody separation. - Zafar Rafii; Zhiyao Duan; Bryan Pardo (IEEE ACM Trans. Audio Speech Lang. Process., 2014)

Piano music transcription modeling note temporal evolution. - Andrea Cogliati; Zhiyao Duan (ICASSP, 2015)

Score Following for Piano Performances with Sustain-Pedal Effects. - Bochen Li; Zhiyao Duan (ISMIR, 2015)

Piano music transcription with fast convolutional sparse coding. - Andrea Cogliati; Zhiyao Duan; Brendt Wohlberg (MLSP, 2015)

Retrieving sounds by vocal imitation recognition. - Yichi Zhang 008; Zhiyao Duan (MLSP, 2015)

Rotational reset strategy for online semi-supervised NMF-based speech enhancement for long recordings. - Jun Zhou; Shuo Chen; Zhiyao Duan (WASPAA, 2015)

Emotion classification: How does an automated system compare to Naive human coders? - Sefik Emre Eskimez; Kenneth Imade; Na Yang; Melissa Sturge-Apple; Zhiyao Duan; Wendi B. Heinzelman (ICASSP, 2016)

IMISOUND: An unsupervised system for sound query by vocal imitation. - Yichi Zhang 008; Zhiyao Duan (ICASSP, 2016)

WISE: Web-based Interactive Speech Emotion Classification. - Sefik Emre Eskimez; Melissa Sturge-Apple; Zhiyao Duan; Wendi B. Heinzelman (SAAIP@IJCAI, 2016)

Transcribing Human Piano Performances into Music Notation. - Andrea Cogliati; David Temperley; Zhiyao Duan (ISMIR, 2016)

Creating A Musical Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications. - Bochen Li; Xinzhao Liu; Karthik Dinesh; Zhiyao Duan; Gaurav Sharma 001 (CoRR, 2016)

Context-Dependent Piano Music Transcription With Convolutional Sparse Coding. - Andrea Cogliati; Zhiyao Duan; Brendt Wohlberg (IEEE ACM Trans. Audio Speech Lang. Process., 2016)

An Approach to Score Following for Piano Performances With the Sustained Effect. - Bochen Li; Zhiyao Duan (IEEE ACM Trans. Audio Speech Lang. Process., 2016)

Visually informed multi-pitch analysis of string ensembles. - Karthik Dinesh; Bochen Li; Xinzhao Liu; Zhiyao Duan; Gaurav Sharma 001 (ICASSP, 2017)

See and listen: Score-informed association of sound tracks to players in chamber music performance videos. - Bochen Li; Karthik Dinesh; Zhiyao Duan; Gaurav Sharma 001 (ICASSP, 2017)

Deep ranking: Triplet MatchNet for music metric learning. - Rui Lu; Kailun Wu; Zhiyao Duan; Changshui Zhang (ICASSP, 2017)

A Metric for Music Notation Transcription Accuracy. - Andrea Cogliati; Zhiyao Duan (ISMIR, 2017)

Video-Based Vibrato Detection and Analysis for Polyphonic String Music. - Bochen Li; Karthik Dinesh; Gaurav Sharma 001; Zhiyao Duan (ISMIR, 2017)

Deep Cross-Modal Audio-Visual Generation. - Lele Chen; Sudhanshu Srivastava; Zhiyao Duan; Chenliang Xu (ACM Multimedia (Thematic Workshops), 2017)

Metric learning based data augmentation for environmental sound classification. - Rui Lu; Zhiyao Duan; Changshui Zhang (WASPAA, 2017)

IMINET: Convolutional semi-siamese networks for sound search by vocal imitation. - Yichi Zhang 008; Zhiyao Duan (WASPAA, 2017)

Enhanced multiclass SVM with thresholding fusion for speech-based emotion classification. - Na Yang; Jianbo Yuan; Yun Zhou; Ilker Demirkol; Zhiyao Duan; Wendi B. Heinzelman; Melissa Sturge-Apple (Int. J. Speech Technol., 2017)

Piano Transcription With Convolutional Sparse Lateral Inhibition. - Andrea Cogliati; Zhiyao Duan; Brendt Wohlberg (IEEE Signal Process. Lett., 2017)

Vocal Imitation Set: a dataset of vocally imitated sound events using the AudioSet ontology. - Bongjun Kim; Madhav Ghei; Bryan Pardo; Zhiyao Duan (DCASE, 2018)

Lip Movements Generation at a Glance. - Lele Chen; Zhiheng Li 002; Ross K. Maddox; Zhiyao Duan; Chenliang Xu (ECCV (7), 2018)

Audio-Visual Event Localization in Unconstrained Videos. - Yapeng Tian; Jing Shi 005; Bochen Li; Zhiyao Duan; Chenliang Xu (ECCV (2), 2018)

Generating Talking Face Landmarks from Speech. - Sefik Emre Eskimez; Ross K. Maddox; Chenliang Xu; Zhiyao Duan (LVA/ICA, 2018)

Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition. - Sefik Emre Eskimez; Zhiyao Duan; Wendi B. Heinzelman (ICASSP, 2018)

Multi-Scale Recurrent Neural Network for Sound Event Detection. - Rui Lu; Zhiyao Duan; Changshui Zhang (ICASSP, 2018)

Score-Aligned Polyphonic Microtiming Estimation. - Xueyang Wang; Ryan Stables; Bochen Li; Zhiyao Duan (ICASSP, 2018)

Visualization and Interpretation of Siamese Style Convolutional Neural Networks for Sound Search by Vocal Imitation. - Yichi Zhang 008; Zhiyao Duan (ICASSP, 2018)

Joint Speaker Diarization and Recognition Using Convolutional and Recurrent Neural Networks. - Zhihan Zhou 004; Yichi Zhang 008; Zhiyao Duan (ICASSP, 2018)

Skeleton Plays Piano: Online Generation of Pianist Body Movements from MIDI Performance. - Bochen Li; Akira Maezawa; Zhiyao Duan (ISMIR, 2018)

Part-invariant Model for Music Generation and Harmonization. - Yujia Yan; Ethan Lustig; Joseph VanderStel; Zhiyao Duan (ISMIR, 2018)

Front-end speech enhancement for commercial speaker verification systems. - Sefik Emre Eskimez; Peter Soufleris; Zhiyao Duan; Wendi B. Heinzelman (Speech Commun., 2018)

Listen and Look: Audio-Visual Matching Assisted Speech Source Separation. - Rui Lu; Zhiyao Duan; Changshui Zhang (IEEE Signal Process. Lett., 2018)

Hierarchical Cross-Modal Talking Face Generation With Dynamic Pixel-Wise Loss. - Lele Chen; Ross K. Maddox; Zhiyao Duan; Chenliang Xu (CVPR, 2019)

Sound to Visual: Hierarchical Cross-Modal Talking Face Generation. - Lele Chen; Haitian Zheng; Ross K. Maddox; Zhiyao Duan; Chenliang Xu (CVPR Workshops, 2019)

Audio-Visual Event Localization in the Wild. - Yapeng Tian; Jing Shi 005; Bochen Li; Zhiyao Duan; Chenliang Xu (CVPR Workshops, 2019)

Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Loss. - Lele Chen; Ross K. Maddox; Zhiyao Duan; Chenliang Xu (CoRR, 2019)

Sound Search by Text Description or Vocal Imitation? - Yichi Zhang 008; Yiting Zhang; Zhiyao Duan (CoRR, 2019)

Spoofing Speaker Verification Systems with Deep Multi-speaker Text-to-speech Synthesis. - Mingrui Yuan; Zhiyao Duan (CoRR, 2019)

Adversarial Training for Speech Super-Resolution. - Sefik Emre Eskimez; Kazuhito Koishida; Zhiyao Duan (IEEE J. Sel. Top. Signal Process., 2019)

Automatic Music Transcription: An Overview. - Emmanouil Benetos; Simon Dixon; Zhiyao Duan; Sebastian Ewert (IEEE Signal Process. Mag., 2019)

Audiovisual Analysis of Music Performances: Overview of an Emerging Field. - Zhiyao Duan; Slim Essid; Cynthia C. S. Liem; Gaël Richard; Gaurav Sharma 001 (IEEE Signal Process. Mag., 2019)

Audio-Visual Deep Clustering for Speech Separation. - Rui Lu; Zhiyao Duan; Changshui Zhang (IEEE ACM Trans. Audio Speech Lang. Process., 2019)

Siamese Style Convolutional Neural Networks for Sound Search by Vocal Imitation. - Yichi Zhang 008; Bryan Pardo; Zhiyao Duan (IEEE ACM Trans. Audio Speech Lang. Process., 2019)

Online Audio-Visual Source Association for Chamber Music Performances. - Bochen Li; Karthik Dinesh; Chenliang Xu; Gaurav Sharma 001; Zhiyao Duan (Trans. Int. Soc. Music. Inf. Retr., 2019)

Creating a Multitrack Classical Music Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications. - Bochen Li; Xinzhao Liu; Karthik Dinesh; Zhiyao Duan; Gaurav Sharma 001 (IEEE Trans. Multim., 2019)

RL-Duet: Online Music Accompaniment Generation Using Deep Reinforcement Learning. - Nan Jiang; Sheng Jin 007; Zhiyao Duan; Changshui Zhang (AAAI, 2020)

Vroom!: A Search Engine for Sounds by Vocal Imitation Queries. - Yichi Zhang 008; Junbo Hu; Yiting Zhang; Bryan Pardo; Zhiyao Duan (CHIIR, 2020)

End-To-End Generation of Talking Faces from Noisy Speech. - Sefik Emre Eskimez; Ross K. Maddox; Chenliang Xu; Zhiyao Duan (ICASSP, 2020)

BachDuet: A Deep Learning System for Human-Machine Counterpoint Improvisation. - Christodoulos Benetatos; Joseph VanderStel; Zhiyao Duan (NIME, 2020)

When Counterpoint Meets Chinese Folk Melodies. - Nan Jiang; Sheng Jin 007; Zhiyao Duan; Changshui Zhang (NeurIPS, 2020)

Themes Inferred Audio-visual Correspondence Learning. - Runze Su; Fei Tao; Xudong Liu; Haoran Wei; Xiaorong Mei; Zhiyao Duan; Lei Yuan 001; Ji Liu 002; Yuying Xie (CoRR, 2020)

Raw-x-vector: Multi-scale Time Domain Speaker Embedding Network. - Ge Zhu; Fei Jiang; Zhiyao Duan (CoRR, 2020)

One-class learning towards generalized voice spoofing detection. - You Zhang 001; Fei Jiang; Zhiyao Duan (CoRR, 2020)

Do not look back: an online beat tracking method using RNN and enhanced particle filtering. - Mojtaba Heydari; Zhiyao Duan (CoRR, 2020)

Speaker Attractor Network: Generalizing Speech Separation to Unseen Numbers of Sources. - Fei Jiang; Zhiyao Duan (IEEE Signal Process. Lett., 2020)

Noise-Resilient Training Method for Face Landmark Generation From Speech. - Sefik Emre Eskimez; Ross K. Maddox; Chenliang Xu; Zhiyao Duan (IEEE ACM Trans. Audio Speech Lang. Process., 2020)

Don't Look Back: An Online Beat Tracking Method Using RNN and Enhanced Particle Filtering. - Mojtaba Heydari; Zhiyao Duan (ICASSP, 2021)

An Empirical Study on Channel Effects for Synthetic Voice Spoofing Countermeasure Systems. - You Zhang 001; Ge Zhu; Fei Jiang; Zhiyao Duan (Interspeech, 2021)

Y-Vector: Multiscale Waveform Encoder for Speaker Embedding. - Ge Zhu; Fei Jiang; Zhiyao Duan (Interspeech, 2021)

BeatNet: CRNN and Particle Filtering for Online Joint Beat, Downbeat and Meter Tracking. - Mojtaba Heydari; Frank Cwitkowitz; Zhiyao Duan (ISMIR, 2021)

CollageNet: Fusing arbitrary melody and accompaniment into a coherent song. - Abudukelimu Wuerkaixi; Christodoulos Benetatos; Zhiyao Duan; Changshui Zhang (ISMIR, 2021)

Skipping the Frame-Level: Event-Based Piano Transcription With Neural Semi-CRFs. - Yujia Yan; Frank Cwitkowitz; Zhiyao Duan (NeurIPS, 2021)

UR Channel-Robust Synthetic Speech Detection System for ASVspoof 2021. - Xinhui Chen; You Zhang 001; Ge Zhu; Zhiyao Duan (CoRR, 2021)

Learning Sparse Analytic Filters for Piano Transcription. - Frank Cwitkowitz; Mojtaba Heydari; Zhiyao Duan (CoRR, 2021)

One-Class Learning Towards Synthetic Voice Spoofing Detection. - You Zhang 001; Fei Jiang; Zhiyao Duan (IEEE Signal Process. Lett., 2021)

Audiovisual Singing Voice Separation. - Bochen Li; Yuxuan Wang; Zhiyao Duan (Trans. Int. Soc. Music. Inf. Retr., 2021)

A Novel 1D State Space for Efficient Music Rhythmic Analysis. - Mojtaba Heydari; Matthew C. McCallum; Andreas F. Ehmann; Zhiyao Duan (ICASSP, 2022)

Progressive Teacher-Student Training Framework for Music Tagging. - Rui Lu; Baigong Zheng; Jiarui Hai; Fei Tao; Zhiyao Duan; Ji Liu 002 (ICASSP, 2022)

A Study of The Robustness of Raw Waveform Based Speaker Embeddings Under Mismatched Conditions. - Ge Zhu; Frank Cwitkowitz; Zhiyao Duan (ICASSP, 2022)

Singing beat tracking with Self-supervised front-end and linear transformers. - Mojtaba Heydari; Zhiyao Duan (ISMIR, 2022)

Rethinking Audio-Visual Synchronization for Active Speaker Detection. - Abudukelimu Wuerkaixi; You Zhang 001; Zhiyao Duan; Changshui Zhang (MLSP, 2022)

DyViSE: Dynamic Vision-Guided Speaker Embedding for Audio-Visual Speaker Diarization. - Abudukelimu Wuerkaixi; Kunda Yan; You Zhang 001; Zhiyao Duan; Changshui Zhang (MMSP, 2022)

A Probabilistic Fusion Framework for Spoofing Aware Speaker Verification. - You Zhang 001; Ge Zhu; Zhiyao Duan (Odyssey, 2022)

A New Fusion Strategy for Spoofing Aware Speaker Verification. - You Zhang 001; Ge Zhu; Zhiyao Duan (CoRR, 2022)

A Data-Driven Methodology for Considering Feasibility and Pairwise Likelihood in Deep Learning Based Guitar Tablature Transcription Systems. - Frank Cwitkowitz; Jonathan Driedger; Zhiyao Duan (CoRR, 2022)

Predicting Global Head-Related Transfer Functions From Scanned Head Geometry Using Deep Learning and Compact Representations. - Yuxiang Wang; You Zhang 001; Zhiyao Duan; Mark Bocko (CoRR, 2022)

ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and Rhythm. - Meiying Chen; Zhiyao Duan (CoRR, 2022)

Music Source Separation With Generative Flow. - Ge Zhu; Jordan Darefsky; Fei Jiang; Anton Selitskiy; Zhiyao Duan (IEEE Signal Process. Lett., 2022)

Draw and Listen! A Sketch-Based System for Music Inpainting. - Christodoulos Benetatos; Zhiyao Duan (Trans. Int. Soc. Music. Inf. Retr., 2022)

Speech Driven Talking Face Generation From a Single Image and an Emotion Condition. - Sefik Emre Eskimez; You Zhang 001; Zhiyao Duan (IEEE Trans. Multim., 2022)

SAMO: Speaker Attractor Multi-Center One-Class Learning For Voice Anti-Spoofing. - Siwen Ding; You Zhang 001; Zhiyao Duan (ICASSP, 2023)

SingNet: a real-time Singing Voice beat and Downbeat Tracking System. - Mojtaba Heydari; Ju-Chiang Wang; Zhiyao Duan (ICASSP, 2023)

HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields. - You Zhang 001; Yuxiang Wang; Zhiyao Duan (ICASSP, 2023)

Transcription Free Filler Word Detection with Neural Semi-CRFs. - Ge Zhu; Yujia Yan; Juan Pablo Cáceres; Zhiyao Duan (ICASSP, 2023)

ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and Speed. - Meiying Chen; Zhiyao Duan (INTERSPEECH, 2023)

Phase perturbation improves channel robustness for speech spoofing countermeasures. - Yongyi Zang; You Zhang 001; Zhiyao Duan (INTERSPEECH, 2023)

Harmonic Analysis With Neural Semi-CRF. - Qiaoyu Yang; Frank Cwitkowitz; Zhiyao Duan (ISMIR, 2023)

Mitigating Cross-Database Differences for Learning Unified HRTF Representation. - Yutong Wen; You Zhang 001; Zhiyao Duan (WASPAA, 2023)

EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesis. - Ge Zhu; Yutong Wen; Marc-André Carbonneau; Zhiyao Duan (CoRR, 2023)

Editorial for TISMIR Special Collection: Cultural Diversity in MIR Research. - Zhiyao Duan; Peter van Kranenburg; Juhan Nam; Preeti Rao (Trans. Int. Soc. Music. Inf. Retr., 2023)

SingFake: Singing Voice Deepfake Detection. - Yongyi Zang; You Zhang 001; Mojtaba Heydari; Zhiyao Duan (ICASSP, 2024)

SynthTab: Leveraging Synthesized Data for Guitar Tablature Transcription. - Yongyi Zang; Yi Zhong; Frank Cwitkowitz; Zhiyao Duan (ICASSP, 2024)

Learning Arousal-Valence Representation from Categorical Emotion Labels of Speech. - Enting Zhou; You Zhang 001; Zhiyao Duan (ICASSP, 2024)

Cacophony: An Improved Contrastive Audio-Text Model. - Ge Zhu; Zhiyao Duan (CoRR, 2024)

Toward Fully Self-Supervised Multi-Pitch Estimation. - Frank Cwitkowitz; Zhiyao Duan (CoRR, 2024)

Scoring Intervals using Non-Hierarchical Transformer For Automatic Piano Transcription. - Yujia Yan; Zhiyao Duan (CoRR, 2024)

SVDD Challenge 2024: A Singing Voice Deepfake Detection Challenge Evaluation Plan. - You Zhang 001; Yongyi Zang; Jiatong Shi; Ryuichi Yamamoto; Jionghao Han; Yuxun Tang; Tomoki Toda; Zhiyao Duan (CoRR, 2024)

CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection. - Yongyi Zang; Jiatong Shi; You Zhang 001; Ryuichi Yamamoto; Jionghao Han; Yuxun Tang; Shengyuan Xu; Wenxiao Zhao; Jing Guo; Tomoki Toda; Zhiyao Duan (CoRR, 2024)

GTR-Voice: Articulatory Phonetics Informed Controllable Expressive Speech Synthesis. - Zehua Kcriss Li; Meiying Melissa Chen; Yi Zhong; Pinxin Liu; Zhiyao Duan (CoRR, 2024)

A Multi-Stream Fusion Approach with One-Class Learning for Audio-Visual Deepfake Detection. - Kyungbok Lee; You Zhang 001; Zhiyao Duan (CoRR, 2024)

Generating Data with Text-to-Speech and Large-Language Models for Conversational Speech Recognition. - Samuele Cornell; Jordan Darefsky; Zhiyao Duan; Shinji Watanabe 001 (CoRR, 2024)

SVDD 2024: The Inaugural Singing Voice Deepfake Detection Challenge. - You Zhang 001; Yongyi Zang; Jiatong Shi; Ryuichi Yamamoto; Tomoki Toda; Zhiyao Duan (CoRR, 2024)

MusicHiFi: Fast High-Fidelity Stereo Vocoding. - Ge Zhu; Juan Pablo Cáceres; Zhiyao Duan; Nicholas J. Bryan (IEEE Signal Process. Lett., 2024)