Zhi-Yao Duan

Most-cited papers

Hierarchical Cross-Modal Talking Face Generation With Dynamic Pixel-Wise Loss
Lele Chen, R. Maddox, Zhi-Yao Duan, Chen-Liang Xu
2019Computer Vision and Pattern Recognition482 citations
Semantic Scholar
Lip Movements Generation at a Glance
Lele Chen, Zhiheng Li, R. Maddox, Zhi-Yao Duan +1 more
2018European Conference on Computer Vision331 citations Open access
Semantic Scholar
One-Class Learning Towards Synthetic Voice Spoofing Detection
You Zhang, Fei Jiang, Zhi-Yao Duan
2020IEEE Signal Processing Letters319 citations Open access
Semantic Scholar
Automatic Music Transcription: An Overview
Emmanouil Benetos, S. Dixon, Zhi-Yao Duan, Sebastian Ewert
2019IEEE Signal Processing Magazine315 citations Open access
Semantic Scholar
Deep Cross-Modal Audio-Visual Generation
Lele Chen, Sudhanshu Srivastava, Zhi-Yao Duan, Chen-Liang Xu
2017ACM Multimedia236 citations Open access
Semantic Scholar
Creating a Multitrack Classical Music Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications
Bo-Chen Li, Xinzhao Liu, K. Dinesh, Zhi-Yao Duan +1 more
2016IEEE transactions on multimedia209 citations Open access
Semantic Scholar
Speech Driven Talking Face Generation From a Single Image and an Emotion Condition
Sefik Emre Eskimez, You Zhang, Zhi-Yao Duan
2020IEEE transactions on multimedia118 citations Open access
Semantic Scholar
UR Channel-Robust Synthetic Speech Detection System for ASVspoof 2021
Xinhui Chen, You Zhang, Ge Zhu, Zhi-Yao Duan
20212021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge69 citations Open access
Semantic Scholar
Unsupervised Learning Approach to Feature Analysis for Automatic Speech Emotion Recognition
Sefik Emre Eskimez, Zhi-Yao Duan, W. Heinzelman
2018IEEE International Conference on Acoustics, Speech, and Signal Processing66 citations
Semantic Scholar
Generating Talking Face Landmarks from Speech
Sefik Emre Eskimez, R. Maddox, Chen-Liang Xu, Zhi-Yao Duan
2018Latent Variable Analysis and Signal Separation60 citations Open access
Semantic Scholar
RL-Duet: Online Music Accompaniment Generation Using Deep Reinforcement Learning
Nan Jiang, Sheng Jin, Zhi-Yao Duan, Chang-Shui Zhang
2020AAAI Conference on Artificial Intelligence58 citations Open access
Semantic Scholar
SAMO: Speaker Attractor Multi-Center One-Class Learning For Voice Anti-Spoofing
Sivan Ding, You Zhang, Zhi-Yao Duan
2022IEEE International Conference on Acoustics, Speech, and Signal Processing54 citations Open access
Semantic Scholar
Audio–Visual Deep Clustering for Speech Separation
Rui Lu, Zhi-Yao Duan, Chang-Shui Zhang
2019IEEE/ACM Transactions on Audio Speech and Language Processing52 citations Open access
Semantic Scholar
Listen and Look: Audio–Visual Matching Assisted Speech Source Separation
Rui Lu, Zhi-Yao Duan, Chang-Shui Zhang
2018IEEE Signal Processing Letters48 citations Open access
Semantic Scholar
Siamese Style Convolutional Neural Networks for Sound Search by Vocal Imitation
Yichi Zhang, Bryan Pardo, Zhi-Yao Duan
2019IEEE/ACM Transactions on Audio Speech and Language Processing42 citations Open access
Semantic Scholar
Deep ranking: Triplet MatchNet for music metric learning
Rui Lu, Kailun Wu, Zhi-Yao Duan, Chang-Shui Zhang
2017IEEE International Conference on Acoustics, Speech, and Signal Processing40 citations
Semantic Scholar
Vocal Imitation Set: a dataset of vocally imitated sound events using the AudioSet ontology
B. Kim, Madhav Ghei, Bryan Pardo, Zhi-Yao Duan
2018Workshop on Detection and Classification of Acoustic Scenes and Events38 citations
Semantic Scholar
BeatNet: CRNN and Particle Filtering for Online Joint Beat, Downbeat and Meter Tracking
M. Heydari, Frank Cwitkowitz, Zhi-Yao Duan
2021International Society for Music Information Retrieval Conference37 citations
Semantic Scholar
An Empirical Study on Channel Effects for Synthetic Voice Spoofing Countermeasure Systems
You Zhang, Ge Zhu, Fei Jiang, Zhi-Yao Duan
2021Interspeech37 citations Open access
Semantic Scholar
Adversarial Training for Speech Super-Resolution
Sefik Emre Eskimez, K. Koishida, Zhi-Yao Duan
2019IEEE Journal on Selected Topics in Signal Processing37 citations Open access
Semantic Scholar
Skipping the Frame-Level: Event-Based Piano Transcription With Neural Semi-CRFs
Yujia Yan, Frank Cwitkowitz, Zhi-Yao Duan
2021Neural Information Processing Systems35 citations
Semantic Scholar
Noise-Resilient Training Method for Face Landmark Generation From Speech
Sefik Emre Eskimez, R. Maddox, Chen-Liang Xu, Zhi-Yao Duan
2020IEEE/ACM Transactions on Audio Speech and Language Processing34 citations Open access
Semantic Scholar
Front-end speech enhancement for commercial speaker verification systems
Sefik Emre Eskimez, Peter Soufleris, Zhi-Yao Duan, W. Heinzelman
2018Speech Communication34 citations Open access
Semantic Scholar
HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields
You Zhang, Yuxiang Wang, Zhi-Yao Duan
2022IEEE International Conference on Acoustics, Speech, and Signal Processing32 citations Open access
Semantic Scholar
Transcribing Human Piano Performances into Music Notation
Andrea Cogliati, D. Temperley, Zhi-Yao Duan
2016International Society for Music Information Retrieval Conference31 citations
Semantic Scholar
End-To-End Generation of Talking Faces from Noisy Speech
Sefik Emre Eskimez, R. Maddox, Chen-Liang Xu, Zhi-Yao Duan
2020IEEE International Conference on Acoustics, Speech, and Signal Processing29 citations
Semantic Scholar
A Probabilistic Fusion Framework for Spoofing Aware Speaker Verification
You Zhang, Ge Zhu, Zhi-Yao Duan
2022The Speaker and Language Recognition Workshop27 citations Open access
Semantic Scholar
See and listen: Score-informed association of sound tracks to players in chamber music performance videos
Bo-Chen Li, K. Dinesh, Zhi-Yao Duan, Gaurav Sharma
2017IEEE International Conference on Acoustics, Speech, and Signal Processing27 citations
Semantic Scholar
Rethinking Audio-Visual Synchronization for Active Speaker Detection
Abudukelimu Wuerkaixi, You Zhang, Zhi-Yao Duan, Chang-Shui Zhang
2022International Workshop on Machine Learning for Signal Processing26 citations Open access
Semantic Scholar
Y-Vector: Multiscale Waveform Encoder for Speaker Embedding
Ge Zhu, Fei Jiang, Zhi-Yao Duan
2020Interspeech26 citations
Semantic Scholar
Skeleton Plays Piano: Online Generation of Pianist Body Movements from MIDI Performance
Bo-Chen Li, Akira Maezawa, Zhi-Yao Duan
2018International Society for Music Information Retrieval Conference26 citations
Semantic Scholar
Global HRTF Personalization Using Anthropometric Measures
Yuxiang Wang, You Zhang, Zhi-Yao Duan, M. Bocko
202123 citations
Semantic Scholar
BachDuet: A Deep Learning System for Human-Machine Counterpoint Improvisation
Christodoulos Benetatos, Joseph VanderStel, Zhi-Yao Duan
2020New Interfaces for Musical Expression23 citations
Semantic Scholar
Piano Transcription With Convolutional Sparse Lateral Inhibition
Andrea Cogliati, Zhi-Yao Duan, B. Wohlberg
2017IEEE Signal Processing Letters23 citations Open access
Semantic Scholar
IMISOUND: An Unsupervised System for Sound Query by Vocal Imitation
Yichi Zhang, Zhi-Yao Duan
2016IEEE International Conference on Acoustics, Speech, and Signal Processing23 citations
Semantic Scholar
Multi-Scale Recurrent Neural Network for Sound Event Detection
Rui Lu, Zhi-Yao Duan, Chang-Shui Zhang
2018IEEE International Conference on Acoustics, Speech, and Signal Processing22 citations
Semantic Scholar
IMINET: Convolutional semi-siamese networks for sound search by vocal imitation
Yichi Zhang, Zhi-Yao Duan
2017IEEE Workshop on Applications of Signal Processing to Audio and Acoustics21 citations
Semantic Scholar
A Metric for Music Notation Transcription Accuracy
Andrea Cogliati, Zhi-Yao Duan
2017International Society for Music Information Retrieval Conference21 citations
Semantic Scholar
Part-invariant Model for Music Generation and Harmonization
Yujia Yan, Ethan Lustig, Joseph VanderStel, Zhi-Yao Duan
2018International Society for Music Information Retrieval Conference20 citations
Semantic Scholar
Music Source Separation With Generative Flow
Ge Zhu, Jordan Darefsky, Fei Jiang, A. Selitskiy +1 more
2022IEEE Signal Processing Letters19 citations Open access
Semantic Scholar
ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and Speed
Mei-Shuo Chen, Zhi-Yao Duan
2022Interspeech18 citations Open access
Semantic Scholar
Don’t Look Back: An Online Beat Tracking Method Using RNN and Enhanced Particle Filtering
M. Heydari, Zhi-Yao Duan
2020IEEE International Conference on Acoustics, Speech, and Signal Processing16 citations
Semantic Scholar
Audiovisual Analysis of Music Performances: Overview of an Emerging Field
Zhi-Yao Duan, S. Essid, Cynthia C. S. Liem, G. Richard +1 more
2019IEEE Signal Processing Magazine16 citations Open access
Semantic Scholar
Metric learning based data augmentation for environmental sound classification
Rui Lu, Zhi-Yao Duan, Chang-Shui Zhang
2017IEEE Workshop on Applications of Signal Processing to Audio and Acoustics16 citations
Semantic Scholar
Creating A Musical Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applications
Bo-Chen Li, Xinzhao Liu, K. Dinesh, Zhi-Yao Duan +1 more
2016arXiv.org16 citations
Semantic Scholar
DyViSE: Dynamic Vision-Guided Speaker Embedding for Audio-Visual Speaker Diarization
Abudukelimu Wuerkaixi, Kunda Yan, You Zhang, Zhi-Yao Duan +1 more
2022IEEE International Workshop on Multimedia Signal Processing15 citations
Semantic Scholar
Speech-In-Noise Comprehension is Improved When Viewing a Deep-Neural-Network-Generated Talking Face
Shan Tong, Casper E. Wenner, Chen-Liang Xu, Zhi-Yao Duan +1 more
2022bioRxiv15 citations Open access
Semantic Scholar
Visualization and Interpretation of Siamese Style Convolutional Neural Networks for Sound Search by Vocal Imitation
Yichi Zhang, Zhi-Yao Duan
2018IEEE International Conference on Acoustics, Speech, and Signal Processing15 citations
Semantic Scholar
AUDIO-VISUAL SOURCE ASSOCIATION FOR STRING ENSEMBLES THROUGH MULTI-MODAL VIBRATO ANALYSIS
Bochen Li, Chen-Liang Xu, Zhi-Yao Duan
201715 citations
Semantic Scholar
When Counterpoint Meets Chinese Folk Melodies
Nan Jiang, Sheng Jin, Zhi-Yao Duan, Chang-Shui Zhang
2020Neural Information Processing Systems13 citations
Semantic Scholar