Jinyu Li

Most-cited papers

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Sanyuan Chen, Cheng-Yi Wang, Zheng-Yang Chen, Yu Wu +15 more
2021IEEE Journal on Selected Topics in Signal Processing3,876 citations Open access
Semantic Scholar
Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
Sanyuan Chen, Cheng-Yi Wang, Yu Wu, Zi-Hua Zhang +9 more
2023IEEE Transactions on Audio, Speech, and Language Processing1,456 citations
Semantic Scholar
Recent Advances in End-to-End Automatic Speech Recognition
Jinyu Li
2021APSIPA Transactions on Signal and Information Processing478 citations Open access
Semantic Scholar
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing
Junyi Ao, Rui Wang, Long Zhou, Cheng-Yi Wang +10 more
2021Annual Meeting of the Association for Computational Linguistics315 citations Open access
Semantic Scholar
Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling
Zi-Hua Zhang, Long Zhou, Cheng-Yi Wang, Sanyuan Chen +9 more
2023arXiv.org297 citations Open access
Semantic Scholar
Continuous Speech Separation: Dataset and Analysis
Zhuo Chen, T. Yoshioka, Liang Lu, Tianyan Zhou +5 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing268 citations
Semantic Scholar
On Decoder-Only Architecture For Speech-to-Text and Large Language Model Integration
Jian Wu, Yashesh Gaur, Zhuo Chen, Long Zhou +7 more
2023Automatic Speech Recognition & Understanding240 citations Open access
Semantic Scholar
Developing Real-Time Streaming Transformer Transducer for Speech Recognition on Large-Scale Dataset
Xie Chen, Yu Wu, Zheng-Hao Wang, Shu-Jie Liu +1 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing212 citations
Semantic Scholar
Improving RNN Transducer Modeling for End-to-End Speech Recognition
Jinyu Li, Rui Zhao, Hu Hu, Yifan Gong
2019Automatic Speech Recognition & Understanding180 citations Open access
Semantic Scholar
Continuous Speech Separation with Conformer
Sanyuan Chen, Yu Wu, Zhuo Chen, Jian Wu +5 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing155 citations
Semantic Scholar
Unispeech-Sat: Universal Speech Representation Learning With Speaker Aware Pre-Training
Sanyuan Chen, Yu Wu, Cheng-Yi Wang, Zheng-Yang Chen +7 more
2021IEEE International Conference on Acoustics, Speech, and Signal Processing150 citations
Semantic Scholar
On the Comparison of Popular End-to-End Models for Large Scale Speech Recognition
Jinyu Li, Yu Wu, Yashesh Gaur, Chengyi Wang +2 more
2020Interspeech142 citations Open access
Semantic Scholar
SpeechX: Neural Codec Language Model as a Versatile Speech Transformer
Xiaofei Wang, Manthan Thakker, Zhuo Chen, Naoyuki Kanda +6 more
2023IEEE/ACM Transactions on Audio Speech and Language Processing130 citations Open access
Semantic Scholar
VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation
Tian-Rui Wang, Long Zhou, Zi-Hua Zhang, Yu Wu +5 more
2023arXiv.org127 citations Open access
Semantic Scholar
Integration of Speech Separation, Diarization, and Recognition for Multi-Speaker Meetings: System Description, Comparison, and Analysis
Desh Raj, Pavel Denisov, Zhuo Chen, Hakan Erdogan +10 more
2020Spoken Language Technology Workshop126 citations
Semantic Scholar
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
Zhong Meng, S. Parthasarathy, Eric Sun, Yashesh Gaur +6 more
2020Spoken Language Technology Workshop123 citations
Semantic Scholar
Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability
Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu +7 more
2020Interspeech113 citations Open access
Semantic Scholar
Adaptation Algorithms for Neural Network-Based Speech Recognition: An Overview
Peter Bell, Joachim Fainberg, Ondrej Klejch, Jinyu Li +2 more
2021IEEE Open Journal of Signal Processing91 citations Open access
Semantic Scholar
Streaming Multi-Talker ASR with Token-Level Serialized Output Training
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao +6 more
2022Interspeech87 citations Open access
Semantic Scholar
Prompting Large Language Models for Zero-Shot Domain Adaptation in Speech Recognition
Yuang Li, Yu Wu, Jinyu Li, Shu-Jie Liu
2023Automatic Speech Recognition & Understanding83 citations Open access
Semantic Scholar
SpeechLM: Enhanced Speech Pre-Training With Unpaired Textual Data
Zi-Hua Zhang, Sanyuan Chen, Long Zhou, Yu Wu +7 more
2022IEEE/ACM Transactions on Audio Speech and Language Processing80 citations Open access
Semantic Scholar
Microsoft Speaker Diarization System for the Voxceleb Speaker Recognition Challenge 2020
Xiong Xiao, Naoyuki Kanda, Zhuo Chen, Tianyan Zhou +9 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing70 citations
Semantic Scholar
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training
Zi-Hua Zhang, Long Zhou, Junyi Ao, Shu-Jie Liu +3 more
2022Conference on Empirical Methods in Natural Language Processing69 citations Open access
Semantic Scholar
Adversarial Speaker Verification
Zhong Meng, Yong Zhao, Jinyu Li, Yifan Gong
2019IEEE International Conference on Acoustics, Speech, and Signal Processing68 citations Open access
Semantic Scholar
VatLM: Visual-Audio-Text Pre-Training With Unified Masked Prediction for Speech Representation Learning
Qiu-shi Zhu, Long Zhou, Zi-Hua Zhang, Shu-Jie Liu +6 more
2022IEEE transactions on multimedia67 citations Open access
Semantic Scholar
Wav2vec-Switch: Contrastive Learning from Original-Noisy Speech Pairs for Robust Speech Recognition
Yiming Wang, Jinyu Li, Heming Wang, Yao Qian +2 more
2021IEEE International Conference on Acoustics, Speech, and Signal Processing67 citations
Semantic Scholar
Streaming End-to-End Multi-Talker Speech Recognition
Liang Lu, Naoyuki Kanda, Jinyu Li, Yifan Gong
2020IEEE Signal Processing Letters58 citations Open access
Semantic Scholar
Internal Language Model Training for Domain-Adaptive End-To-End Speech Recognition
Zhong Meng, Naoyuki Kanda, Yashesh Gaur, S. Parthasarathy +5 more
2021IEEE International Conference on Acoustics, Speech, and Signal Processing56 citations
Semantic Scholar
Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition?
Sanyuan Chen, Yu Wu, Cheng-Yi Wang, Shu-Jie Liu +7 more
2022Interspeech54 citations Open access
Semantic Scholar
Semantic Mask for Transformer based End-to-End Speech Recognition
Chengyi Wang, Yu Wu, Yu-Jiao Du, Jinyu Li +6 more
2019Interspeech53 citations Open access
Semantic Scholar
Minimum Latency Training Strategies for Streaming Sequence-to-Sequence ASR
H. Inaguma, Yashesh Gaur, Liang Lu, Jinyu Li +1 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing51 citations
Semantic Scholar
A Configurable Multilingual Model is All You Need to Recognize All Languages
Long Zhou, Jinyu Li, Eric Sun, Shu-Jie Liu
2021IEEE International Conference on Acoustics, Speech, and Signal Processing48 citations
Semantic Scholar
Factorized Neural Transducer for Efficient Language Model Adaptation
Xie Chen, Zhong Meng, S. Parthasarathy, Jinyu Li
2021IEEE International Conference on Acoustics, Speech, and Signal Processing47 citations
Semantic Scholar
Exploring Transformers for Large-Scale Speech Recognition
Liang Lu, Changliang Liu, Jinyu Li, Yifan Gong
2020Interspeech46 citations Open access
Semantic Scholar
Low Latency End-to-End Streaming Speech Recognition with a Scout Network
Chengyi Wang, Yu Wu, Liang Lu, Shujie Liu +3 more
2020Interspeech45 citations Open access
Semantic Scholar
Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
Naoyuki Kanda, Jian Wu, Yu Wu, Xiong Xiao +6 more
2022Interspeech41 citations Open access
Semantic Scholar
Large-Scale Streaming End-to-End Speech Translation with Neural Transducers
Jian Xue, Peidong Wang, Jinyu Li, Matt Post +1 more
2022Interspeech39 citations Open access
Semantic Scholar
Self-Supervised Learning for speech recognition with Intermediate layer supervision
Chengyi Wang, Yu Wu, Sanyuan Chen, Shu-Jie Liu +3 more
2021arXiv.org38 citations
Semantic Scholar
Don’t Shoot Butterfly with Rifles: Multi-Channel Continuous Speech Separation with Early Exit Transformer
Sanyuan Chen, Yu Wu, Zhuo Chen, T. Yoshioka +3 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing37 citations Open access
Semantic Scholar
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Zhong Meng, Yashesh Gaur, Naoyuki Kanda, Jinyu Li +3 more
2021Interspeech36 citations
Semantic Scholar
Improving Noise Robustness of Contrastive Speech Representation Learning with Speech Reconstruction
Heming Wang, Yao Qian, Xiaofei Wang, Yiming Wang +5 more
2021IEEE International Conference on Acoustics, Speech, and Signal Processing34 citations
Semantic Scholar
On Addressing Practical Challenges for RNN-Transducer
Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei +2 more
2021Automatic Speech Recognition & Understanding34 citations
Semantic Scholar
Using Personalized Speech Synthesis and Neural Language Generator for Rapid Speaker Adaptation
Yan Huang, Lei He, Wenning Wei, W. Gale +2 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing33 citations
Semantic Scholar
Transfer Learning Approaches for Streaming End-to-End Speech Recognition System
Vikas Joshi, Rui Zhao, Rupeshkumar Mehta, Kshitiz Kumar +1 more
2020Interspeech29 citations Open access
Semantic Scholar
Exploring Pre-Training with Alignments for RNN Transducer Based End-to-End Speech Recognition
Hu Hu, Rui Zhao, Jinyu Li, Liang Lu +1 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing28 citations
Semantic Scholar
High-Accuracy and Low-Latency Speech Recognition with Two-Head Contextual Layer Trajectory LSTM Model
Jinyu Li, Rui Zhao, Eric Sun, J. H. M. Wong +3 more
2020IEEE International Conference on Acoustics, Speech, and Signal Processing27 citations Open access
Semantic Scholar
Dual-Path RNN for Long Recording Speech Separation
Chen-Da Li, Yi Luo, Cong Han, Jinyu Li +8 more
2021Spoken Language Technology Workshop26 citations
Semantic Scholar
Towards Contextual Spelling Correction for Customization of End-to-End Speech Recognition Systems
Xiaoqiang Wang, Yanqing Liu, Jinyu Li, Veljko Miljanic +2 more
2022IEEE/ACM Transactions on Audio Speech and Language Processing25 citations Open access
Semantic Scholar
Rapid Speaker Adaptation for Conformer Transducer: Attention and Bias Are All You Need
Yan Huang, Guo-Li Ye, Jinyu Li, Yifan Gong
2021Interspeech24 citations
Semantic Scholar
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu +5 more
2021Interspeech24 citations
Semantic Scholar