Dehao Chen

Most-cited papers

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
Dmitry Lepikhin, HyoukJoong Lee, Yuan-Zhong Xu, Dehao Chen +5 more
2020International Conference on Learning Representations2,507 citations
Semantic Scholar
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
Yan-Ping Huang, You-Long Cheng, Ankur Bapna, O. Firat +7 more
2018Neural Information Processing Systems2,327 citations
Semantic Scholar
LaMDA: Language Models for Dialog Applications
R. Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer +56 more
2022arXiv.org1,930 citations
Semantic Scholar
MLPerf Training Benchmark
Peter Mattson, Christine Cheng, Cody A. Coleman, G. Diamos +33 more
2019Conference on Machine Learning and Systems416 citations
Semantic Scholar
Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling
Jonathan Shen, P. Nguyen, Yong-Hui Wu, Z. Chen +88 more
2019arXiv.org215 citations
Semantic Scholar
GSPMD: General and Scalable Parallelization for ML Computation Graphs
Yuan-Zhong Xu, HyoukJoong Lee, Dehao Chen, Blake A. Hechtman +12 more
2021arXiv.org203 citations
Semantic Scholar
AutoFDO: Automatic feedback-directed optimization for warehouse-scale applications
Dehao Chen, David Li, Tipp Moseley
2016IEEE/ACM International Symposium on Code Generation and Optimization160 citations Open access
Semantic Scholar
MapCG: Writing parallel program portable between CPU and GPU
Chuntao Hong, Dehao Chen, Wen-Guang Chen, Wei-Min Zheng +1 more
2010International Conference on Parallel Architectures and Compilation Techniques159 citations
Semantic Scholar
Image Classification at Supercomputer Scale
Chris Ying, Sameer Kumar, Dehao Chen, Tao Wang +1 more
2018arXiv.org133 citations
Semantic Scholar
Overlap Communication with Dependent Computation via Decomposition in Large Deep Learning Models
Shi-Bo Wang, Jin-Liang Wei, Amit Sabne, Andy Davis +10 more
2022International Conference on Architectural Support for Programming Languages and Operating Systems132 citations Open access
Semantic Scholar
Taming hardware event samples for FDO compilation
Dehao Chen, Neil Vachharajani, R. Hundt, Shih-Wei Liao +4 more
2010IEEE/ACM International Symposium on Code Generation and Optimization78 citations
Semantic Scholar
Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training
Yuan-Zhong Xu, HyoukJoong Lee, Dehao Chen, Hongjun Choi +2 more
2020arXiv.org53 citations
Semantic Scholar
Tree partition based parallel frequent pattern mining on shared memory systems
Dehao Chen, Chunrong Lai, Wei Hu, Wen-Guang Chen +2 more
2006Proceedings 20th IEEE International Parallel & Distributed Processing Symposium47 citations
Semantic Scholar
Scale MLPerf-0.6 models on Google TPU-v3 Pods
Sameer Kumar, Victor Bitorff, Dehao Chen, Chi-Ning Chou +8 more
2019arXiv.org44 citations
Semantic Scholar
Taming Hardware Event Samples for Precise and Versatile Feedback Directed Optimizations
Dehao Chen, Neil Vachharajani, R. Hundt, X. Li +3 more
2013IEEE transactions on computers39 citations
Semantic Scholar
Exploring the limits of Concurrency in ML Training on Google TPUs
Sameer Kumar, James Bradbury, Cliff Young, Yu Emma Wang +15 more
2020Conference on Machine Learning and Systems29 citations
Semantic Scholar
Providing Source Code Level Portability Between CPU and GPU with MapCG
Chuntao Hong, Dehao Chen, Yu-Bei Chen, Wen-Guang Chen +2 more
2012Journal of Computational Science and Technology16 citations
Semantic Scholar
Hardware Counted Profile-Guided Optimization
Baptiste Wicht, R. Vitillo, Dehao Chen, D. Levinthal
2014arXiv.org14 citations
Semantic Scholar
CUDA-Zero: a framework for porting shared memory GPU applications to multi-GPUs
Dehao Chen, Wen-Guang Chen, Wei-Min Zheng
2012Science China Information Sciences13 citations
Semantic Scholar
Feedback-Directed Optimizations in GCC with Estimated Edge Profiles from Hardware Event Sampling
Vinodha Ramasamy, Paul Yuan, Dehao Chen, R. Hundt
200812 citations
Semantic Scholar
GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism
Yan-Ping Huang, Yong-Long Cheng, Dehao Chen, HyoukJoong Lee +3 more
2018arXiv.org4 citations
Semantic Scholar
Quaternion Extreme Learning Machine Based on Real Augmented Representation
Huisheng Zhang, Zaiqiang Wang, Dehao Chen, Shuai Zhu +1 more
2023IEEE Signal Processing Letters2 citations
Semantic Scholar
News Recommendation Model Based on Long-Term and Short-Term Interests
Lei Ren, Dehao Chen, Zexin Miao, Huisheng Zhang
2022ICBDT1 citations
Semantic Scholar
A Practical Stride Prefetching Implementation in Global Optimizer
Hu-Cheng Zhou, Xing Zhou, Tianwei Sheng, Dehao Chen +4 more
20081 citations
Semantic Scholar
TensorPipe: Easy Scaling with Micro-Batch Pipeline Parallelism
Yan-Ping Huang, You-Long Cheng, Ankur Bapna, O. Firat +7 more
2019Neural Information Processing Systems0 citations
Semantic Scholar
Providing Source Code Level Portability Between CPU and GPU with MapCG
Chuntao Hong, Dehao Chen, Wen-Guang Chen, Wei-Min Zheng +2 more
20120 citations
Semantic Scholar