DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models
S. Jacobs, Masahiro Tanaka, Cheng-Ming Zhang, Minjia Zhang +3 more
Researcher profile · Semantic Scholar
S. Jacobs, Masahiro Tanaka, Cheng-Ming Zhang, Minjia Zhang +3 more
Sam Adé Jacobs, Masahiro Tanaka, Cheng-Ming Zhang, Min-Jia Zhang +4 more
Pei-Yan Dong, Siyue Wang, Wei Niu, Cheng-Ming Zhang +6 more
Wenchong He, Zhe Jiang, Cheng-Ming Zhang, A. Sainju
Jinqi Xiao, Cheng-Ming Zhang, Yu Gong, Miao Yin +4 more
Sian Jin, Cheng-Ming Zhang, Xintong Jiang, Yunhe Feng +4 more
Cheng-Ming Zhang, T. Geng, Anqi Guo, Jian-Nan Tian +3 more
Geng Yuan, Zhiheng Liao, Xiao-Long Ma, Yuxuan Cai +10 more
Jian-Nan Tian, Sheng Di, Cheng-Ming Zhang, Xin Liang +4 more
S. Song, Bonnie Kruft, Min-Jia Zhang, Cong-Long Li +88 more
Guan-Hua Wang, Cheng-Ming Zhang, Zhe-Yu Shen, Ang Li +1 more
Jinda Jia, Cong Xie, Hanlin Lu, Daoce Wang +7 more
Cheng-Ming Zhang, Sian Jin, T. Geng, Jian-Nan Tian +2 more
Cheng-Ming Zhang, Geng Yuan, Wei Niu, Jian-Nan Tian +7 more
Lizhi Xiang, Miao Yin, Cheng-Ming Zhang, Aravind Sukumaran-Rajam +3 more
Bo Jiang, Taolue Yang, You-Yuan Liu, Cheng-Ming Zhang +2 more
Cheng-Ming Zhang, Bai-Xi Sun, Xiao-Dong Yu, Zhen Xie +4 more
Yuanbin Man, Ying Huang, Cheng-Ming Zhang, Bing-Zhe Li +2 more
Zhenghui Guo, Yuanbin Man, Junyuan Sheng, Bowen Lin +7 more
Boyuan Zhang, Luan-Zheng Guo, Jian-Nan Tian, Jinyang Liu +6 more
Bowen Lin, Fan-Jiang Ye, Yihua Liu, Zhenghui Guo +6 more
Wenqi Jia, Zhewen Hu, Ying Huang, YunXiang Gong +9 more
Haoyu Ma, Cheng-Ming Zhang, Li-Zhi Xiang, Xiao-Long Ma +8 more
A. Tsaris, Cheng-Ming Zhang, Xiao Wang, Jun-Qi Yin +8 more
Cheng-Ming Zhang, Geng Yuan, Wei Niu, Jian-Nan Tian +7 more
Yihua Liu, Fan-Jiang Ye, Bowen Lin, Rongyu Fang +1 more
Yilin Yang, Zhenghui Guo, Yu-Ke Wang, O. Gnawali +2 more
Zhenghui Guo, Yilin Yang, Yuanbin Man, Miao Yin +4 more
Cheng-Ming Zhang, Shaden Smith, Bai-Xi Sun, Jian-Nan Tian +5 more
Bai-Xi Sun, Xiaodong Yu, Cheng-Ming Zhang, Jian-Nan Tian +6 more
Boyuan Zhang, Ding Zhou, Yafan Huang, Shi-Hui Song +4 more
Boyuan Zhang, Luan-Zheng Guo, Jian-Nan Tian, Jinyang Liu +7 more
Cheng-Ming Zhang, Xinheng Ding, Bai-Xi Sun, Xiao-Dong Yu +3 more
Cheng-Ming Zhang, Sian Jin, T. Geng, Jian-Nan Tian +2 more