Understanding and Mitigating Numerical Sources of Nondeterminism in LLM Inference
Jiayi Yuan, Hao Li, Xinheng Ding, Wenya Xie +6 more
2025Neural Information Processing Systems82 citations
Semantic Scholar
Researcher profile · Semantic Scholar
Jiayi Yuan, Hao Li, Xinheng Ding, Wenya Xie +6 more
Zi-Yang Zhang, Xinheng Ding, Jia-Yi Yuan, Rixin Liu +3 more
Wenya Xie, Sheng-Ming Zhou, Ze-Lin Li, Pouya Parsa +8 more
Rixin Liu, Xingqi Cui, Kai-Jian Wang, Xinheng Ding +3 more
Cheng-Ming Zhang, Xinheng Ding, Bai-Xi Sun, Xiao-Dong Yu +3 more