Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
Tian-Le Cai, Yu-Hong Li, Zheng-Yang Geng, Hong-Wu Peng +3 more
2024International Conference on Machine Learning1,038 citations
Semantic Scholar
Researcher profile · Semantic Scholar
Tian-Le Cai, Yu-Hong Li, Zheng-Yang Geng, Hong-Wu Peng +3 more
Hong-Wu Peng, Ohiremen L. Dibua, Yuan-Jun Xiong, Yi-Fan Gong +7 more
Song-Tao Liu, Hong-Wu Peng, Zhiwei Zhang, Zheng-Yu Chen +1 more
Reza Yazdani Aminabadi, Samyam Rajbhandari, Ahmad Awan, Cheng Li +34 more
Chih-Hsiang Peng, Po-Chuan Lin, S. Barma, Jhing-Fa Wang +3 more
Tianle Cai, Yu-Hong Li, Zheng-Yang Geng, Hong-Wu Peng +496 more