Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads
Tian-Le Cai, Yu-Hong Li, Zheng-Yang Geng, Hong-Wu Peng +3 more
2024International Conference on Machine Learning1,038 citations
Semantic Scholar
Researcher profile · Semantic Scholar
Tian-Le Cai, Yu-Hong Li, Zheng-Yang Geng, Hong-Wu Peng +3 more
Yu-Hong Li, Tianle Cai, Yi Zhang, De-huai Chen +1 more
P. Harris, E. Katsavounidis, W. McCormack, D. Rankin +17 more
Yuan-Zhang Yuan, Yi-Bo Huang, De-huai Chen, Qiu-yu Zhang
Yu-Hong Li, Jia-Jie Li, Cong Han, P. Li +2 more