cff-version: 1.2.0 message: "If you use this software, please cite it as below." references: - type: article authors: - family-names: Cai given-names: Tianle - family-names: Li given-names: Yuhong - family-names: Geng given-names: Zhengyang - family-names: Peng given-names: Hongwu - family-names: Lee given-names: Jason D. - family-names: Chen given-names: Deming - family-names: Dao given-names: Tri title: "Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads" year: 2024 journal: "arXiv preprint arXiv: 2401.10774"