LycheeDecode: Accelerating Long-Context LLM Inference via Hybrid-Head Sparse Decoding

LycheeDecode: Accelerating Long-Context LLM Inference via Hybrid-Head Sparse Decoding | ScienceToStartup | ScienceToStartup