JunxiongWang 's Collections

Mamba2InLlama3.2-3B

Mamba distilled from Llama3.2 3B Instruct. The Mamba in the Llama: Distilling and Accelerating Hybrid Models (https://arxiv.org/abs/2408.15237).