Qwen2.5-Coder-1.5B-Instruct for speculative decoding?

#1
by Handgun1773 - opened

The title says it: iirc exl2 support speculative decoding, we have a smol qwen coder, nobody exl2ed it.
If you have the time, it would be very cool of you to do it.
Base models would also be very nice for code completion.

Sign up or log in to comment