Quantized 4x MoE of this model.

by Kquant03 - opened Jan 6

Jan 6

•

Thank you so much for training this model, man. You're a legend.

(edit: llama.cpp is bugged again, I have to go back again for the 3rd time and work on this...😔)

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment