Text Generation
Transformers
PyTorch
Italian
English
mistral
conversational
text-generation-inference
Inference Endpoints

Plan for AWQ?

#6
by Malithius - opened

Hi Federico,
is there any plan to release also an awq version of the model?

Owner

Hey not for this version but we plan to do it for cerbero1.5. It will be released in the next weeks

Oh nice,
I look forward to testing it.

Sign up or log in to comment