altomek
/

Nemomix-v3.0-12B-8bpw-EXL2

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Edit model card

Nemomix-v3.0-12B

ExLlamav2 8 bpw quants of https://huggingface.co/MarinaraSpaghetti/Nemomix-v3.0-12B

Downloads last month: 10

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/Nemomix-v3.0-12B-8bpw-EXL2

Base model

MarinaraSpaghetti/Nemomix-v3.0-12B

Quantized

(3)

this model