mradermacher
/

SauerkrautLM-Qwen-32b-i1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

weighted/imatrix quants of https://huggingface.co/VAGOsolutions/SauerkrautLM-Qwen-32b

Downloads last month: 0

GGUF

Model size

32.5B params

Architecture

qwen2

1-bit

2-bit

3-bit

4-bit

6-bit

Inference API

Unable to determine this model's library. Check the docs .