922-CA
/

monika-ddlc-7b-v1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

GGUFs of monika-ddlc-7b-v1. (Primarily tested and run with Koboldcpp v1.46.1+).

QLora here.

Downloads last month: 76

GGUF

Model size

6.74B params

Architecture

llama

4-bit

5-bit

8-bit

Inference API

Unable to determine this model's library. Check the docs .