dranger003's picture
Update README.md
3ae3305 verified
|
raw
history blame
571 Bytes
metadata
license: other
license_name: deepseek
license_link: https://huggingface.co/deepseek-ai/deepseek-coder-33b-base/blob/main/LICENSE
library_name: gguf
pipeline_tag: text-generation

GGUF importance matrix (imatrix) quants for https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-33B-v1.5
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.

Layers Context Template
62
16384
SYSTEM:
{instructions}
USER:
{prompt}
ASSISTANT:
{response}