dranger003
/

WhiteRabbitNeo-33B-v1.5-iMat.GGUF

Text Generation

Model card Files Files and versions Community

dranger003 commited on Feb 18

Commit

3ae3305

•

1 Parent(s): ca7c616

Update README.md

Files changed (1) hide show

README.md +5 -1

README.md CHANGED Viewed

@@ -6,4 +6,8 @@ library_name: gguf
 pipeline_tag: text-generation
 ---
 GGUF importance matrix (imatrix) quants for https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-33B-v1.5
-The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.

 pipeline_tag: text-generation
 ---
 GGUF importance matrix (imatrix) quants for https://huggingface.co/WhiteRabbitNeo/WhiteRabbitNeo-33B-v1.5
+The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
+| Layers | Context | Template |
+| --- | --- | --- |
+| <pre>62</pre> | <pre>16384</pre> | <pre>SYSTEM:<br>{instructions}<br>USER:<br>{prompt}<br>ASSISTANT:<br>{response}</pre> |