Hugging Face's logo

dranger003
/
zephyr-7b-gemma-v0.1-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
dranger003 commited on
Commit
6662efc
·
verified ·
1 Parent(s): 74812cd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -3,3 +3,8 @@ license: other
3
  license_name: gemma-terms-of-use
4
  license_link: https://ai.google.dev/gemma/terms
5
  ---
 
 
 
 
 
 
3
  license_name: gemma-terms-of-use
4
  license_link: https://ai.google.dev/gemma/terms
5
  ---
6
+ GGUF quants for https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1
7
+
8
+ | Layers | Context | [Template](https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1/blob/19186e70e5679c47aaef473ae2fd56e20765088d/tokenizer_config.json#L59) |
9
+ | --- | --- | --- |
10
+ | <pre>28</pre> | <pre>8192</pre> | <pre>\<s\>\<\|user\|\><br>{prompt}<br>\<\|assistant\|\><br>{response}</pre> |