---
license: other
license_name: gemma-terms-of-use
license_link: https://ai.google.dev/gemma/terms
---
GGUF quants for https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1  

> Zephyr is a series of language models that are trained to act as helpful assistants. Zephyr 7B Gemma is the third model in the series, and is a fine-tuned version of google/gemma-7b that was trained on on a mix of publicly available, synthetic datasets using Direct Preference Optimization (DPO). You can reproduce the training of this model via the recipe provided in the Alignment Handbook.

| Layers | Context | [Template](https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1/blob/19186e70e5679c47aaef473ae2fd56e20765088d/tokenizer_config.json#L59) |
| --- | --- | --- |
| <pre>28</pre> | <pre>8192</pre> | <pre>\<s\>\<\|user\|\><br>{prompt}<br>\<\|assistant\|\><br>{response}</pre> |