Mistral-AI
Collection
Quantized versions of models by mistralai
•
19 items
•
Updated
•
4
Mistral-7B-Instruct-v0.2-GGUF
- Model creator: Mistral AI_
- Original model: Mistral-7B-Instruct-v0.2
Description
The Mistral-7B-Instruct-v0.2 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.2.
Mistral-7B-v0.2 has the following changes compared to Mistral-7B-v0.1
- 32k context window (vs 8k context in v0.1)
- Rope-theta = 1e6
- No Sliding-Window Attention
For full details of this model please read our paper and release blog post.
- Downloads last month
- 145
Inference API (serverless) is not available, repository is disabled.
Model tree for QuantFactory/Mistral-7B-Instruct-v0.2-GGUF
Base model
mistralai/Mistral-7B-Instruct-v0.2
Quantized
this model