CISCai
/

Mistral-7B-Instruct-v0.3-SOTA-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-SOTA-GGUF

1 contributor

History: 6 commits

CISCai's picture

Fix example parameters

8acad5e verified 6 months ago

.gitattributes

2.46 kB

Upload 14 files 6 months ago
Mistral-7B-Instruct-v0.3.IQ1_M.gguf

1.76 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ1_S.gguf

1.62 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ2_M.gguf

2.5 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ2_S.gguf

2.31 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ2_XS.gguf

2.2 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ2_XXS.gguf

1.99 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ3_M.gguf

3.29 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ3_S.gguf

3.19 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ3_XS.gguf

3.02 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ3_XXS.gguf

2.83 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.IQ4_XS.gguf

3.91 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.fp16.gguf

14.5 GB
LFS

Added support for system prompt 6 months ago
Mistral-7B-Instruct-v0.3.imatrix.dat

4.99 MB
LFS

Upload 14 files 6 months ago
README.md

13.3 kB

Fix example parameters 6 months ago