Hugging Face's logo

neuralmagic
/
Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation
Transformers
Safetensors
mistral
conversational
Eval Results
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
2
Mistral-7B-Instruct-v0.3-GPTQ-4bit

Commit History

Update README.md
ed07c8f
verified

mgoin commited on

Update README.md
ca4faba
verified

mgoin commited on

Update README.md
2ca503f
verified

mgoin commited on

Delete nm-vllm_Llama_vs_Mistral.png
2631819
verified

mgoin commited on

Update README.md
dc49055
verified

mgoin commited on

add link to nm-vllm
169e798

Eldar Kurtic commited on

add nm-vllm perf
bc8ee38

Eldar Kurtic commited on

Update results
ba1167e

Eldar Kurtic commited on

Update results
d2809f1

Eldar Kurtic commited on

Update results
d8f6dae

Eldar Kurtic commited on

Initial commit
65aebf9

Eldar Kurtic commited on

initial commit
ab98e3f
verified

ekurtic commited on