Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

6,418

Full-text search

Active filters: 8-bit

themanas021/phi-3-medical-instruct-themanas

Text Generation • Updated May 7 • 71 • 4

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 1.97M • 63

shaheerzk/text_to_sql

Text Generation • Updated Oct 25 • 136 • 1

rubenamtz0/llama-3-8b-lora-law2entity

Updated Jun 4 • 111 • 1

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.07M • 10

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.06M • 9

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3 • 958 • 21

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 27.5k • 2

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 421 • 3

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • Updated Jul 23 • 73 • 2

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 1.83M • 5

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 1.85M • 33

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 1.85M • 37

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23 • 7.65k • 12

Slvcxc/L3-Super-Nova-RP-8B-8.0bpw-h8-exl2

Text Generation • Updated Jul 24 • 30 • 4

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 7.67k • 13

ParasiticRogue/Lumimaid-Magnum-12B-exl2-8.0

Text Generation • Updated Aug 3 • 34 • 4

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1 • 1.84M • 5

anokimchen/sd-turbo-openvino-8bit-no-calibration

Text-to-Image • Updated Aug 7 • 1

anokimchen/sd-turbo-openvino-8bit-GPT4vision-calibrated

Text-to-Image • Updated Aug 7 • 1

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ-INT8

Updated Aug 7 • 73 • 1

alpindale/Meta-Llama-3.1-70B-Instruct-GPTQ-INT8

Updated Aug 13 • 2.23k • 2

FuturisticVibes/Rocinante-12B-v1.1-8.0bpw-h8-exl2

Updated Aug 23 • 5 • 1

FuturisticVibes/MN-12B-Celeste-V1.9-8.0bpw-h8-exl2

Text Generation • Updated Aug 23 • 28 • 1

Statuo/Celeste-v1.9-8bpw-EXL2

Text Generation • Updated Aug 17 • 11 • 1

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 988k • 7

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 491 • 2

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 1.84M • 5

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21 • 69.4k • 14

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21 • 4.11k • 9