Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

6,423

Full-text search

Active filters: 8-bit

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • Updated 21 days ago • 166 • 1

mlx-community/Qwen2.5.1-Coder-7B-Instruct-8bit

Text Generation • Updated 19 days ago • 161 • 2

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • Updated 13 days ago • 15.2k • 1

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated 13 days ago • 15.2k • 1

NikolayKozloff/MKLLM-7B-Instruct-openvino-8bit

Updated 20 days ago • 12 • 1

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • Updated 13 days ago • 15k • 1

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated 13 days ago • 15.1k • 1

radm/Athene-70B-bnb-4bit

Updated 19 days ago • 4 • 1

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • Updated 10 days ago • 9.27k • 11

waldie/TQ2.5-14B-Sugarquill-v1-8bpw-h8-exl2

Text Generation • Updated 18 days ago • 21 • 1

mlx-community/Meta-Llama-3.1-405B-Instruct-8bit

Text Generation • Updated 18 days ago • 412 • 1

mlx-community/Qwen2.5-Coder-32B-8bit

Text Generation • Updated 16 days ago • 114 • 1

lmstudio-community/Qwen2.5-Coder-1.5B-Instruct-MLX-8bit

Text Generation • Updated 15 days ago • 59 • 1

crce9598/Llama3.2-Code-Instruct-Finetune-IPAM

Text Generation • Updated 12 days ago • 23 • 1

prithivMLmods/Llama-3.2-3B-GGUF

Text Generation • Updated 9 days ago • 1.25k • 8

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated 13 days ago • 47k • 6

mlx-community/Athene-V2-Chat-8bit

Text Generation • Updated 12 days ago • 55 • 1

bullerwins/Athene-V2-Chat-exl2_8.0bpw

Text Generation • Updated 11 days ago • 23 • 1

kunalsuri/Llama3-8B-1.58-100B-tokens

Text Generation • Updated 9 days ago • 64 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated 8 days ago • 34.7k • 1

nm-testing/pixtral-12b-W8A8

Updated 8 days ago • 18 • 1

CalamitousFelicitousness/EVA-Qwen2.5-72B-v0.2-GPTQ-8Bit

Text Generation • Updated 4 days ago • 121 • 1

mlx-community/numind-NuExtract-1.5-MLX-8bit

Text Generation • Updated about 21 hours ago • 1

mlx-community/QwQ-32B-Preview-8bit

Text Generation • Updated about 5 hours ago • 1

Beygo/QwQ-32B-Preview-Q8-mlx

Text Generation • Updated about 7 hours ago • 1

mlx-community/Lumimaid-v0.2-70B

Updated Oct 13 • 11 • 1

MikeRoz/sophosympatheia_Evathene-v1.0-8.0bpw-h8-exl2

Text Generation • Updated 11 days ago • 34 • 1

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 3.8k • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21 • 13 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29 • 3.78k • 4