Edit Models filters

Inference status

Misc

compressed-tensors

AutoTrain Compatible

Inference Endpoints

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

260

Full-text search

Active filters: compressed-tensors

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated 19 days ago • 2.16k • 4

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • Updated 28 days ago • 1.4k • 3

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated 27 days ago • 14.3k • 11

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated 27 days ago • 3.74k • 12

neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated 28 days ago • 133k • 32

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated 28 days ago • 49.4k • 32

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8

Text Generation • Updated 28 days ago • 2.32k • 31

neuralmagic/Meta-Llama-3.1-405B-Instruct-FP8-dynamic

Text Generation • Updated 19 days ago • 404 • 14

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 14 days ago • 8.41k • 11

neuralmagic/gemma-2-9b-it-quantized.w4a16

Text Generation • Updated 28 days ago • 432 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated 28 days ago • 245 • 2

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated 27 days ago • 942 • 2

nm-testing/Phi-3.5-MoE-instruct-FP8

Updated 28 days ago • 81 • 2

neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2 • 21.4k • 10

neuralmagic/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • Updated 28 days ago • 1.05k • 2

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated 28 days ago • 1.74k • 2

neuralmagic/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • Updated 21 days ago • 1.25k • 3

neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • Updated Oct 2 • 15.5k • 3

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated 21 days ago • 8.98k • 2

neuralmagic/Phi-3.5-mini-instruct-FP8-KV

Text Generation • Updated Oct 1 • 350 • 1

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1 • 8 • 1

nm-testing/NVLM-D-72B-FP8-dynamic

Updated about 1 month ago • 1.96k • 2

neuralmagic/pixtral-12b-FP8-dynamic

Text Generation • Updated 5 days ago • 1.98k • 1

noneUsername/SuperNova-Medius-W8A8-Dynamic-Per-Token

Updated 19 days ago • 197 • 1

flowaicom/Flow-Judge-v0.1-FP8

Updated 23 days ago • 56 • 1

flowaicom/Flow-Judge-v0.1-W8A16

Updated 23 days ago • 21 • 1

flowaicom/Flow-Judge-v0.1-W4A16

Updated 23 days ago • 35 • 1

neuralmagic/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic

Text Generation • Updated 21 days ago • 9.15k • 8

thwin27/Aria-sequential_mlp-FP8-dynamic

Image-Text-to-Text • Updated 14 days ago • 195 • 5

nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-FP8-compressed

Updated 8 days ago • 17 • 1