Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

234

Full-text search

Active filters: int8

ecastera/eva-dolphin-llama3-8b-spanish

Text Generation • Updated Jun 14 • 21 • 3

Anthonyg5005/L3-8B-Stheno-v3.1-int8-ct2

Text Generation • Updated Jun 17 • 11

Anthonyg5005/turbcat-instruct-8b-int8-ct2

Text Generation • Updated Jun 20 • 8

angeloc1/llama3dot1SimilarProcesses8

Text Generation • Updated Jul 27 • 13

angeloc1/llama3dot1DifferentProcesses8

Text Generation • Updated Jul 27 • 16

FriendliAI/Meta-Llama-3-8B-int8

Text Generation • Updated Aug 1 • 32 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • Updated Oct 9 • 417 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated Oct 23 • 674 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 254 • 1

neuralmagic/gemma-2-2b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 55 • 1

neuralmagic/gemma-2-2b-quantized.w8a16

Text Generation • Updated Oct 9 • 48

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 17

neuralmagic/gemma-2-2b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 2.16k

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 493 • 2

angeloc1/llama3dot1FoodDel8v02

Text Generation • Updated Aug 18 • 20

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 491 • 2

neuralmagic/SmolLM-360M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 13

neuralmagic/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 395

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • Updated Sep 7 • 13

FriendliAI/Meta-Llama-3.1-8B-Instruct-int8

Text Generation • Updated Sep 9 • 19 • 1

FriendliAI/Meta-Llama-3.1-70B-Instruct-int8

Text Generation • Updated Sep 9 • 20

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10 • 24

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 13 • 58

SteveTran/T5-small-query-expansion-INT8

Text2Text Generation • Updated 14 days ago • 206