Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

117

Full-text search

Active filters: llama-3.1

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • Updated Sep 16 • 514 • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8 • 3.13k • 7

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • Updated Aug 8 • 654

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29 • 165 • 3

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 27 • 935 • 1

ModelCloud/Meta-Llama-3.1-8B-gptq-4bit

Text Generation • Updated Jul 26 • 158

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • Updated Jul 27 • 261 • 4

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • Updated Sep 1 • 532 • 6

OpenBuddy/openbuddy-llama3.1-8b-v22.1-131k

Text Generation • Updated Jul 24 • 218 • 5

sunnyyy/openbuddy-llama3.1-8b-v22.1-131k-Q4_K_M-GGUF

Text Generation • Updated Jul 25 • 32

jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Jul 25 • 9

jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Jul 25 • 5

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • Updated Aug 28 • 751 • 13

mudler/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Jul 27 • 74

mradermacher/Configurable-Llama-3.1-8B-Instruct-GGUF

Updated Jul 29 • 274

OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k

Text Generation • Updated Aug 11 • 249 • 2

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-GGUF

Updated Jul 29 • 376

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-GGUF

Updated Jul 28 • 396

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16

Text Generation • Updated Sep 16 • 1.02k • 2

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16

Text Generation • Updated Jul 28 • 878

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • Updated Aug 8 • 622 • 2

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-i1-GGUF

Updated Aug 2 • 494 • 1

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-i1-GGUF

Updated Aug 2 • 553

Cran-May/openbuddy-llama3.1-8b-v22.2-131k-Q4_K_M-GGUF

Text Generation • Updated Jul 29 • 21 • 1

mradermacher/Configurable-Llama-3.1-8B-Instruct-i1-GGUF

Updated Aug 2 • 514

ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit

Text Generation • Updated Jul 30 • 9 • 2

Kalei/Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom

Text Generation • Updated Jul 31 • 13

hierholzer/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Aug 19 • 339 • 3

adrlau/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Aug 2 • 7

anhbn/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 9