Edit Models filters

Inference status

Misc

text-generation-inference

AutoTrain Compatible

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,154

Full-text search

Active filters: 2-bit

jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated 29 days ago • 185

jburmeister/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • Updated 29 days ago • 68

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated 29 days ago • 88

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • Updated 28 days ago • 484 • 1

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • Updated 14 days ago • 44.1k • 1

zewenwu/phi-3.5-w2g64-gptq

Updated 21 days ago • 1

Satwik11/Phi-3.5-Mini-instruct-quantized-autoround-asym-2bit

Updated 18 days ago • 8

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated 16 days ago • 247 • 1

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_2.0bpw_h6

Text Generation • Updated 12 days ago • 12

MaziyarPanahi/ref_70_e3-GGUF

Text Generation • Updated 9 days ago • 72

Xu-Ouyang/pythia-1b-deduped-int2-step2000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 8

Xu-Ouyang/pythia-1b-deduped-int2-step4000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 8

Xu-Ouyang/pythia-1b-deduped-int2-step6000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 8

Xu-Ouyang/pythia-1b-deduped-int2-step8000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 8

Xu-Ouyang/pythia-1b-deduped-int2-step10000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step12000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step14000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 13

Xu-Ouyang/pythia-1b-deduped-int2-step29000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step36000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step43000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step57000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 9

Xu-Ouyang/pythia-1b-deduped-int2-step71000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step86000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 12

Xu-Ouyang/pythia-1b-deduped-int2-step93000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 11

Xu-Ouyang/pythia-1b-deduped-int2-step95000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step98000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step100000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step107000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step110000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 10

Xu-Ouyang/pythia-1b-deduped-int2-step115000-GPTQ-wikitext2-uva

Text Generation • Updated 7 days ago • 9