Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,695

Full-text search

Active filters: 3-bit

Xu-Ouyang/pythia-12b-deduped-int3-step8000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 10

Xu-Ouyang/pythia-12b-deduped-int3-step10000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 24

Xu-Ouyang/pythia-12b-deduped-int3-step12000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 10

Xu-Ouyang/pythia-6.9b-deduped-int3-step2000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 10

Xu-Ouyang/pythia-6.9b-deduped-int3-step4000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 10

Xu-Ouyang/pythia-6.9b-deduped-int3-step6000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 11

Xu-Ouyang/pythia-6.9b-deduped-int3-step8000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 12

Xu-Ouyang/pythia-6.9b-deduped-int3-step10000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 10

Xu-Ouyang/pythia-6.9b-deduped-int3-step12000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 10

Xu-Ouyang/pythia-160m-deduped-int3-step2000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 11

Xu-Ouyang/pythia-160m-deduped-int3-step4000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 11

Xu-Ouyang/pythia-160m-deduped-int3-step6000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 10

Xu-Ouyang/pythia-160m-deduped-int3-step8000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 10

Xu-Ouyang/pythia-160m-deduped-int3-step10000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 11

Xu-Ouyang/pythia-160m-deduped-int3-step12000-GPTQ-wikitext2

Text Generation • Updated Jul 30 • 12

Xu-Ouyang/Llama-2-13b-hf-int3-GPTQ-wikitext2

Text Generation • Updated Jul 31 • 11

Xu-Ouyang/Qwen2-0.5B-int3-GPTQ-wikitext2

Text Generation • Updated Jul 31 • 5

Xu-Ouyang/Qwen2-1.5B-int3-GPTQ-wikitext2

Text Generation • Updated Jul 31 • 9

Xu-Ouyang/Qwen1.5-0.5B-int3-GPTQ-wikitext2

Text Generation • Updated Jul 31 • 7

Xu-Ouyang/Qwen1.5-1.8B-int3-GPTQ-wikitext2

Text Generation • Updated Jul 31 • 5

Xu-Ouyang/Qwen1.5-14B-int3-GPTQ-wikitext2

Text Generation • Updated Jul 31 • 8

Xu-Ouyang/Qwen1.5-4B-int3-GPTQ-wikitext2

Text Generation • Updated Aug 1 • 5

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1 • 1.25M • 4

Xu-Ouyang/Meta-Llama-3.1-8B-int3-GPTQ-wikitext2

Text Generation • Updated Aug 1 • 30

MaziyarPanahi/calme-2.2-qwen2-72b-GGUF

Text Generation • Updated Aug 6 • 1.41k • 2

MaziyarPanahi/RYS-XLarge-GGUF

Text Generation • Updated Aug 6 • 135 • 7

MaziyarPanahi/calme-2.3-legalkit-8b-GGUF

Text Generation • Updated Aug 7 • 1.25M • 8

TeeZee/2xbagel-34b-v0.2-bpw3.0-h6-exl2

Text Generation • Updated Aug 7 • 7

Xu-Ouyang/FloatLM_3.9B-int3-GPTQ-wikitext2

Text Generation • Updated Aug 7 • 11

Xu-Ouyang/FloatLM_99M-int3-GPTQ-wikitext2

Text Generation • Updated Aug 7 • 22