Edit Models filters

Inference status

Misc

arxiv: 2403.04652

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

215

Full-text search

Active filters: 2403.04652

Zoyd/01-ai_Yi-1.5-9B-Chat-16K-5_0bpw_exl2

Text Generation • Updated May 20 • 4 • 1

Zoyd/01-ai_Yi-1.5-9B-Chat-16K-6_0bpw_exl2

Text Generation • Updated May 20 • 3

Zoyd/01-ai_Yi-1.5-9B-Chat-16K-6_5bpw_exl2

Text Generation • Updated May 20 • 6

Zoyd/01-ai_Yi-1.5-9B-Chat-16K-8_0bpw_exl2

Text Generation • Updated May 20 • 2

Zoyd/01-ai_Yi-1.5-9B-32K-2_5bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-9B-32K-2_2bpw_exl2

Text Generation • Updated May 20 • 6

Zoyd/01-ai_Yi-1.5-9B-32K-3_0bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-9B-32K-3_75bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-9B-32K-4_0bpw_exl2

Text Generation • Updated May 20 • 6

Zoyd/01-ai_Yi-1.5-9B-32K-4_25bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-9B-32K-5_0bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-9B-32K-6_0bpw_exl2

Text Generation • Updated May 20 • 2

Zoyd/01-ai_Yi-1.5-9B-32K-6_5bpw_exl2

Text Generation • Updated May 20 • 8 • 1

Zoyd/01-ai_Yi-1.5-9B-32K-8_0bpw_exl2

Text Generation • Updated May 20 • 6

Zoyd/01-ai_Yi-1.5-9B-32K-3_5bpw_exl2

Text Generation • Updated May 20 • 2

Zoyd/01-ai_Yi-1.5-34B-32K-2_2bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-34B-32K-2_5bpw_exl2

Text Generation • Updated May 20 • 6

Zoyd/01-ai_Yi-1.5-34B-32K-3_0bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-34B-32K-3_5bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-34B-32K-3_75bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-34B-32K-4_0bpw_exl2

Text Generation • Updated May 20 • 8

Zoyd/01-ai_Yi-1.5-34B-32K-4_25bpw_exl2

Text Generation • Updated May 20 • 4

Zoyd/01-ai_Yi-1.5-34B-32K-5_0bpw_exl2

Text Generation • Updated May 20 • 2

Zoyd/01-ai_Yi-1.5-34B-32K-6_0bpw_exl2

Text Generation • Updated May 20 • 16

Zoyd/01-ai_Yi-1.5-34B-32K-6_5bpw_exl2

Text Generation • Updated May 20 • 2

Zoyd/01-ai_Yi-1.5-34B-32K-8_0bpw_exl2

Text Generation • Updated May 20 • 2

LoneStriker/Yi-1.5-34B-32K-GGUF

Updated May 20 • 22 • 5

Zoyd/01-ai_Yi-1.5-34B-Chat-16K-2_2bpw_exl2

Text Generation • Updated May 21 • 5

Zoyd/01-ai_Yi-1.5-34B-Chat-16K-2_5bpw_exl2

Text Generation • Updated May 21 • 5

LoneStriker/Yi-1.5-34B-32K-3.0bpw-h6-exl2

Text Generation • Updated May 20 • 5