Edit Models filters

Model Tree

Qwen/Qwen2-7B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

71

Full-text search

Active filters: Qwen/Qwen2-7B-Instruct

CHE-72/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 21 • 4

CHE-72/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jun 21 • 4

CHE-72/Qwen2-7B-Instruct-Q5_0-GGUF

Text Generation • Updated Jun 21 • 9

CHE-72/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 21

CHE-72/Qwen2-7B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jun 21 • 7

CHE-72/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Jun 21 • 16

CHE-72/Qwen2-7B-Instruct-Q3_K_L-GGUF

Text Generation • Updated Jun 21 • 6

CHE-72/Qwen2-7B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Jun 21 • 8

CHE-72/Qwen2-7B-Instruct-Q3_K_S-GGUF

Text Generation • Updated Jun 21 • 4

CHE-72/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Jun 21 • 3

CHE-72-ZLab/Alibaba-Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 23 • 74

Minuano/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 10 • 4

martintomov/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 11 • 2

PrunaAI/Qwen-Qwen2-7B-Instruct-bnb-4bit-smashed

Text Generation • Updated Jul 13 • 12

PrunaAI/Qwen-Qwen2-7B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 13 • 10

Kondara/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 26 • 5

TAYUCOKI/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 29

nguyenphuthien/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 30 • 13

TrentJohnsongtri/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 30 • 4

blogcncom/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Aug 5 • 51

yashagra/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Aug 8 • 15

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 20 • 1.15k

ysn-rfd/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 17

hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Sep 17 • 3

Junrui2021/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 11 • 2

noway-wf/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 24

Triangle104/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 24 • 12 • 1

Triangle104/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Aug 24 • 1

Triangle104/Qwen2-7B-Instruct-Q6_K-GGUF

Text Generation • Updated Aug 24 • 8

Triangle104/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Aug 24 • 4