Edit Models filters

Model Tree

Qwen/Qwen2-7B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

71

Full-text search

Active filters: Qwen/Qwen2-7B-Instruct

CHE-72/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jun 21 • 12

CHE-72/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jun 21 • 2

CHE-72/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jun 21 • 5

CHE-72/Qwen2-7B-Instruct-Q5_0-GGUF

Text Generation • Updated Jun 21 • 13

CHE-72/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jun 21 • 6

CHE-72/Qwen2-7B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jun 21 • 10

CHE-72/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Jun 21 • 17

CHE-72/Qwen2-7B-Instruct-Q3_K_L-GGUF

Text Generation • Updated Jun 21 • 18

CHE-72/Qwen2-7B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Jun 21 • 21

CHE-72/Qwen2-7B-Instruct-Q3_K_S-GGUF

Text Generation • Updated Jun 21 • 14

CHE-72/Qwen2-7B-Instruct-Q2_K-GGUF

Text Generation • Updated Jun 21 • 15

CHE-72-ZLab/Alibaba-Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 23 • 64

Minuano/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 10 • 5

martintomov/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 11 • 4

PrunaAI/Qwen-Qwen2-7B-Instruct-bnb-4bit-smashed

Text Generation • Updated Jul 13 • 11

PrunaAI/Qwen-Qwen2-7B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 13 • 11

Kondara/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 26 • 4

TAYUCOKI/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 29 • 9

nguyenphuthien/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 30 • 20

TrentJohnsongtri/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 30 • 1

blogcncom/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Aug 5 • 57

yashagra/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated Aug 8 • 28

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 20 • 1.22k

ysn-rfd/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 17 • 7

hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Sep 17 • 12

Junrui2021/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 11 • 5

noway-wf/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Aug 24

Triangle104/Qwen2-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Aug 24 • 13

Triangle104/Qwen2-7B-Instruct-Q6_K-GGUF

Text Generation • Updated Aug 24 • 11

Triangle104/Qwen2-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Aug 24 • 18