Hugging Face's logo

TheBloke
/
Llama-2-13B-chat-AWQ

Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-2
text-generation-inference
4-bit precision
awq
Model card Files Community
4
ybelkada commited on
Commit
aacb123
•
1 Parent(s): ea9528d

Update config.json

Browse files
Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -28,6 +28,6 @@
28
  "q_group_size": 128,
29
  "w_bit": 4,
30
  "version": "GEMM",
31
- "backend": "autoawq",
32
  }
33
  }
 
28
  "q_group_size": 128,
29
  "w_bit": 4,
30
  "version": "GEMM",
31
+ "backend": "autoawq"
32
  }
33
  }