Hugging Face's logo

TheBloke
/
GPlatty-30B-SuperHOT-8K-GPTQ

Text Generation
Transformers
Safetensors
llama
custom_code
text-generation-inference
4-bit precision
gptq
Model card Files Community
2
New discussion

what's the prompt template of this model?

1
#2 opened over 1 year ago by yiouyou

In text-generation-webui I don't see where to set the LOADER to ExLlama

2
#1 opened over 1 year ago by cleverest