Hugging Face's logo

TheBloke
/
GPT4All-13B-snoozy-GPTQ

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
4-bit precision
gptq
Model card Files Community
4
TheBloke commited on
Commit
2aa150d
•
1 Parent(s): 295f50c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -15,6 +15,7 @@ It is the result of quantising to 4bit using [GPTQ-for-LLaMa](https://github.com
15
  ## Repositories available
16
 
17
  * [4bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/GPT4ALL-13B-snoozy-GPTQ).
 
18
  * [Nomic.AI's original model in float32 HF for GPU inference](https://huggingface.co/nomic-ai/gpt4all-13b-snoozy).
19
 
20
  ## How to easily download and use this model in text-generation-webui
 
15
  ## Repositories available
16
 
17
  * [4bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/GPT4ALL-13B-snoozy-GPTQ).
18
+ * [4bit and 5bit GGML models for GPU inference](https://huggingface.co/TheBloke/GPT4ALL-13B-snoozy-GGML).
19
  * [Nomic.AI's original model in float32 HF for GPU inference](https://huggingface.co/nomic-ai/gpt4all-13b-snoozy).
20
 
21
  ## How to easily download and use this model in text-generation-webui