File size: 751 Bytes
39a408e |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 |
---
tags: ["manticore"]
---
openaccess-ai-collective Manticore-13b-Chat-Pyg with the Guanaco 13b qLoRa from TimDettmers applied, uncensored
---
Quantized by mindrage to 4bit GPTQ, groupsize 128, no-act-order.
Command used to quantize:
python3 llama.py Manticore-13B-Chat-Pyg-Guanaco-GPTQ-4bit-128g.no-act-order.safetensors c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors
The model seems to have benefited from further augmentation by openaccess-ai-collective with the Guanaco qLora by TimDettmer, pending further testing.
It is very diverse and can generate output that seems eerily smart at times.
Promptimg style:
user: "USER:"
bot: "ASSISTANT:"
context: "This is a conversation between an advanced AI and a human user."
|