metadata
tags:
- manticore
openaccess-ai-collective Manticore-13b-Chat-Pyg with the Guanaco 13b qLoRa from TimDettmers applied, uncensored
Quantized by mindrage to 4bit GPTQ, groupsize 128, no-act-order.
Command used to quantize: python3 llama.py Manticore-13B-Chat-Pyg-Guanaco-GPTQ-4bit-128g.no-act-order.safetensors c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors
The model seems to have benefited from further augmentation by openaccess-ai-collective with the Guanaco qLora by TimDettmer, pending further testing. It is very diverse and can generate output that seems eerily smart at times.
Promptimg style:
user: "USER:" bot: "ASSISTANT:" context: "This is a conversation between an advanced AI and a human user."