FreedomIntelligence
/

AceGPT-7b-chat-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

hh2017 commited on Sep 23, 2023

Commit

f572f8e

•

1 Parent(s): 456d9b0

Update README.md

Files changed (1) hide show

README.md +5 -1

README.md CHANGED Viewed

@@ -10,7 +10,11 @@ quantized_by: FreedomIntelligence
 <!-- description start -->
 ## Description
-This repo contains GPTQ model files for [AceGPT 2 7B Chat](https://huggingface.co/FreedomIntelligence/AceGPT-7B-chat).
 <!-- description end -->

 <!-- description start -->
 ## Description
+This repo contains int4 model(GPTQ) for [AceGPT-7B-Chat](https://huggingface.co/FreedomIntelligence/AceGPT-7B-chat).
+The performance of the int4 version has experienced some degradation. For a better user experience, please use the fp16 version.
+For details, see [AceGPT-7B-Chat](https://huggingface.co/FreedomIntelligence/AceGPT-7B-chat) and [AceGPT-13B-Chat](https://huggingface.co/FreedomIntelligence/AceGPT-13B-chat).
 <!-- description end -->