SebastianSchramm
/

UniNER-7B-all-GPTQ-4bit-128g-actorder_True

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

SebastianSchramm commited on Aug 26, 2023

Commit

be45b4b

•

1 Parent(s): 9be4774

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ inference: false
 ## Model Description
-The model [Universal-NER/UniNER-7B-all](https://huggingface.co/Universal-NER/UniNER-7B-all) was quantized to 4bit, group_size 128, and ascending_order=True with auto-gptq integration in transformers (https://huggingface.co/blog/gptq-integration).
 ## Evaluation
 TODO

 ## Model Description
+The model [Universal-NER/UniNER-7B-all](https://huggingface.co/Universal-NER/UniNER-7B-all) was quantized to 4bit, group_size 128, and act-order=True with auto-gptq integration in transformers (https://huggingface.co/blog/gptq-integration).
 ## Evaluation
 TODO