OrionStarAI
/

Orion-14B-Chat-Int4

Text Generation

4-bit precision

Model card Files Files and versions Community

renillhuang commited on Jan 25

Commit

c900962

•

1 Parent(s): ccbda11

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -279,6 +279,8 @@ CUDA_VISIBLE_DEVICES=0 python demo/text_generation_base.py --model OrionStarAI/O
 CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-14B-Chat --tokenizer OrionStarAI/Orion-14B-Chat --prompt hi
 ```
 ## 4.4. Inference by vllm
 - Project URL<br>

 CUDA_VISIBLE_DEVICES=0 python demo/text_generation.py --model OrionStarAI/Orion-14B-Chat --tokenizer OrionStarAI/Orion-14B-Chat --prompt hi
 ```
+<a name="vllm"></a><br>
 ## 4.4. Inference by vllm
 - Project URL<br>