renillhuang commited on
Commit
d8da45f
โ€ข
1 Parent(s): d2ade3d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -24,7 +24,6 @@
24
  </div>
25
 
26
 
27
-
28
  # Table of Contents
29
 
30
  - [๐Ÿ“– Model Introduction](#model-introduction)
@@ -34,6 +33,7 @@
34
  - [๐Ÿ“œ Declarations & License](#declarations-license)
35
  - [๐Ÿฅ‡ Company Introduction](#company-introduction)
36
 
 
37
  # 1. Model Introduction
38
 
39
  - Orion-14B series models are open-source multilingual large language models trained from scratch by OrionStarAI. The base model is trained on 2.5T multilingual corpus, including Chinese, English, Japanese, Korean, etc, and it exhibits superior performance in these languages. For details, please refer to [tech report](https://github.com/OrionStarAI/Orion/blob/master/doc/Orion14B_v3.pdf).
@@ -64,6 +64,8 @@
64
  - **Orion-14B-Base-Int4:** A quantized base model utilizing 4-bit integer weights. It significantly reduces the model size by 70% and increases the inference speed by 30% while incurring a minimal performance loss of only 1%.
65
  - **Orion-14B-Chat-Int4:** A quantized chat model utilizing 4-bit integer weights.
66
 
 
 
67
  # 2. Model Download
68
 
69
  Model release and download links are provided in the table below:
@@ -78,6 +80,7 @@ Model release and download links are provided in the table below:
78
  | ๐Ÿ’ผOrion-14B-Base-Int4 | [Orion-14B-Base-Int4](https://huggingface.co/OrionStarAI/Orion-14B-Base-Int4) | [Orion-14B-Base-Int4](https://modelscope.cn/models/OrionStarAI/Orion-14B-Base-Int4/summary) |
79
  | ๐Ÿ“ฆOrion-14B-Chat-Int4 | [Orion-14B-Chat-Int4](https://huggingface.co/OrionStarAI/Orion-14B-Chat-Int4) | [Orion-14B-Chat-Int4](https://modelscope.cn/models/OrionStarAI/Orion-14B-Chat-Int4/summary) |
80
 
 
81
  # 3. Model Benchmarks
82
 
83
  ## 3.1. Base Model Orion-14B-Base Benchmarks
@@ -210,6 +213,8 @@ Model release and download links are provided in the table below:
210
  | OrionStar-14B-Base | 28.0 | 135 | 72.8 | 70.6 | 70.0 | 93.3 | 78.5 |
211
  | OrionStar-14B-Base-Int4 | 8.3 | 178 | 71.8 | 69.8 | 69.2 | 93.1 | 78.0 |
212
 
 
 
213
  # 4. Model Inference
214
 
215
  Model weights, source code, and configuration needed for inference are published on Hugging Face, and the download link
@@ -290,7 +295,7 @@ User๏ผš์ž๊ธฐ์†Œ๊ฐœ๋ฅผ ํ•ด์ฃผ์„ธ์š”.
290
  Orion-14B๏ผš์•ˆ๋…•ํ•˜์„ธ์š”, ์ œ ์ด๋ฆ„์€ ChatMax์ž…๋‹ˆ๋‹ค. OrionStar์—์„œ ๊ฐœ๋ฐœํ•œ AI ์–ด์‹œ์Šคํ„ดํŠธ์ž…๋‹ˆ๋‹ค. ์ €๋Š” ์‚ฌ์šฉ์ž๋“ค์—๊ฒŒ ์ •ํ™•ํ•˜๊ณ  ๊ฐ๊ด€์ ์ด๋ฉฐ ์œ ์šฉํ•œ ๋‹ต๋ณ€์„ ์ œ๊ณตํ•˜์—ฌ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๊ณ  ์ •๋ณด๋ฅผ ์–ป๋Š” ๋ฐ ๋„์›€์„ ์ค„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
291
  `````
292
 
293
-
294
  # 5. Declarations, License
295
 
296
  ## 5.1. Declarations
@@ -311,6 +316,7 @@ Community use of the Orion-14B series models
311
  - For model, please comply with [ใ€Orion-14B Seriesใ€‘ Models Community License Agreement](./ModelsCommunityLicenseAgreement)
312
 
313
 
 
314
  # 6. Company Introduction
315
 
316
  OrionStar is a leading global service robot solutions company, founded in September 2016. OrionStar is dedicated to
 
24
  </div>
25
 
26
 
 
27
  # Table of Contents
28
 
29
  - [๐Ÿ“– Model Introduction](#model-introduction)
 
33
  - [๐Ÿ“œ Declarations & License](#declarations-license)
34
  - [๐Ÿฅ‡ Company Introduction](#company-introduction)
35
 
36
+ <a name="model-introduction"></a><br>
37
  # 1. Model Introduction
38
 
39
  - Orion-14B series models are open-source multilingual large language models trained from scratch by OrionStarAI. The base model is trained on 2.5T multilingual corpus, including Chinese, English, Japanese, Korean, etc, and it exhibits superior performance in these languages. For details, please refer to [tech report](https://github.com/OrionStarAI/Orion/blob/master/doc/Orion14B_v3.pdf).
 
64
  - **Orion-14B-Base-Int4:** A quantized base model utilizing 4-bit integer weights. It significantly reduces the model size by 70% and increases the inference speed by 30% while incurring a minimal performance loss of only 1%.
65
  - **Orion-14B-Chat-Int4:** A quantized chat model utilizing 4-bit integer weights.
66
 
67
+
68
+ <a name="model-download"></a><br>
69
  # 2. Model Download
70
 
71
  Model release and download links are provided in the table below:
 
80
  | ๐Ÿ’ผOrion-14B-Base-Int4 | [Orion-14B-Base-Int4](https://huggingface.co/OrionStarAI/Orion-14B-Base-Int4) | [Orion-14B-Base-Int4](https://modelscope.cn/models/OrionStarAI/Orion-14B-Base-Int4/summary) |
81
  | ๐Ÿ“ฆOrion-14B-Chat-Int4 | [Orion-14B-Chat-Int4](https://huggingface.co/OrionStarAI/Orion-14B-Chat-Int4) | [Orion-14B-Chat-Int4](https://modelscope.cn/models/OrionStarAI/Orion-14B-Chat-Int4/summary) |
82
 
83
+ <a name="model-benchmark"></a><br>
84
  # 3. Model Benchmarks
85
 
86
  ## 3.1. Base Model Orion-14B-Base Benchmarks
 
213
  | OrionStar-14B-Base | 28.0 | 135 | 72.8 | 70.6 | 70.0 | 93.3 | 78.5 |
214
  | OrionStar-14B-Base-Int4 | 8.3 | 178 | 71.8 | 69.8 | 69.2 | 93.1 | 78.0 |
215
 
216
+
217
+ <a name="model-inference"></a><br>
218
  # 4. Model Inference
219
 
220
  Model weights, source code, and configuration needed for inference are published on Hugging Face, and the download link
 
295
  Orion-14B๏ผš์•ˆ๋…•ํ•˜์„ธ์š”, ์ œ ์ด๋ฆ„์€ ChatMax์ž…๋‹ˆ๋‹ค. OrionStar์—์„œ ๊ฐœ๋ฐœํ•œ AI ์–ด์‹œ์Šคํ„ดํŠธ์ž…๋‹ˆ๋‹ค. ์ €๋Š” ์‚ฌ์šฉ์ž๋“ค์—๊ฒŒ ์ •ํ™•ํ•˜๊ณ  ๊ฐ๊ด€์ ์ด๋ฉฐ ์œ ์šฉํ•œ ๋‹ต๋ณ€์„ ์ œ๊ณตํ•˜์—ฌ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๊ณ  ์ •๋ณด๋ฅผ ์–ป๋Š” ๋ฐ ๋„์›€์„ ์ค„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
296
  `````
297
 
298
+ <a name="declarations-license"></a><br>
299
  # 5. Declarations, License
300
 
301
  ## 5.1. Declarations
 
316
  - For model, please comply with [ใ€Orion-14B Seriesใ€‘ Models Community License Agreement](./ModelsCommunityLicenseAgreement)
317
 
318
 
319
+ <a name="company-introduction"></a><br>
320
  # 6. Company Introduction
321
 
322
  OrionStar is a leading global service robot solutions company, founded in September 2016. OrionStar is dedicated to