renillhuang
commited on
Commit
โข
d8da45f
1
Parent(s):
d2ade3d
Update README.md
Browse files
README.md
CHANGED
@@ -24,7 +24,6 @@
|
|
24 |
</div>
|
25 |
|
26 |
|
27 |
-
|
28 |
# Table of Contents
|
29 |
|
30 |
- [๐ Model Introduction](#model-introduction)
|
@@ -34,6 +33,7 @@
|
|
34 |
- [๐ Declarations & License](#declarations-license)
|
35 |
- [๐ฅ Company Introduction](#company-introduction)
|
36 |
|
|
|
37 |
# 1. Model Introduction
|
38 |
|
39 |
- Orion-14B series models are open-source multilingual large language models trained from scratch by OrionStarAI. The base model is trained on 2.5T multilingual corpus, including Chinese, English, Japanese, Korean, etc, and it exhibits superior performance in these languages. For details, please refer to [tech report](https://github.com/OrionStarAI/Orion/blob/master/doc/Orion14B_v3.pdf).
|
@@ -64,6 +64,8 @@
|
|
64 |
- **Orion-14B-Base-Int4:** A quantized base model utilizing 4-bit integer weights. It significantly reduces the model size by 70% and increases the inference speed by 30% while incurring a minimal performance loss of only 1%.
|
65 |
- **Orion-14B-Chat-Int4:** A quantized chat model utilizing 4-bit integer weights.
|
66 |
|
|
|
|
|
67 |
# 2. Model Download
|
68 |
|
69 |
Model release and download links are provided in the table below:
|
@@ -78,6 +80,7 @@ Model release and download links are provided in the table below:
|
|
78 |
| ๐ผOrion-14B-Base-Int4 | [Orion-14B-Base-Int4](https://huggingface.co/OrionStarAI/Orion-14B-Base-Int4) | [Orion-14B-Base-Int4](https://modelscope.cn/models/OrionStarAI/Orion-14B-Base-Int4/summary) |
|
79 |
| ๐ฆOrion-14B-Chat-Int4 | [Orion-14B-Chat-Int4](https://huggingface.co/OrionStarAI/Orion-14B-Chat-Int4) | [Orion-14B-Chat-Int4](https://modelscope.cn/models/OrionStarAI/Orion-14B-Chat-Int4/summary) |
|
80 |
|
|
|
81 |
# 3. Model Benchmarks
|
82 |
|
83 |
## 3.1. Base Model Orion-14B-Base Benchmarks
|
@@ -210,6 +213,8 @@ Model release and download links are provided in the table below:
|
|
210 |
| OrionStar-14B-Base | 28.0 | 135 | 72.8 | 70.6 | 70.0 | 93.3 | 78.5 |
|
211 |
| OrionStar-14B-Base-Int4 | 8.3 | 178 | 71.8 | 69.8 | 69.2 | 93.1 | 78.0 |
|
212 |
|
|
|
|
|
213 |
# 4. Model Inference
|
214 |
|
215 |
Model weights, source code, and configuration needed for inference are published on Hugging Face, and the download link
|
@@ -290,7 +295,7 @@ User๏ผ์๊ธฐ์๊ฐ๋ฅผ ํด์ฃผ์ธ์.
|
|
290 |
Orion-14B๏ผ์๋
ํ์ธ์, ์ ์ด๋ฆ์ ChatMax์
๋๋ค. OrionStar์์ ๊ฐ๋ฐํ AI ์ด์์คํดํธ์
๋๋ค. ์ ๋ ์ฌ์ฉ์๋ค์๊ฒ ์ ํํ๊ณ ๊ฐ๊ด์ ์ด๋ฉฐ ์ ์ฉํ ๋ต๋ณ์ ์ ๊ณตํ์ฌ ๋ฌธ์ ๋ฅผ ํด๊ฒฐํ๊ณ ์ ๋ณด๋ฅผ ์ป๋ ๋ฐ ๋์์ ์ค ์ ์์ต๋๋ค.
|
291 |
`````
|
292 |
|
293 |
-
|
294 |
# 5. Declarations, License
|
295 |
|
296 |
## 5.1. Declarations
|
@@ -311,6 +316,7 @@ Community use of the Orion-14B series models
|
|
311 |
- For model, please comply with [ใOrion-14B Seriesใ Models Community License Agreement](./ModelsCommunityLicenseAgreement)
|
312 |
|
313 |
|
|
|
314 |
# 6. Company Introduction
|
315 |
|
316 |
OrionStar is a leading global service robot solutions company, founded in September 2016. OrionStar is dedicated to
|
|
|
24 |
</div>
|
25 |
|
26 |
|
|
|
27 |
# Table of Contents
|
28 |
|
29 |
- [๐ Model Introduction](#model-introduction)
|
|
|
33 |
- [๐ Declarations & License](#declarations-license)
|
34 |
- [๐ฅ Company Introduction](#company-introduction)
|
35 |
|
36 |
+
<a name="model-introduction"></a><br>
|
37 |
# 1. Model Introduction
|
38 |
|
39 |
- Orion-14B series models are open-source multilingual large language models trained from scratch by OrionStarAI. The base model is trained on 2.5T multilingual corpus, including Chinese, English, Japanese, Korean, etc, and it exhibits superior performance in these languages. For details, please refer to [tech report](https://github.com/OrionStarAI/Orion/blob/master/doc/Orion14B_v3.pdf).
|
|
|
64 |
- **Orion-14B-Base-Int4:** A quantized base model utilizing 4-bit integer weights. It significantly reduces the model size by 70% and increases the inference speed by 30% while incurring a minimal performance loss of only 1%.
|
65 |
- **Orion-14B-Chat-Int4:** A quantized chat model utilizing 4-bit integer weights.
|
66 |
|
67 |
+
|
68 |
+
<a name="model-download"></a><br>
|
69 |
# 2. Model Download
|
70 |
|
71 |
Model release and download links are provided in the table below:
|
|
|
80 |
| ๐ผOrion-14B-Base-Int4 | [Orion-14B-Base-Int4](https://huggingface.co/OrionStarAI/Orion-14B-Base-Int4) | [Orion-14B-Base-Int4](https://modelscope.cn/models/OrionStarAI/Orion-14B-Base-Int4/summary) |
|
81 |
| ๐ฆOrion-14B-Chat-Int4 | [Orion-14B-Chat-Int4](https://huggingface.co/OrionStarAI/Orion-14B-Chat-Int4) | [Orion-14B-Chat-Int4](https://modelscope.cn/models/OrionStarAI/Orion-14B-Chat-Int4/summary) |
|
82 |
|
83 |
+
<a name="model-benchmark"></a><br>
|
84 |
# 3. Model Benchmarks
|
85 |
|
86 |
## 3.1. Base Model Orion-14B-Base Benchmarks
|
|
|
213 |
| OrionStar-14B-Base | 28.0 | 135 | 72.8 | 70.6 | 70.0 | 93.3 | 78.5 |
|
214 |
| OrionStar-14B-Base-Int4 | 8.3 | 178 | 71.8 | 69.8 | 69.2 | 93.1 | 78.0 |
|
215 |
|
216 |
+
|
217 |
+
<a name="model-inference"></a><br>
|
218 |
# 4. Model Inference
|
219 |
|
220 |
Model weights, source code, and configuration needed for inference are published on Hugging Face, and the download link
|
|
|
295 |
Orion-14B๏ผ์๋
ํ์ธ์, ์ ์ด๋ฆ์ ChatMax์
๋๋ค. OrionStar์์ ๊ฐ๋ฐํ AI ์ด์์คํดํธ์
๋๋ค. ์ ๋ ์ฌ์ฉ์๋ค์๊ฒ ์ ํํ๊ณ ๊ฐ๊ด์ ์ด๋ฉฐ ์ ์ฉํ ๋ต๋ณ์ ์ ๊ณตํ์ฌ ๋ฌธ์ ๋ฅผ ํด๊ฒฐํ๊ณ ์ ๋ณด๋ฅผ ์ป๋ ๋ฐ ๋์์ ์ค ์ ์์ต๋๋ค.
|
296 |
`````
|
297 |
|
298 |
+
<a name="declarations-license"></a><br>
|
299 |
# 5. Declarations, License
|
300 |
|
301 |
## 5.1. Declarations
|
|
|
316 |
- For model, please comply with [ใOrion-14B Seriesใ Models Community License Agreement](./ModelsCommunityLicenseAgreement)
|
317 |
|
318 |
|
319 |
+
<a name="company-introduction"></a><br>
|
320 |
# 6. Company Introduction
|
321 |
|
322 |
OrionStar is a leading global service robot solutions company, founded in September 2016. OrionStar is dedicated to
|