Update README.md
Browse files
README.md
CHANGED
@@ -5,10 +5,19 @@ pipeline_tag: text-generation
|
|
5 |
# Model Card for Breeze-7B-Instruct-v0.1
|
6 |
|
7 |
|
8 |
-
|
|
|
|
|
|
|
9 |
|
10 |
|
11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
|
13 |
|
14 |
[Breeze-7B-Instruct-64k-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-64k-v0.1) is an extension to the Breeze-7B-v-0.1 model to enable 64k context length, which is equivalent to 88k Traditional Chinese characters.
|
|
|
5 |
# Model Card for Breeze-7B-Instruct-v0.1
|
6 |
|
7 |
|
8 |
+
Breeze-7B is a language model that builds upon the foundation of Mistral-7B, specifically
|
9 |
+
enhanced for Traditional Chinese. This model introduces an expanded vocabulary with additional 30,000 Traditional Chinese tokens,
|
10 |
+
significantly improving its performance in understanding and generating Traditional Chinese text. As a result,
|
11 |
+
the model is twice as efficient in the encoding and decoding of Traditional Chinese compared to Mistral-7B.
|
12 |
|
13 |
|
14 |
+
|
15 |
+
[Breeze-7B-Instruct-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v0.1) derives from the base model [Breeze-7B-Base-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Base-v0.1), which has been continually
|
16 |
+
pre-trained on a substantial dataset of 250GB of Traditional Chinese content. Additionally, it has undergone supervised fine-tuning with over 1 million instances to
|
17 |
+
sharpen its capabilities. Breeze-7B-Instruct-v0.1 demonstrates impressive performance in benchmarks for both English and Traditional Chinese, surpassing the results of
|
18 |
+
Taiwan-LLM-7B-v2.1-chat, Taiwan-LLM-13B-v2.0-chat and Qwen-7B-chat in Traditional Chinese assessments. It also excels in some benchmarks against Yi-6B-Chat.
|
19 |
+
In English evaluations, Breeze-7B-Instruct-v0.1 shows comparable results to Mistral-7B-Instruct-v0.1 on the MMLU and MT-Bench benchmarks.
|
20 |
+
|
21 |
|
22 |
|
23 |
[Breeze-7B-Instruct-64k-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-64k-v0.1) is an extension to the Breeze-7B-v-0.1 model to enable 64k context length, which is equivalent to 88k Traditional Chinese characters.
|