YC-Chen commited on
Commit
aaa5c31
1 Parent(s): 731c46c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -2
README.md CHANGED
@@ -5,10 +5,19 @@ pipeline_tag: text-generation
5
  # Model Card for Breeze-7B-Instruct-v0.1
6
 
7
 
8
- [Breeze-7B-Base-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Base-v0.1) is a language model that builds upon the foundation of Mistral-7B, specifically enhanced for Traditional Chinese. This model introduces an expanded vocabulary with additional 30,000 Traditional Chinese tokens, significantly improving its performance in understanding and generating Traditional Chinese text. As a result, the model is twice as efficient in the encoding and decoding of Traditional Chinese compared to Mistral-7B.
 
 
 
9
 
10
 
11
- [Breeze-7B-Instruct-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v0.1) derives from the base model Breeze-7B-Base-v0.1, which has been continually pre-trained on a substantial dataset of 250GB of Traditional Chinese content. Additionally, it has undergone supervised fine-tuning with over 1 million instances to sharpen its capabilities. Breeze-7B-Instruct-v0.1 demonstrates impressive performance in benchmarks for both English and Traditional Chinese, surpassing the results of Taiwan-LLM-7B-v2.1-chat, Taiwan-LLM-13B-v2.0-chat and Qwen-7B-chat in Traditional Chinese assessments. It also excels in some benchmarks against Yi-6B-Chat. In English evaluations, Breeze-7B-Instruct-v0.1 shows comparable results to Mistral-7B-Instruct-v0.1 on the MMLU and MT-Bench benchmarks. This achievement marks a significant milestone as it is the first instance of vocabulary expansion in a model tailored for Traditional Chinese.
 
 
 
 
 
 
12
 
13
 
14
  [Breeze-7B-Instruct-64k-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-64k-v0.1) is an extension to the Breeze-7B-v-0.1 model to enable 64k context length, which is equivalent to 88k Traditional Chinese characters.
 
5
  # Model Card for Breeze-7B-Instruct-v0.1
6
 
7
 
8
+ Breeze-7B is a language model that builds upon the foundation of Mistral-7B, specifically
9
+ enhanced for Traditional Chinese. This model introduces an expanded vocabulary with additional 30,000 Traditional Chinese tokens,
10
+ significantly improving its performance in understanding and generating Traditional Chinese text. As a result,
11
+ the model is twice as efficient in the encoding and decoding of Traditional Chinese compared to Mistral-7B.
12
 
13
 
14
+
15
+ [Breeze-7B-Instruct-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-v0.1) derives from the base model [Breeze-7B-Base-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Base-v0.1), which has been continually
16
+ pre-trained on a substantial dataset of 250GB of Traditional Chinese content. Additionally, it has undergone supervised fine-tuning with over 1 million instances to
17
+ sharpen its capabilities. Breeze-7B-Instruct-v0.1 demonstrates impressive performance in benchmarks for both English and Traditional Chinese, surpassing the results of
18
+ Taiwan-LLM-7B-v2.1-chat, Taiwan-LLM-13B-v2.0-chat and Qwen-7B-chat in Traditional Chinese assessments. It also excels in some benchmarks against Yi-6B-Chat.
19
+ In English evaluations, Breeze-7B-Instruct-v0.1 shows comparable results to Mistral-7B-Instruct-v0.1 on the MMLU and MT-Bench benchmarks.
20
+
21
 
22
 
23
  [Breeze-7B-Instruct-64k-v0.1](https://huggingface.co/MediaTek-Research/Breeze-7B-Instruct-64k-v0.1) is an extension to the Breeze-7B-v-0.1 model to enable 64k context length, which is equivalent to 88k Traditional Chinese characters.