File size: 2,171 Bytes
a291bf0
ccc62ae
a291bf0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
616fc5a
a291bf0
616fc5a
 
a291bf0
616fc5a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
<div align="center">

<picture> 
  <img alt="specify theme context for images" src="https://raw.githubusercontent.com/01-ai/Yi/main/assets/img/Yi_logo_icon_light.svg" width="150px">
</picture>

</div>

<p align="center">
  <a href="https://github.com/01-ai">πŸ€— HuggingFace</a> β€’
  <a href="https://www.modelscope.cn/organization/01ai/">πŸ€– ModelScope</a> β€’
  <a href="https://wisemodel.cn/organization/01.AI">✑️ WiseModel</a> 
  <br/>
  <a href="https://github.com/01-ai/Yi-1.5">πŸ™ GitHub</a> β€’
  <a href="https://discord.gg/hYUwWddeAu">πŸ‘Ύ Discord</a> β€’
  <a href="https://twitter.com/01ai_yi">🐀 Twitter</a> β€’
  <a href="https://github.com/01-ai/Yi/issues/43#issuecomment-1827285245">πŸ’¬ WeChat</a> 
  <br/>
  <a href="https://arxiv.org/abs/2403.04652">πŸ“ Paper</a> β€’
  <a href="https://github.com/01-ai/Yi/tree/main?tab=readme-ov-file#faq">πŸ™Œ FAQ</a> β€’
  <a href="https://github.com/01-ai/Yi/tree/main?tab=readme-ov-file#learning-hub">πŸ“— Learning Hub</a>
</p>

# Intro

Yi-1.5 is an upgraded version of Yi. It is continuously pre-trained on Yi with a high-quality corpus of 500B tokens and fine-tuned on 3M diverse fine-tuning samples. 

Compared with Yi, Yi-1.5 delivers stronger performance in coding, math, reasoning, and instruction-following capability, while still maintaining excellent capabilities in language understanding, commonsense reasoning, and reading comprehension.

<div align="center">
  
Model | Context Length | Pre-trained Tokens
| :------------: | :------------: | :------------: |
| Yi-1.5 | 4K | 3.6T

</div>

# Models

- Chat models

<div align="center">

Model | Download
| :------------: | :------------: |
Yi-1.5-34B-Chat | β€’ πŸ€— Hugging Face 
Yi-1.5-9B-Chat  | β€’ πŸ€— Hugging Face 
Yi-1.5-6B-Chat  | β€’ πŸ€— Hugging Face 

</div>

- Base models

<div align="center">

Model | Download
| :------------: | :------------: |
Yi-1.5-34B | β€’ πŸ€— Hugging Face 
Yi-1.5-9B  | β€’ πŸ€— Hugging Face 
Yi-1.5-6B  | β€’ πŸ€— Hugging Face 

</div>

# Benchmarks

- Chat models

- Base models

# Quick Start

For getting up and running with Yi-1.5 models quickly, see [README](https://github.com/01-ai/Yi-1.5).