BAAI
/

Infinity-Instruct-3M-0625-Llama3-70B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

hyxmmm commited on Jul 9

Commit

2dcae60

•

1 Parent(s): 434a95e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -35,7 +35,7 @@ Infinity-Instruct-3M-0625-Llama3-70B is an opensource supervised instruction tun
 <img src="fig/trainingflow.png">
 </p>
-Infinity-Instruct-3M-0625-Llama3-70B is tuned on Million-level instruction dataset [Infinity-Instruct](https://huggingface.co/datasets/BAAI/Infinity-Instruct). First, we apply the foundational dataset Infinity-Instruct-3M to improve the foundational ability (math & code) of Llama3-70B, and get the foundational instruct model Infinity-Instruct-3M-Mistral-7B. Then we finetune the Infinity-Instruct-3M-Llama3-70B to get the stronger chat model Infinity-Instruct-3M-0625-Llama3-70B. Here is the training hyperparamers.
 ```bash
 epoch: 3

 <img src="fig/trainingflow.png">
 </p>
+Infinity-Instruct-3M-0625-Llama3-70B is tuned on Million-level instruction dataset [Infinity-Instruct](https://huggingface.co/datasets/BAAI/Infinity-Instruct). First, we apply the foundational dataset Infinity-Instruct-3M to improve the foundational ability (math & code) of Llama3-70B, and get the foundational instruct model Infinity-Instruct-3M-Llama3-70B. Then we finetune the Infinity-Instruct-3M-Llama3-70B to get the stronger chat model Infinity-Instruct-3M-0625-Llama3-70B. Here is the training hyperparamers.
 ```bash
 epoch: 3