File size: 384 Bytes
eaa5f55
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
---
license: llama2
---

Training is currently still underway, but this is the first epoch of a 32k context fine-tuning run of Mistral-7b over the following datasets:

  - emrgnt-cmplxty/sciphi-textbooks-are-all-you-need
  - open-phi/rag-textbook-instruct-full
  - open-phi/programming_books_llama
  - open-phi/textbooks
  - Open-Orca/SlimOrca
  - WizardLM/WizardLM_evol_instruct_70k