Crystalcareai
commited on
Commit
•
58771de
1
Parent(s):
e256df1
Update README.md
Browse files
README.md
CHANGED
@@ -32,7 +32,7 @@ Our appreciation for the sponsors of Dolphin 2.9.2:
|
|
32 |
|
33 |
This model is based on Qwen2-72b, and is governed by [tongyi-qianwen license](LICENSE)
|
34 |
|
35 |
-
The base model has
|
36 |
|
37 |
This model was trained FFT on parameters selected by [Laser Scanner](https://github.com/cognitivecomputations/laserRMT/blob/main/laser_scanner.py), using ChatML prompt template format.
|
38 |
|
|
|
32 |
|
33 |
This model is based on Qwen2-72b, and is governed by [tongyi-qianwen license](LICENSE)
|
34 |
|
35 |
+
The base model has 128k context, and the full-weight fine-tuning was with 8k sequence length.
|
36 |
|
37 |
This model was trained FFT on parameters selected by [Laser Scanner](https://github.com/cognitivecomputations/laserRMT/blob/main/laser_scanner.py), using ChatML prompt template format.
|
38 |
|