Update README.md
Browse files
README.md
CHANGED
|
@@ -31,3 +31,5 @@ Final checkpoint: RWKV-4-Pile-14B-20230213-8019.pth : Trained on the Pile for 33
|
|
| 31 |
* SC2016 acc 75.57%
|
| 32 |
* Hellaswag acc_norm 70.24%
|
| 33 |
* WinoGrande acc 62.98%
|
|
|
|
|
|
|
|
|
| 31 |
* SC2016 acc 75.57%
|
| 32 |
* Hellaswag acc_norm 70.24%
|
| 33 |
* WinoGrande acc 62.98%
|
| 34 |
+
|
| 35 |
+
ctx4096-test282: use this when you need long ctxlen. might be slightly weaker for short ctxlens.
|