Update README.md
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ datasets:
|
|
18 |
|
19 |
RWKV-4 14B is a L40-D5120 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
|
20 |
|
21 |
-
** Note: It's a BF16 model, and it may overflow if you are using FP16 (
|
22 |
|
23 |
At this moment you have to use my Github code (https://github.com/BlinkDL/RWKV-LM) to run it.
|
24 |
|
|
|
18 |
|
19 |
RWKV-4 14B is a L40-D5120 causal language model trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.
|
20 |
|
21 |
+
** Note: It's a BF16 model, and it may overflow if you are using FP16 (fixable by rescaling the weights). **
|
22 |
|
23 |
At this moment you have to use my Github code (https://github.com/BlinkDL/RWKV-LM) to run it.
|
24 |
|