Commit
•
c11ef27
1
Parent(s):
d1599f9
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,7 @@ Trained from scratch using Tensorflow Keras
|
|
| 14 |
[200mb Russian Comments from 2ch](https://www.kaggle.com/datasets/fizzzgen/65mb-of-dvach-conversations) dataset used
|
| 15 |
|
| 16 |
- Type: decoder-only
|
|
|
|
| 17 |
- Vocabulary size: 32000
|
| 18 |
- Hidden size: 768
|
| 19 |
- FFN size: 3072
|
|
|
|
| 14 |
[200mb Russian Comments from 2ch](https://www.kaggle.com/datasets/fizzzgen/65mb-of-dvach-conversations) dataset used
|
| 15 |
|
| 16 |
- Type: decoder-only
|
| 17 |
+
- Tokenizer: BPE
|
| 18 |
- Vocabulary size: 32000
|
| 19 |
- Hidden size: 768
|
| 20 |
- FFN size: 3072
|