Commit
•
df5ef64
1
Parent(s):
c3975ef
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,6 @@ widget:
|
|
| 11 |
library_name: transformers
|
| 12 |
---
|
| 13 |
|
| 14 |
-
BlueHeeler-10M is a nanoGPT (GPT-2) 6-head x 6-layer x 192-deep model trained on scripts from the children's show Bluey
|
| 15 |
|
| 16 |
`iter 2000: loss 1.2913, time 30647.72ms, mfu 0.05%`
|
|
|
|
| 11 |
library_name: transformers
|
| 12 |
---
|
| 13 |
|
| 14 |
+
BlueHeeler-10M is a nanoGPT (GPT-2) 6-head x 6-layer x 192-deep model with a context size of 64 trained on scripts from the children's show Bluey
|
| 15 |
|
| 16 |
`iter 2000: loss 1.2913, time 30647.72ms, mfu 0.05%`
|