Update README.md
Browse files
README.md
CHANGED
|
@@ -14,16 +14,13 @@ datasets:
|
|
| 14 |
inference: false
|
| 15 |
---
|
| 16 |
|
| 17 |
-
|
| 18 |
-
|
| 19 |
<br/>
|
| 20 |
Trained with google cloud TPUs.
|
| 21 |
-
|
| 22 |
```
|
| 23 |
Runtime: 3h 26m 44s
|
| 24 |
Steps: 18000
|
| 25 |
Precision: bf16
|
| 26 |
Learning Rate: 1e-6
|
| 27 |
```
|
| 28 |
-
|
| 29 |
|
|
|
|
| 14 |
inference: false
|
| 15 |
---
|
| 16 |
|
| 17 |
+
Maybe this is the first ever model trained with TPUs and converted to 🧨 PyTorch 🎊🎉
|
|
|
|
| 18 |
<br/>
|
| 19 |
Trained with google cloud TPUs.
|
|
|
|
| 20 |
```
|
| 21 |
Runtime: 3h 26m 44s
|
| 22 |
Steps: 18000
|
| 23 |
Precision: bf16
|
| 24 |
Learning Rate: 1e-6
|
| 25 |
```
|
|
|
|
| 26 |
|