Update README.md
#57
by
ybelkada
- opened
README.md
CHANGED
|
@@ -1794,6 +1794,8 @@ BLOOM is an autoregressive Large Language Model (LLM), trained to continue text
|
|
| 1794 |
|
| 1795 |
**Model Type:** Transformer-based Language Model
|
| 1796 |
|
|
|
|
|
|
|
| 1797 |
**Version:** 1.0.0
|
| 1798 |
|
| 1799 |
**Languages:** Multiple; see [training data](#training-data)
|
|
|
|
| 1794 |
|
| 1795 |
**Model Type:** Transformer-based Language Model
|
| 1796 |
|
| 1797 |
+
**Checkpoints format:** `transformers` (Megatron-DeepSpeed format available [here](https://huggingface.co/bigscience/bloom-optimizer-states))
|
| 1798 |
+
|
| 1799 |
**Version:** 1.0.0
|
| 1800 |
|
| 1801 |
**Languages:** Multiple; see [training data](#training-data)
|