llm-jp
/

llm-jp-13b-v2.0

Text Generation

text-generation-inference

Model card Files Files and versions Community

hkiyomaru commited on Apr 24

Commit

8703a3b

•

1 Parent(s): 8250994

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -73,14 +73,14 @@ print(tokenizer.decode(output))
 ```
-## Model Details (To be updated)
 - **Model type:** Transformer-based Language Model
-- **Total seen tokens:** 300B
 |Model|Params|Layers|Hidden size|Heads|Context length|
 |:---:|:---:|:---:|:---:|:---:|:---:|
-|13b model|13b|40|5120|40|2048|
 ## Training

 ```
+## Model Details
 - **Model type:** Transformer-based Language Model
+- **Total seen tokens:** 256B
 |Model|Params|Layers|Hidden size|Heads|Context length|
 |:---:|:---:|:---:|:---:|:---:|:---:|
+|13b model|13b|40|5120|40|4096|
 ## Training