Teja-Gollapudi
commited on
Commit
•
cdf62e0
1
Parent(s):
8df6308
Update README.md
Browse files
README.md
CHANGED
@@ -9,11 +9,21 @@ pipeline_tag: conversational
|
|
9 |
---
|
10 |
|
11 |
# VMware/open-llama-0.3T-7B-open-instruct-v1.1
|
|
|
|
|
12 |
<ul>
|
13 |
<li>Fully Open Source, <b>Commerically viable.</b></li>
|
14 |
<li>The instruction dataset, [VMware/open-instruct-v1.1-oasst-dolly-hhrlhf](https://huggingface.co/datasets/VMware/open-instruct-v1.1-oasst-dolly-hhrlhf) is under cc-by-sa-3.0, and the Language Model ([openlm-research/open_llama_7b_preview_300bt](https://huggingface.co/openlm-research/open_llama_7b_preview_300bt/tree/main/open_llama_7b_preview_300bt_transformers_weights)) is under apache-2.0 License.</li>
|
15 |
</ul>
|
16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
## Use in Transformers
|
18 |
|
19 |
Please load the tokenizer with 'add_bos_token = True' parameter as the underlying OpenLLaMa model and this model were trained with a BOS token.
|
|
|
9 |
---
|
10 |
|
11 |
# VMware/open-llama-0.3T-7B-open-instruct-v1.1
|
12 |
+
|
13 |
+
## License
|
14 |
<ul>
|
15 |
<li>Fully Open Source, <b>Commerically viable.</b></li>
|
16 |
<li>The instruction dataset, [VMware/open-instruct-v1.1-oasst-dolly-hhrlhf](https://huggingface.co/datasets/VMware/open-instruct-v1.1-oasst-dolly-hhrlhf) is under cc-by-sa-3.0, and the Language Model ([openlm-research/open_llama_7b_preview_300bt](https://huggingface.co/openlm-research/open_llama_7b_preview_300bt/tree/main/open_llama_7b_preview_300bt_transformers_weights)) is under apache-2.0 License.</li>
|
17 |
</ul>
|
18 |
|
19 |
+
## Nomenclature
|
20 |
+
<ul>
|
21 |
+
<li> Model : Open-llama
|
22 |
+
<li> Model trained on : 300B or 0.3 T tokens
|
23 |
+
<li> Model Size: 7B parameters
|
24 |
+
<li> Dataset: Open-instruct-v1.1 (oasst,dolly, hhrlhf)
|
25 |
+
</ul>
|
26 |
+
|
27 |
## Use in Transformers
|
28 |
|
29 |
Please load the tokenizer with 'add_bos_token = True' parameter as the underlying OpenLLaMa model and this model were trained with a BOS token.
|