Teja-Gollapudi commited on
Commit
cdf62e0
1 Parent(s): 8df6308

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -9,11 +9,21 @@ pipeline_tag: conversational
9
  ---
10
 
11
  # VMware/open-llama-0.3T-7B-open-instruct-v1.1
 
 
12
  <ul>
13
  <li>Fully Open Source, <b>Commerically viable.</b></li>
14
  <li>The instruction dataset, [VMware/open-instruct-v1.1-oasst-dolly-hhrlhf](https://huggingface.co/datasets/VMware/open-instruct-v1.1-oasst-dolly-hhrlhf) is under cc-by-sa-3.0, and the Language Model ([openlm-research/open_llama_7b_preview_300bt](https://huggingface.co/openlm-research/open_llama_7b_preview_300bt/tree/main/open_llama_7b_preview_300bt_transformers_weights)) is under apache-2.0 License.</li>
15
  </ul>
16
 
 
 
 
 
 
 
 
 
17
  ## Use in Transformers
18
 
19
  Please load the tokenizer with 'add_bos_token = True' parameter as the underlying OpenLLaMa model and this model were trained with a BOS token.
 
9
  ---
10
 
11
  # VMware/open-llama-0.3T-7B-open-instruct-v1.1
12
+
13
+ ## License
14
  <ul>
15
  <li>Fully Open Source, <b>Commerically viable.</b></li>
16
  <li>The instruction dataset, [VMware/open-instruct-v1.1-oasst-dolly-hhrlhf](https://huggingface.co/datasets/VMware/open-instruct-v1.1-oasst-dolly-hhrlhf) is under cc-by-sa-3.0, and the Language Model ([openlm-research/open_llama_7b_preview_300bt](https://huggingface.co/openlm-research/open_llama_7b_preview_300bt/tree/main/open_llama_7b_preview_300bt_transformers_weights)) is under apache-2.0 License.</li>
17
  </ul>
18
 
19
+ ## Nomenclature
20
+ <ul>
21
+ <li> Model : Open-llama
22
+ <li> Model trained on : 300B or 0.3 T tokens
23
+ <li> Model Size: 7B parameters
24
+ <li> Dataset: Open-instruct-v1.1 (oasst,dolly, hhrlhf)
25
+ </ul>
26
+
27
  ## Use in Transformers
28
 
29
  Please load the tokenizer with 'add_bos_token = True' parameter as the underlying OpenLLaMa model and this model were trained with a BOS token.