Enderfga commited on
Commit
d76eb38
β€’
1 Parent(s): 514a3c0

add config :)

Browse files
config/13B_params.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"dim": 5120, "multiple_of": 256, "n_heads": 40, "n_layers": 40, "norm_eps": 1e-05, "vocab_size": -1}
config/70B_params.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"dim": 8192, "multiple_of": 4096, "ffn_dim_multiplier": 1.3, "n_heads": 64, "n_kv_heads": 8, "n_layers": 80, "norm_eps": 1e-05, "vocab_size": -1}
7B_config/params.json β†’ config/7B_params.json RENAMED
File without changes
{7B_config β†’ config}/README.md RENAMED
File without changes
{7B_config β†’ config}/tokenizer.model RENAMED
File without changes