add config :)
Browse files
config/13B_params.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"dim": 5120, "multiple_of": 256, "n_heads": 40, "n_layers": 40, "norm_eps": 1e-05, "vocab_size": -1}
|
config/70B_params.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"dim": 8192, "multiple_of": 4096, "ffn_dim_multiplier": 1.3, "n_heads": 64, "n_kv_heads": 8, "n_layers": 80, "norm_eps": 1e-05, "vocab_size": -1}
|
7B_config/params.json β config/7B_params.json
RENAMED
File without changes
|
{7B_config β config}/README.md
RENAMED
File without changes
|
{7B_config β config}/tokenizer.model
RENAMED
File without changes
|