Upload config.json with huggingface_hub
Browse files- config.json +1 -0
config.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"vocab_size": 50257, "emb_dim": 768, "context_length": 1024, "n_heads": 12, "n_layers": 12, "drop_rate": 0.1, "qkv_bias": true}
|