Haxirus commited on
Commit
0bd7e91
1 Parent(s): da09d24

Upload config.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. config.json +1 -0
config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"vocab_size": 50257, "emb_dim": 768, "context_length": 1024, "n_heads": 12, "n_layers": 12, "drop_rate": 0.1, "qkv_bias": true}