Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Alpha-VLLM
/
LLaMA2-Accessory
like
37
Follow
Alpha-VLLM
43
arxiv:
2305.11206
arxiv:
2303.16199
arxiv:
2304.15010
License:
other
Model card
Files
Files and versions
Community
1
481dba5
LLaMA2-Accessory
/
config
/
70B_params.json
Enderfga
add config :)
d76eb38
over 1 year ago
raw
Copy download link
history
blame
Safe
147 Bytes
{
"dim"
:
8192
,
"multiple_of"
:
4096
,
"ffn_dim_multiplier"
:
1.3
,
"n_heads"
:
64
,
"n_kv_heads"
:
8
,
"n_layers"
:
80
,
"norm_eps"
:
1e-05
,
"vocab_size"
:
-1
}