Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Alpha-VLLM
/
LLaMA2-Accessory
like
37
Follow
Alpha-VLLM
43
arxiv:
2305.11206
arxiv:
2303.16199
arxiv:
2304.15010
License:
other
Model card
Files
Files and versions
Community
1
481dba5
LLaMA2-Accessory
/
config
/
code_34B_params.json
Enderfga
Upload 4 files
1500a73
about 1 year ago
raw
Copy download link
history
blame
Safe
184 Bytes
{
"dim"
:
8192
,
"n_layers"
:
48
,
"n_heads"
:
64
,
"n_kv_heads"
:
8
,
"multiple_of"
:
256
,
"ffn_dim_multiplier"
:
1.0
,
"norm_eps"
:
1e-5
,
"rope_theta"
:
1000000
}