Update README.md
Browse files
README.md
CHANGED
@@ -50,9 +50,9 @@ This repo contains GGUF format model files for Hermes-2-Theta-Llama-3-8B-32k.
|
|
50 |
| hermes-2-theta-llama-3-8b-32k.Q8_0.gguf | Q8_0 | 8 | 8.54 GB | 7.96G, +0.0026 ppl @ Llama-3-8B |
|
51 |
|
52 |
## Parameters
|
53 |
-
|
|
54 |
-
|
|
55 |
-
|
|
56 |
|
57 |
## Benchmarks
|
58 |
![](https://i.ibb.co.com/6m0HKpk/Tangkapan-Layar-2024-09-06-pukul-12-51-10.png)
|
|
|
50 |
| hermes-2-theta-llama-3-8b-32k.Q8_0.gguf | Q8_0 | 8 | 8.54 GB | 7.96G, +0.0026 ppl @ Llama-3-8B |
|
51 |
|
52 |
## Parameters
|
53 |
+
| path | type | architecture | rope_theta | sliding_win | max_pos_embed |
|
54 |
+
| -------------------------------------- | ------- | ---------------- | ---------- | ----------- | ------------- |
|
55 |
+
| OpenPipe/Hermes-2-Theta-Llama-3-8B-32k | llama | LlamaForCausalLM | 4000000.0 | null | 32768 |
|
56 |
|
57 |
## Benchmarks
|
58 |
![](https://i.ibb.co.com/6m0HKpk/Tangkapan-Layar-2024-09-06-pukul-12-51-10.png)
|