Perplexity evaluations
Vikhrmodels/Veles-2.5 subset evaluations:
| Model | Perplexity | Lower Bound | Upper Bound | Confidence |
|---|---|---|---|---|
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_S | 4.2069 | 4.1722 | 4.2416 | 0.0348 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6_K | 4.2071 | 4.1723 | 4.2419 | 0.0348 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K | 4.2103 | 4.1755 | 4.2451 | 0.0348 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_M | 4.2103 | 4.1755 | 4.2451 | 0.0348 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q8_0 | 4.2127 | 4.1778 | 4.2476 | 0.0349 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_0 | 4.2243 | 4.1893 | 4.2593 | 0.035 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_1 | 4.2284 | 4.1933 | 4.2635 | 0.0351 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_XS | 4.2335 | 4.1985 | 4.2685 | 0.035 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_NL | 4.2361 | 4.201 | 4.2712 | 0.0351 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K | 4.2418 | 4.2066 | 4.277 | 0.0352 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_M | 4.2418 | 4.2066 | 4.277 | 0.0352 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_S | 4.254 | 4.2187 | 4.2893 | 0.0353 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_0 | 4.2543 | 4.2191 | 4.2895 | 0.0352 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_1 | 4.2636 | 4.2282 | 4.299 | 0.0354 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_L | 4.2748 | 4.2393 | 4.3103 | 0.0355 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_M | 4.3016 | 4.2658 | 4.3374 | 0.0358 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K | 4.3016 | 4.2658 | 4.3374 | 0.0358 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_M | 4.3161 | 4.2801 | 4.3521 | 0.036 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_S | 4.3541 | 4.3177 | 4.3905 | 0.0364 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_S | 4.3628 | 4.3265 | 4.3991 | 0.0363 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XS | 4.3692 | 4.3328 | 4.4056 | 0.0364 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XXS | 4.3951 | 4.3588 | 4.4314 | 0.0363 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K | 4.4597 | 4.4226 | 4.4968 | 0.0371 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_M | 4.6029 | 4.5642 | 4.6416 | 0.0387 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K_S | 4.6483 | 4.6098 | 4.6868 | 0.0385 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_S | 4.7825 | 4.7421 | 4.8229 | 0.0404 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XS | 4.9246 | 4.8831 | 4.9661 | 0.0415 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XXS | 5.3178 | 5.2728 | 5.3628 | 0.045 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_M | 6.6785 | 6.6198 | 6.7372 | 0.0587 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_S | 8.3323 | 8.2575 | 8.4071 | 0.0748 |
ggml-org/wikitext-2-raw-v1 evaluations:
| Model | Perplexity | Lower Bound | Upper Bound | Confidence |
|---|---|---|---|---|
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q8_0 | 7.8895 | 7.8347 | 7.9443 | 0.0548 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q6_K | 7.8896 | 7.8349 | 7.9443 | 0.0547 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_S | 7.8957 | 7.841 | 7.9504 | 0.0547 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K | 7.9047 | 7.8499 | 7.9595 | 0.0548 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_K_M | 7.9047 | 7.8499 | 7.9595 | 0.0548 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_1 | 7.9092 | 7.8543 | 7.9641 | 0.0549 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q5_0 | 7.921 | 7.8661 | 7.976 | 0.0549 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_XS | 7.9583 | 7.9032 | 8.0135 | 0.0551 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ4_NL | 7.9635 | 7.9082 | 8.0187 | 0.0553 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K | 7.9777 | 7.9223 | 8.0331 | 0.0554 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_M | 7.9777 | 7.9223 | 8.0331 | 0.0554 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_K_S | 8.0115 | 7.9557 | 8.0673 | 0.0558 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_1 | 8.0142 | 7.9586 | 8.0698 | 0.0556 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q4_0 | 8.0419 | 7.9862 | 8.0976 | 0.0557 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_L | 8.0924 | 8.036 | 8.1487 | 0.0563 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_M | 8.146 | 8.0892 | 8.2028 | 0.0568 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_M | 8.1713 | 8.1142 | 8.2284 | 0.0571 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K | 8.1713 | 8.1142 | 8.2284 | 0.0571 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_S | 8.2287 | 8.1711 | 8.2863 | 0.0576 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XS | 8.3294 | 8.271 | 8.3878 | 0.0583 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q3_K_S | 8.3341 | 8.2759 | 8.3923 | 0.0582 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ3_XXS | 8.3716 | 8.3135 | 8.4297 | 0.0581 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K | 8.6176 | 8.5579 | 8.6773 | 0.0597 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_M | 8.7986 | 8.737 | 8.8602 | 0.0616 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-Q2_K_S | 9.1279 | 9.0646 | 9.1912 | 0.0633 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_S | 9.2979 | 9.2323 | 9.3635 | 0.0656 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XS | 9.6843 | 9.6161 | 9.7525 | 0.0682 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ2_XXS | 10.5431 | 10.4683 | 10.6179 | 0.0748 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_M | 12.964 | 12.8689 | 13.0591 | 0.0951 |
| Gemma-2-Ataraxy-Gemmasutra-9B-slerp-IQ1_S | 15.2188 | 15.1051 | 15.3325 | 0.1137 |
- Downloads last month
- 284
Model tree for AI-Art-Collab/Gemma-2-Ataraxy-Gemmasutra-9B-slerp-GGUF
Base model
recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp
Quantized
this model
Evaluation results
- Q5_K_S on Vikhrmodels/Veles-2.5self-reported4.2069 +/- 0.0348
- Q6_K on Vikhrmodels/Veles-2.5self-reported4.2071 +/- 0.0348
- Q5_K on Vikhrmodels/Veles-2.5self-reported4.2103 +/- 0.0348
- Q5_K_M on Vikhrmodels/Veles-2.5self-reported4.2103 +/- 0.0348
- Q8_0 on Vikhrmodels/Veles-2.5self-reported4.2127 +/- 0.0349
- Q5_0 on Vikhrmodels/Veles-2.5self-reported4.2243 +/- 0.0350
- Q5_1 on Vikhrmodels/Veles-2.5self-reported4.2284 +/- 0.0351
- IQ4_XS on Vikhrmodels/Veles-2.5self-reported4.2335 +/- 0.0350
- IQ4_NL on Vikhrmodels/Veles-2.5self-reported4.2361 +/- 0.0351
- Q4_K on Vikhrmodels/Veles-2.5self-reported4.2418 +/- 0.0352