MTSAIR
/

Cotype-Nano-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

AlanRobotics commited on 17 days ago

Commit

95481b4

•

1 Parent(s): 703cec3

Update README.md

Files changed (1) hide show

README.md +12 -9

README.md CHANGED Viewed

@@ -96,12 +96,15 @@ print(res[0]['generated_text'][1])
 ### Results on ru-llm-arena: 20.3 (local measurement)
-| **Model**                                   | **Score** | **95% CI**      | **Avg Tokens** |
-| ------------------------------------------- | --------- | --------------- | -------------- |
-| **Cotype-Nano-4bit**                  | **21.6**     | **+2.1 / -1.8**     | **587**         |
-| storm-7b                                    | 20.62     | +2.0 / -1.6     | 419.32         |
-| neural-chat-7b-v3-3                         | 19.04     | +2.0 / -1.7     | 927.21         |
-| Vikhrmodels-Vikhr-Llama-3.2-1B-instruct | 19.04 | +1.3 / -1.6 | 958.63     |
-| gigachat_lite                               | 17.2      | +1.4 / -1.4     | 276.81         |
-| Vikhrmodels-vikhr-qwen-1.5b-it              | 13.19     | +1.4 / -1.6     | 2495.38        |
-| meta-llama-Llama-3.2-1B-Instruct            | 4.04      | +0.8 / -0.6     | 1240.53        |

 ### Results on ru-llm-arena: 20.3 (local measurement)
+| Model                                      | Score  | 95% CI | Avg. #Tokens |
+|---------------------------------------------|-------|-------------------------|---------------|
+| **Cotype-Nano-4bit**                           | **21.6**  | **+2.1 / -1.8**               | **587**           |
+| storm-7b                                    | 20.62 | +1.4 / -1.6             | 419.32        |
+| neural-chat-7b-v3-3                         | 19.04 | +1.8 / -1.5             | 927.21        |
+| Vikhrmodels-Vikhr-Llama-3.2-1B-instruct     | 19.04 | +1.2 / -1.5             | 958.63        |
+| gigachat_lite                               | 17.2  | +1.5 / -1.5             | 276.81        |
+| Vikhrmodels-Vikhr-Qwen-2.5-0.5b-Instruct    | 16.5  | +1.5 / -1.7             | 583.5         |
+| Qwen-Qwen2.5-1.5B-Instruct                  | 16.46 | +1.3 / -1.3             | 483.67        |
+| Vikhrmodels-vikhr-qwen-1.5b-it              | 13.19 | +1.3 / -1.1             | 2495.38       |
+| meta-llama-Llama-3.2-1B-Instruct            | 4.04  | +0.6 / -0.8             | 1240.53       |
+| Qwen-Qwen2.5-0.5B-Instruct                  | 4.02  | +0.7 / -0.8             | 829.87        |