Hugging Face's logo

neuralmagic
/
Qwen2-72B-Instruct-FP8

Text Generation
Transformers
Safetensors
qwen2
fp8
vllm
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
1
abhinavnmagic commited on
Commit
c56d386
•
1 Parent(s): 5f4af14

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -44,10 +44,10 @@ model.save_quantized(quantized_model_dir)
44
  | :------------------: | :----------------------: | :------------------------------------------------: |
45
  | arc-c<br>25-shot | 71.58 | 72.09 |
46
  | hellaswag<br>10-shot | 86.94 | 86.83 |
47
- | mmlu<br>5-shot | xx.xx | 84.06 |
48
- | truthfulqa<br>0-shot | 66.94 | 66.95 |
49
  | winogrande<br>5-shot | 82.79 | 83.18 |
50
- | gsm8k<br>5-shot | xx.xx | 88.93 |
51
- | **Average<br>Accuracy** | **xx.xx** | **80.34** |
52
- | **Recovery** | **100%** | **xx.xx%** |
53
 
 
44
  | :------------------: | :----------------------: | :------------------------------------------------: |
45
  | arc-c<br>25-shot | 71.58 | 72.09 |
46
  | hellaswag<br>10-shot | 86.94 | 86.83 |
47
+ | mmlu<br>5-shot | 83.97 | 84.06 |
48
+ | truthfulqa<br>0-shot | 66.98 | 66.95 |
49
  | winogrande<br>5-shot | 82.79 | 83.18 |
50
+ | gsm8k<br>5-shot | 87.56 | 88.93 |
51
+ | **Average<br>Accuracy** | **79.97** | **80.34** |
52
+ | **Recovery** | **100%** | **100.46%** |
53