eduardo-alvarez
commited on
Commit
•
c96e151
1
Parent(s):
0090c02
updating leaderboard stats and removal of gsm8k
Browse files
status/leaderboard_status_041624.csv
ADDED
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Model,Average,Hardware,Model Type,Precision,Size,Infrastructure,ARC,HellaSwag,MMLU,TruthfulQA,Winogrande,Affiliation
|
2 |
+
Intel/neural-chat-7b-v3-3,71.574,Gaudi,fine-tuned,fp16,7,Intel Developer Cloud,66.89,85.26,63.07,63.01,79.64,Intel Engineering
|
3 |
+
Intel/neural-chat-7b-v3-2,70.858,Gaudi,fine-tuned,fp16,7,Intel Developer Cloud,67.49,83.92,63.55,59.68,79.65,Intel Engineering
|
4 |
+
Intel/neural-chat-7b-v3-1,70.002,Gaudi,fine-tuned,fp16,7,Intel Developer Cloud,66.21,83.64,62.37,59.65,78.14,Intel Engineering
|
5 |
+
Intel/neural-chat-7b-v3,69.906,Gaudi,fine-tuned,fp16,7,Intel Developer Cloud,67.15,83.29,62.26,58.77,78.06,Intel Engineering
|
6 |
+
Intel/neural-chat-7b-v3-1,69.89,Gaudi,fine-tuned,int8,7,Intel Developer Cloud,65.7,83.54,62.12,59.48,78.61,Intel Engineering
|
7 |
+
Intel/neural-chat-7b-v3-1,69.972,Gaudi,fine-tuned,bf16,7,Intel Developer Cloud,66.3,83.6,62.44,59.54,77.98,Intel Engineering
|
8 |
+
Intel/neural-chat-7b-v3-1,68.256,Gaudi,fine-tuned,int4,7,Intel Developer Cloud,64.25,82.49,60.79,56.4,77.35,Intel Engineering
|
9 |
+
FunDialogues/dollygem-2b-LoRA,49.368,GPU Max,fine-tuned,bf16,2,Intel Developer Cloud,41.55,71.56,35.39,32.59,65.75,No Affiliation
|
10 |
+
ThejasElandassery/dallema,49.134,GPU Max,fine-tuned,bf16,2,Intel Developer Cloud,41.64,72.01,33.67,33.08,65.27,Student Ambassador
|
11 |
+
utkarshsingh99/confused-gemma,49.306,GPU Max,fine-tuned,bf16,2,Intel Developer Cloud,42.06,71.86,34.14,33.2,65.27,Student Ambassador
|
12 |
+
myasaswin/Gemma2B-LORAfied,49.566,GPU Max,fine-tuned,bf16,2,Intel Developer Cloud,42.56,71.56,35.47,32.57,65.67,Student Ambassador
|
13 |
+
Aprajita0/Gemma-2b-Lora,49.526,GPU Max,fine-tuned,bf16,2,Intel Developer Cloud,42.24,71.88,34.14,33.23,66.14,Student Ambassador
|
14 |
+
gopalakrishnan-d/gemma-2b-dolly-ds-lora,49.378,GPU Max,fine-tuned,bf16,2,Intel Developer Cloud,42.24,71.88,34.11,33.15,65.51,Student Ambassador
|
15 |
+
SSK0908/gemma-2b-dolly-qa,49.452,GPU Max,fine-tuned,bf16,2,Intel Developer Cloud,42.15,71.92,33.98,33.15,66.06,Student Ambassador
|