h2oai
/

h2ogpt-gm-oasst1-en-1024-12b

Text Generation

large language model

text-generation-inference

Model card Files Files and versions Community

psinger commited on May 2, 2023

Commit

a280f0e

•

1 Parent(s): d141038

Update README.md

Files changed (1) hide show

README.md +8 -8

README.md CHANGED Viewed

@@ -166,18 +166,18 @@ CUDA_VISIBLE_DEVICES=0 python main.py --model hf-causal-experimental --model_arg
 |    Task     |Version| Metric |Value |   |Stderr|
 |-------------|------:|--------|-----:|---|-----:|
-|openbookqa   |      0|acc     |0.3080|±  |0.0207|
-|             |       |acc_norm|0.3980|±  |0.0219|
-|boolq        |      1|acc     |0.5098|±  |0.0087|
-|winogrande   |      0|acc     |0.6622|±  |0.0133|
 |arc_easy     |      0|acc     |0.6435|±  |0.0098|
 |             |       |acc_norm|0.5800|±  |0.0101|
-|piqa         |      0|acc     |0.7704|±  |0.0098|
-|             |       |acc_norm|0.7704|±  |0.0098|
 |hellaswag    |      0|acc     |0.5150|±  |0.0050|
 |             |       |acc_norm|0.6951|±  |0.0046|
-|arc_challenge|      0|acc     |0.3345|±  |0.0138|
-|             |       |acc_norm|0.3754|±  |0.0142|
 ## Disclaimer

 |    Task     |Version| Metric |Value |   |Stderr|
 |-------------|------:|--------|-----:|---|-----:|
+|arc_challenge|      0|acc     |0.3345|±  |0.0138|
+|             |       |acc_norm|0.3754|±  |0.0142|
 |arc_easy     |      0|acc     |0.6435|±  |0.0098|
 |             |       |acc_norm|0.5800|±  |0.0101|
+|boolq        |      1|acc     |0.5098|±  |0.0087|
 |hellaswag    |      0|acc     |0.5150|±  |0.0050|
 |             |       |acc_norm|0.6951|±  |0.0046|
+|openbookqa   |      0|acc     |0.3080|±  |0.0207|
+|             |       |acc_norm|0.3980|±  |0.0219|
+|piqa         |      0|acc     |0.7704|±  |0.0098|
+|             |       |acc_norm|0.7704|±  |0.0098|
+|winogrande   |      0|acc     |0.6622|±  |0.0133|
 ## Disclaimer