OSainz bpHigh commited on
Commit
8f6a7cc
β€’
1 Parent(s): e190954

Add Aquila model series which have gsm8k test set contamination (#21)

Browse files

- Add Aquila model series which have gsm8k test set contamination (9cf7873ad5a119cc9111a21dd88b38c74911937f)
- Merge remote-tracking branch 'origin/main' into pr/21 (446d97b84641db8fd0ff52b17dad4f9224ab28f0)
- Add PR number + postprocessing (ecb29a1b2b34353c6a1d2fa7bf037237ecb91107)


Co-authored-by: Bhavish Pahwa <bpHigh@users.noreply.huggingface.co>

Files changed (1) hide show
  1. contamination_report.csv +2 -0
contamination_report.csv CHANGED
@@ -148,6 +148,8 @@ gigaword;;allenai/c4;;corpus;;;0.15;data-based;https://arxiv.org/abs/2310.20707;
148
  gigaword;;oscar-corpus/OSCAR-2301;;corpus;;;0.36;data-based;https://arxiv.org/abs/2310.20707;2
149
  gigaword;;togethercomputer/RedPajama-Data-V2;;corpus;;;2.82;data-based;https://arxiv.org/abs/2310.20707;2
150
 
 
 
151
  gsm8k;;GPT-4;;model;100.0;;1.0;data-based;https://arxiv.org/abs/2303.08774;11
152
  gsm8k;;GPT-4;;model;79.00;;;model-based;https://arxiv.org/abs/2311.06233;8
153
 
 
148
  gigaword;;oscar-corpus/OSCAR-2301;;corpus;;;0.36;data-based;https://arxiv.org/abs/2310.20707;2
149
  gigaword;;togethercomputer/RedPajama-Data-V2;;corpus;;;2.82;data-based;https://arxiv.org/abs/2310.20707;2
150
 
151
+ gsm8k;;BAAI/Aquila2-34B;;model;;;100.0;model-based;https://huggingface.co/BAAI/Aquila2-34B/blob/main/README.md;21
152
+ gsm8k;;BAAI/AquilaChat2-34B;;model;;;100.0;model-based;https://huggingface.co/BAAI/AquilaChat2-34B/blob/main/README.md;21
153
  gsm8k;;GPT-4;;model;100.0;;1.0;data-based;https://arxiv.org/abs/2303.08774;11
154
  gsm8k;;GPT-4;;model;79.00;;;model-based;https://arxiv.org/abs/2311.06233;8
155