Spaces:
Running
Running
Jae-Won Chung
commited on
Commit
•
1f4ddf2
1
Parent(s):
a904b94
Add citation information (#32)
Browse files- README.md +22 -0
- app.py +16 -0
- docs/citation.bib +12 -0
README.md
CHANGED
@@ -60,3 +60,25 @@ You can still run benchmarks without Pegasus like this:
|
|
60 |
$ docker exec leaderboard0 python scripts/benchmark.py --model-path /data/leaderboard/weights/lmsys/vicuna-13B --input-file sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled_sorted.json
|
61 |
$ docker exec leaderboard0 python scripts/benchmark.py --model-path databricks/dolly-v2-12b --input-file sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled_sorted.json
|
62 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
60 |
$ docker exec leaderboard0 python scripts/benchmark.py --model-path /data/leaderboard/weights/lmsys/vicuna-13B --input-file sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled_sorted.json
|
61 |
$ docker exec leaderboard0 python scripts/benchmark.py --model-path databricks/dolly-v2-12b --input-file sharegpt/sg_90k_part1_html_cleaned_lang_first_sampled_sorted.json
|
62 |
```
|
63 |
+
|
64 |
+
## Citation
|
65 |
+
|
66 |
+
For the ML.ENERGY Leaderboard:
|
67 |
+
```bibtex
|
68 |
+
@misc{ml-energy-leaderboard,
|
69 |
+
author={Jae-Won Chung and Jiachen Liu and Zhiyu Wu and Yuxuan Xia and Mosharaf Chowdhury},
|
70 |
+
title={{ML.ENERGY} Leaderboard},
|
71 |
+
year={2023},
|
72 |
+
howpublished={\url{https://ml.energy/leaderboard}},
|
73 |
+
}
|
74 |
+
```
|
75 |
+
|
76 |
+
For the [Zeus](https://ml.energy/zeus) framework used for benchmarking:
|
77 |
+
```bibtex
|
78 |
+
@inproceedings{zeus:nsdi23,
|
79 |
+
author={Jie You and Jae-Won Chung and Mosharaf Chowdhury},
|
80 |
+
booktitle={USENIX NSDI},
|
81 |
+
title={Zeus: Understanding and Optimizing {GPU} Energy Consumption of {DNN} Training},
|
82 |
+
year={2023},
|
83 |
+
}
|
84 |
+
```
|
app.py
CHANGED
@@ -357,6 +357,11 @@ table th:first-child {
|
|
357 |
pointer-events: none;
|
358 |
opacity: 0.4;
|
359 |
}
|
|
|
|
|
|
|
|
|
|
|
360 |
"""
|
361 |
|
362 |
intro_text = """
|
@@ -790,6 +795,17 @@ with gr.Blocks(css=custom_css) as block:
|
|
790 |
# Read in LEADERBOARD.md
|
791 |
gr.Markdown(open("docs/leaderboard.md").read())
|
792 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
793 |
# Load the table on page load.
|
794 |
block.load(on_load, outputs=[dataframe, model_preference_dropdown], queue=False)
|
795 |
|
|
|
357 |
pointer-events: none;
|
358 |
opacity: 0.4;
|
359 |
}
|
360 |
+
|
361 |
+
/* Make the Citation header larger */
|
362 |
+
#citation-header > div > span {
|
363 |
+
font-size: 16px !important;
|
364 |
+
}
|
365 |
"""
|
366 |
|
367 |
intro_text = """
|
|
|
795 |
# Read in LEADERBOARD.md
|
796 |
gr.Markdown(open("docs/leaderboard.md").read())
|
797 |
|
798 |
+
# Citation
|
799 |
+
with gr.Accordion("📚 Citation", open=False, elem_id="citation-header"):
|
800 |
+
citation_text = open("docs/citation.bib").read()
|
801 |
+
gr.Textbox(
|
802 |
+
value=citation_text,
|
803 |
+
label="BibTeX for the leaderboard and the Zeus framework used for benchmarking:",
|
804 |
+
lines=len(list(filter(lambda c: c == "\n", citation_text))),
|
805 |
+
interactive=False,
|
806 |
+
show_copy_button=True,
|
807 |
+
)
|
808 |
+
|
809 |
# Load the table on page load.
|
810 |
block.load(on_load, outputs=[dataframe, model_preference_dropdown], queue=False)
|
811 |
|
docs/citation.bib
ADDED
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
@misc{ml-energy-leaderboard,
|
2 |
+
author={Jae-Won Chung and Jiachen Liu and Zhiyu Wu and Yuxuan Xia and Mosharaf Chowdhury},
|
3 |
+
title={{ML.ENERGY} Leaderboard},
|
4 |
+
year={2023},
|
5 |
+
howpublished={\url{https://ml.energy/leaderboard}},
|
6 |
+
}
|
7 |
+
@inproceedings{zeus:nsdi23,
|
8 |
+
author={Jie You and Jae-Won Chung and Mosharaf Chowdhury},
|
9 |
+
booktitle={USENIX NSDI},
|
10 |
+
title={Zeus: Understanding and Optimizing {GPU} Energy Consumption of {DNN} Training},
|
11 |
+
year={2023},
|
12 |
+
}
|