cyrusyc commited on
Commit
8c972cc
1 Parent(s): 260dfb4

move prioritzed readme under `.github/`

Browse files
Files changed (2) hide show
  1. .github/README.md +37 -0
  2. README.md +5 -0
.github/README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # mlip-arena
2
+
3
+ MLIP Arena is an open-source platform for benchmarking machine learning interatomic potentials (MLIPs). The platform provides a unified interface for users to evaluate the performance of their models on a variety of tasks, including single-point density functional theory calculations and molecular dynamics simulations. The platform is designed to be extensible, allowing users to contribute new models, benchmarks, and training data to the platform.
4
+
5
+ ## Contribute
6
+
7
+ ### Add new MLIP models
8
+
9
+ If you have pretrained MLIP models that you would like to contribute to the MLIP Arena and show benchmark in real-time, please follow these steps:
10
+
11
+ 1. Create a new [Hugging Face Model](https://huggingface.co/new) repository and upload the model file.
12
+ 2. Follow the template to code the I/O interface for your model, and upload the script along with metadata to the MLIP Arena [here]().
13
+ 3. CPU benchmarking will be performed automatically. Due to the limited amount GPU compute, if you would like to be considered for GPU benchmarking, please create a pull request to demonstrate the offline performance of your model (published paper or preprint). We will review and select the models to be benchmarked on GPU.
14
+
15
+ ### Add new benchmark tasks
16
+
17
+ 1. Create a new [Hugging Face Dataset](https://huggingface.co/new-dataset) repository and upload the reference data (e.g. DFT, AIMD, experimental measurements such as RDF).
18
+ 2. Follow the task template to implement the task class and upload the script along with metadata to the MLIP Arena [here]().
19
+ 3. Code a benchmark script to evaluate the performance of your model on the task. The script should be able to load the model and the dataset, and output the evaluation metrics.
20
+
21
+ #### Molecular dynamics calculations
22
+
23
+ - [ ] [MD17](http://www.sgdml.org/#datasets)
24
+ - [ ] [MD22](http://www.sgdml.org/#datasets)
25
+
26
+
27
+ #### Single-point density functional theory calculations
28
+
29
+ - [ ] MPTrj
30
+ - [ ] QM9
31
+ - [ ] [Alexandria](https://alexandria.icams.rub.de/)
32
+
33
+ ### Add new training datasets
34
+
35
+ [Hugging Face Auto-Train](https://huggingface.co/docs/hub/webhooks-guide-auto-retrain)
36
+
37
+
README.md CHANGED
@@ -1,3 +1,8 @@
 
 
 
 
 
1
  # mlip-arena
2
 
3
  MLIP Arena is an open-source platform for benchmarking machine learning interatomic potentials (MLIPs). The platform provides a unified interface for users to evaluate the performance of their models on a variety of tasks, including single-point density functional theory calculations and molecular dynamics simulations. The platform is designed to be extensible, allowing users to contribute new models, benchmarks, and training data to the platform.
 
1
+ ---
2
+ sdk: streamlit
3
+ sdk_version: 1.25.0 # The latest supported version
4
+ ---
5
+
6
  # mlip-arena
7
 
8
  MLIP Arena is an open-source platform for benchmarking machine learning interatomic potentials (MLIPs). The platform provides a unified interface for users to evaluate the performance of their models on a variety of tasks, including single-point density functional theory calculations and molecular dynamics simulations. The platform is designed to be extensible, allowing users to contribute new models, benchmarks, and training data to the platform.