File size: 2,444 Bytes
843d7c8 3132a63 843d7c8 b34d507 843d7c8 74d2c04 a4b49bb 74d2c04 3132a63 4f8693a f749068 4f8693a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 |
---
license: cdla-permissive-2.0
tags:
- Pytorch
- Weather & Climate
- Time Series
- Foundation Model
- NASA
- IBM
- MERRA2
---
Prithvi WxC is a 2.3 billion parameter model trained on 160 different variables from MERRA-2 data. It has been pretrained on both forecasting and masked
reconstruction objectives. I.e.~the model is capable of reconstructing atmospheric state from partial information as well as propagating state into the
future. The model takes data from two timestamps as input and generates a single, possibly future, timestamp as output. Currently Prithvi WxC comes in two flavors:
- (This model) `prithvi.wxc.2300m.v1` has been pretrained with a 50% masking ratio. The time delta between input timestamps is variable as is the forecast lead time.
During pretraining, the input delta was chosen from [-3, -6, -9, -12] hours while the forecast lead time was chosen from [0, 6, 12, 24] hours. We recommend using
`prithvi.wxc.2300m.v1` for generic use cases that do not focus on forecasting.
<b> Zero-shot reconstruction </b>
<div style="display: flex; justify-content: center;">
<img src="https://cdn-uploads.huggingface.co/production/uploads/6488f1d3e22a0081a561ec8f/ftaxww2youmdS8XER31RC.png" alt="Reconstruction" width="1024"/>
</div>
Current downstream tasks of PrithviWxC are (please feel free to submit a PR if you want to add yours):
[Downscaling](https://huggingface.co/ibm-granite/granite-geospatial-wxc-downscaling)
[Gravity Wave](https://github.com/NASA-IMPACT/gravity-wave-finetuning)
## Citation
If you use this work, consider citing our paper
```
@misc{schmude2024prithviwxcfoundationmodel,
title={Prithvi WxC: Foundation Model for Weather and Climate},
author={Johannes Schmude and Sujit Roy and Will Trojak and Johannes Jakubik and Daniel Salles Civitarese and Shraddha Singh and Julian Kuehnert and Kumar Ankur and Aman Gupta and Christopher E Phillips and Romeo Kienzler and Daniela Szwarcman and Vishal Gaur and Rajat Shinde and Rohit Lal and Arlindo Da Silva and Jorge Luis Guevara Diaz and Anne Jones and Simon Pfreundschuh and Amy Lin and Aditi Sheshadri and Udaysankar Nair and Valentine Anantharaj and Hendrik Hamann and Campbell Watson and Manil Maskey and Tsengdar J Lee and Juan Bernabe Moreno and Rahul Ramachandran},
year={2024},
eprint={2409.13598},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2409.13598},
}
``` |