NikolaosDionelis2023
commited on
Commit
•
dd08eab
1
Parent(s):
5bb2736
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,35 @@
|
|
1 |
---
|
2 |
license: mit
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
---
|
4 |
+
|
5 |
+
# Model: PhilEO Bench
|
6 |
+
|
7 |
+
A novel evaluation framework for EO Foundation Models.
|
8 |
+
|
9 |
+
## Model Details
|
10 |
+
|
11 |
+
### Model Description
|
12 |
+
|
13 |
+
The PhilEO Bench evaluation framework comprises of a testbed that can be used to test any EO Foundation Model. The three downstream tasks are building density estimation, road segmentation, and land cover classification.
|
14 |
+
|
15 |
+
- **Developed by:** ESA, Phi-lab
|
16 |
+
- **Model type:** Evaluation Framework
|
17 |
+
- **License:** MIT
|
18 |
+
|
19 |
+
The aim of Foundation Models is to improve the performance on several diverse downstream tasks. However, these models are often evaluated on a range of datasets with different characteristics (size, resolution, locations, satellite sources, and capture dates). There is also a focus on evaluating classification downstream tasks, while omitting image-to-image downstream tasks (such as segmentation). Therefore, it is challenging to fairly compare the performance of these burgeoning EO FMs and draw meaningful conclusions. To evaluate FMs, we propose the PhilEO Bench, an evaluation framework with the aim of providing a flexible, consistent, and fair benchmark for EO Sentinel-2 FMs.
|
20 |
+
|
21 |
+
## Uses
|
22 |
+
|
23 |
+
The PhilEO Bench is used to evaluate EO Foundation Models. - We introduce a new flexible evaluation framework focused on generating comparable, fair, and reproducible results.
|
24 |
+
|
25 |
+
### Model Sources
|
26 |
+
|
27 |
+
The basic links for the model are:
|
28 |
+
|
29 |
+
- **Repository:** http://huggingface.co/ESA-philab/PhilEO-Bench
|
30 |
+
- **Paper:** https://arxiv.org/pdf/2401.04464.pdf
|
31 |
+
- **arXiv:** https://arxiv.org/abs/2401.04464
|
32 |
+
|
33 |
+
## Citation
|
34 |
+
|
35 |
+
Casper Fibaek, Luke Camilleri, Andreas Luyts, Nikolaos Dionelis, and Bertrand Le Saux, “PhilEO Bench: Evaluating Geo-Spatial Foundation Models,” arXiv:2401.04464, 2024.
|