update terratorch command
Browse files- README.md +1 -1
- app.py +3 -2
- results/.DS_Store +0 -0
README.md
CHANGED
@@ -63,7 +63,7 @@ Please see [TerraTorch-Iterate](https://github.com/IBM/terratorch-iterate) for i
|
|
63 |
### 2.2 Running benchmark experiments
|
64 |
**On existing models**: To run experiments on an existing model, a custom config file specifying the model and dataset parameters should be prepared. To compare performance of multiple models, define a config file with unique experiment name for each model being comapred. Please see the `examples` folder for sample config files. Each config file (experiment) can then be executed with the following command:
|
65 |
|
66 |
-
`
|
67 |
|
68 |
**On new models**: New models can be evaluated by first onboarding them to the [TerraTorch](https://github.com/IBM/terratorch/) library. Once onboarded, benchmarking may be conducted as outlined above.
|
69 |
|
|
|
63 |
### 2.2 Running benchmark experiments
|
64 |
**On existing models**: To run experiments on an existing model, a custom config file specifying the model and dataset parameters should be prepared. To compare performance of multiple models, define a config file with unique experiment name for each model being comapred. Please see the `examples` folder for sample config files. Each config file (experiment) can then be executed with the following command:
|
65 |
|
66 |
+
`terratorch iterate --hpo --repeat --config <config-file>`
|
67 |
|
68 |
**On new models**: New models can be evaluated by first onboarding them to the [TerraTorch](https://github.com/IBM/terratorch/) library. Once onboarded, benchmarking may be conducted as outlined above.
|
69 |
|
app.py
CHANGED
@@ -41,7 +41,8 @@ def safe_path_join(*parts):
|
|
41 |
def sanitize_column_name(col: str) -> str:
|
42 |
"""Sanitize column names for HTML display"""
|
43 |
col= str(col)
|
44 |
-
|
|
|
45 |
return html.escape(col)
|
46 |
|
47 |
|
@@ -410,7 +411,7 @@ def main():
|
|
410 |
del compiled_results
|
411 |
|
412 |
#create header
|
413 |
-
st.title("🏆
|
414 |
st.markdown("Leaderboard to evaluate Geospatial Foundation Models on downstream tasks")
|
415 |
# content = create_yall()
|
416 |
tabs = st.tabs(["🏆 Main Leaderboard", "Dimensions", "Datasets", "Info", "📝 How to Submit"])
|
|
|
41 |
def sanitize_column_name(col: str) -> str:
|
42 |
"""Sanitize column names for HTML display"""
|
43 |
col= str(col)
|
44 |
+
is_result_column = [True if item in col else False for item in ["IQM", "Mean"]]
|
45 |
+
col = col.replace("_", " ") if any(is_result_column) else col.replace("_", " ").title()
|
46 |
return html.escape(col)
|
47 |
|
48 |
|
|
|
411 |
del compiled_results
|
412 |
|
413 |
#create header
|
414 |
+
st.title("🏆 GEO-Bench Leaderboard")
|
415 |
st.markdown("Leaderboard to evaluate Geospatial Foundation Models on downstream tasks")
|
416 |
# content = create_yall()
|
417 |
tabs = st.tabs(["🏆 Main Leaderboard", "Dimensions", "Datasets", "Info", "📝 How to Submit"])
|
results/.DS_Store
CHANGED
Binary files a/results/.DS_Store and b/results/.DS_Store differ
|
|