NaomiS commited on
Commit
6f0ddde
·
1 Parent(s): 4a51fd0

update terratorch command 

Browse files
Files changed (3) hide show
  1. README.md +1 -1
  2. app.py +3 -2
  3. results/.DS_Store +0 -0
README.md CHANGED
@@ -63,7 +63,7 @@ Please see [TerraTorch-Iterate](https://github.com/IBM/terratorch-iterate) for i
63
  ### 2.2 Running benchmark experiments
64
  **On existing models**: To run experiments on an existing model, a custom config file specifying the model and dataset parameters should be prepared. To compare performance of multiple models, define a config file with unique experiment name for each model being comapred. Please see the `examples` folder for sample config files. Each config file (experiment) can then be executed with the following command:
65
 
66
- `terratorch_iterate --config <path_to_config_file>`
67
 
68
  **On new models**: New models can be evaluated by first onboarding them to the [TerraTorch](https://github.com/IBM/terratorch/) library. Once onboarded, benchmarking may be conducted as outlined above.
69
 
 
63
  ### 2.2 Running benchmark experiments
64
  **On existing models**: To run experiments on an existing model, a custom config file specifying the model and dataset parameters should be prepared. To compare performance of multiple models, define a config file with unique experiment name for each model being comapred. Please see the `examples` folder for sample config files. Each config file (experiment) can then be executed with the following command:
65
 
66
+ `terratorch iterate --hpo --repeat --config <config-file>`
67
 
68
  **On new models**: New models can be evaluated by first onboarding them to the [TerraTorch](https://github.com/IBM/terratorch/) library. Once onboarded, benchmarking may be conducted as outlined above.
69
 
app.py CHANGED
@@ -41,7 +41,8 @@ def safe_path_join(*parts):
41
  def sanitize_column_name(col: str) -> str:
42
  """Sanitize column names for HTML display"""
43
  col= str(col)
44
- col = col.replace("_", " ").title()
 
45
  return html.escape(col)
46
 
47
 
@@ -410,7 +411,7 @@ def main():
410
  del compiled_results
411
 
412
  #create header
413
- st.title("🏆 GeoBench Leaderboard")
414
  st.markdown("Leaderboard to evaluate Geospatial Foundation Models on downstream tasks")
415
  # content = create_yall()
416
  tabs = st.tabs(["🏆 Main Leaderboard", "Dimensions", "Datasets", "Info", "📝 How to Submit"])
 
41
  def sanitize_column_name(col: str) -> str:
42
  """Sanitize column names for HTML display"""
43
  col= str(col)
44
+ is_result_column = [True if item in col else False for item in ["IQM", "Mean"]]
45
+ col = col.replace("_", " ") if any(is_result_column) else col.replace("_", " ").title()
46
  return html.escape(col)
47
 
48
 
 
411
  del compiled_results
412
 
413
  #create header
414
+ st.title("🏆 GEO-Bench Leaderboard")
415
  st.markdown("Leaderboard to evaluate Geospatial Foundation Models on downstream tasks")
416
  # content = create_yall()
417
  tabs = st.tabs(["🏆 Main Leaderboard", "Dimensions", "Datasets", "Info", "📝 How to Submit"])
results/.DS_Store CHANGED
Binary files a/results/.DS_Store and b/results/.DS_Store differ