Hugging Face's logo

IBBI-bio
/
ibbi_rtdetr_od

Model card Files
xet
Community

Evaluation Report for rtdetrx_bb_detect_model

Tasks: Single-class Object Detection, Feature extraction

Evaluation Notes

This model does not identify individual species but detects a single category of object.

The evaluation was performed on a single-class basis using the text prompt: 'bark_beetle'.

Mantel Correlation Explanation

The Mantel R statistic is calculated by comparing the distances between clustering centroids of different species to their phylogenetic distances. This helps determine if the model's learned feature representations correlate with the evolutionary relationships between species.

Object Classification Performance

mAP@[.5:.95]: 0.921

mAP per IoU Threshold

IoU Threshold mAP
[email protected] 0.987815
[email protected] 0.985755
[email protected] 0.983646
[email protected] 0.979705
[email protected] 0.972081
[email protected] 0.956602
[email protected] 0.919432
[email protected] 0.873082
[email protected] 0.824972
[email protected] 0.722574

Average Precision per Class (at last IoU threshold)

Class AP
bark_beetle 0.722574

Classification Metrics per IoU Threshold

IoU Threshold: iou_0.50

  • Accuracy: 0.995
  • Balanced Accuracy: 0.995
  • Macro Precision: 1.000
  • Macro Recall: 0.995
  • Macro F1 Score: 0.997
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                16395
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.994842  0.997414  16480.0
micro avg           1.0  0.994842  0.997414  16480.0
macro avg           1.0  0.994842  0.997414  16480.0
weighted avg        1.0  0.994842  0.997414  16480.0

IoU Threshold: iou_0.55

  • Accuracy: 0.993
  • Balanced Accuracy: 0.993
  • Macro Precision: 1.000
  • Macro Recall: 0.993
  • Macro F1 Score: 0.996
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                16360
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.992718  0.996346  16480.0
micro avg           1.0  0.992718  0.996346  16480.0
macro avg           1.0  0.992718  0.996346  16480.0
weighted avg        1.0  0.992718  0.996346  16480.0

IoU Threshold: iou_0.60

  • Accuracy: 0.990
  • Balanced Accuracy: 0.990
  • Macro Precision: 1.000
  • Macro Recall: 0.990
  • Macro F1 Score: 0.995
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                16323
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.990473  0.995214  16480.0
micro avg           1.0  0.990473  0.995214  16480.0
macro avg           1.0  0.990473  0.995214  16480.0
weighted avg        1.0  0.990473  0.995214  16480.0

IoU Threshold: iou_0.65

  • Accuracy: 0.986
  • Balanced Accuracy: 0.986
  • Macro Precision: 1.000
  • Macro Recall: 0.986
  • Macro F1 Score: 0.993
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                16255
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.986347  0.993127  16480.0
micro avg           1.0  0.986347  0.993127  16480.0
macro avg           1.0  0.986347  0.993127  16480.0
weighted avg        1.0  0.986347  0.993127  16480.0

IoU Threshold: iou_0.70

  • Accuracy: 0.979
  • Balanced Accuracy: 0.979
  • Macro Precision: 1.000
  • Macro Recall: 0.979
  • Macro F1 Score: 0.989
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                16136
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.979126  0.989453  16480.0
micro avg           1.0  0.979126  0.989453  16480.0
macro avg           1.0  0.979126  0.989453  16480.0
weighted avg        1.0  0.979126  0.989453  16480.0

IoU Threshold: iou_0.75

  • Accuracy: 0.965
  • Balanced Accuracy: 0.965
  • Macro Precision: 1.000
  • Macro Recall: 0.965
  • Macro F1 Score: 0.982
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                15902
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.964927  0.982151  16480.0
micro avg           1.0  0.964927  0.982151  16480.0
macro avg           1.0  0.964927  0.982151  16480.0
weighted avg        1.0  0.964927  0.982151  16480.0

IoU Threshold: iou_0.80

  • Accuracy: 0.931
  • Balanced Accuracy: 0.931
  • Macro Precision: 1.000
  • Macro Recall: 0.931
  • Macro F1 Score: 0.964
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                15338
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.930704  0.964108  16480.0
micro avg           1.0  0.930704  0.964108  16480.0
macro avg           1.0  0.930704  0.964108  16480.0
weighted avg        1.0  0.930704  0.964108  16480.0

IoU Threshold: iou_0.85

  • Accuracy: 0.888
  • Balanced Accuracy: 0.888
  • Macro Precision: 1.000
  • Macro Recall: 0.888
  • Macro F1 Score: 0.941
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                14636
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.888107  0.940738  16480.0
micro avg           1.0  0.888107  0.940738  16480.0
macro avg           1.0  0.888107  0.940738  16480.0
weighted avg        1.0  0.888107  0.940738  16480.0

IoU Threshold: iou_0.90

  • Accuracy: 0.845
  • Balanced Accuracy: 0.845
  • Macro Precision: 1.000
  • Macro Recall: 0.845
  • Macro F1 Score: 0.916
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                13919
Classification Report 
              precision  recall  f1-score  support
0                   1.0  0.8446  0.915754  16480.0
micro avg           1.0  0.8446  0.915754  16480.0
macro avg           1.0  0.8446  0.915754  16480.0
weighted avg        1.0  0.8446  0.915754  16480.0

IoU Threshold: iou_0.95

  • Accuracy: 0.758
  • Balanced Accuracy: 0.758
  • Macro Precision: 1.000
  • Macro Recall: 0.758
  • Macro F1 Score: 0.862
  • Cohen's Kappa: 0.000
  • Matthews Corrcoef: 0.000
Confusion Matrix 
Predicted Label      0
True Label            
0                12490
Classification Report 
              precision    recall  f1-score  support
0                   1.0  0.757888  0.862271  16480.0
micro avg           1.0  0.757888  0.862271  16480.0
macro avg           1.0  0.757888  0.862271  16480.0
weighted avg        1.0  0.757888  0.862271  16480.0

Embedding Quality

Internal Cluster Validation

Silhouette_Score Davies-Bouldin_Index Calinski-Harabasz_Index
0.291593 0.561635 3330.14

External Cluster Validation

ARI NMI Cluster_Purity
0.101185 0.317547 0.24571

Mantel Correlation

r p_value n_items
-0.0955094 0.527 32
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support