Add stuff later!
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.
Evaluation results
- accuracy on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported75.585
- ap on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported24.720
- ap_weighted on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported24.720
- f1 on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported63.002
- f1_weighted on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported80.038
- main_score on MTEB AmazonCounterfactualClassification (en-ext)test set self-reported75.585
- accuracy on MTEB AmazonCounterfactualClassification (en)test set self-reported74.343
- ap on MTEB AmazonCounterfactualClassification (en)test set self-reported37.509
- ap_weighted on MTEB AmazonCounterfactualClassification (en)test set self-reported37.509
- f1 on MTEB AmazonCounterfactualClassification (en)test set self-reported68.475