Add SetFit ABSA model

README.md

@@ -6,15 +6,15 @@ tags:
 - text-classification
 - generated_from_setfit_trainer
 widget:
-- text: bench:Get your food to go, find a bench, and kick back with a plate of dumplings.
+- text: Filet Mignon:Please try the Filet Mignon, its just the most tender piece ever.
 - text: comparison:Frankly, when you compare what you can have here for lunch, versus
     McDs or so many other sandwich shops in the city, there is no comparison.
 - text: ton:We had crawfish boiled and despite making a mess, it was a ton of fun
     and quite tasty as well.
-- text: traffic noise:It is set far from the small street it's on, and there is no
-    traffic noise.
-- text: food:The only thing more wonderful than the food (which is exceptional) is
-    the service.
+- text: street:It is set far from the small street it's on, and there is no traffic
+    noise.
+- text: service:The only thing more wonderful than the food (which is exceptional)
+    is the service.
 metrics:
 - accuracy
 - f1_micro
@@ -40,28 +40,28 @@ model-index:
       split: test
     metrics:
     - type: accuracy
-      value: 0.8612873980054397
+      value: 0.85
       name: Accuracy
     - type: f1_micro
-      value: 0.8612873980054397
+      value: 0.85
       name: F1_Micro
     - type: f1_macro
-      value: 0.8539516827486352
+      value: 0.8429732868757259
       name: F1_Macro
     - type: f1_weighted
-      value: 0.8604149464336351
+      value: 0.8499330789226259
       name: F1_Weighted
     - type: precision_micro
-      value: 0.8612873980054397
+      value: 0.85
       name: Precision_Micro
     - type: precision_macro
-      value: 0.8591116944822033
+      value: 0.8432831750154752
       name: Precision_Macro
     - type: recall_micro
-      value: 0.8612873980054397
+      value: 0.85
       name: Recall_Micro
     - type: recall_macro
-      value: 0.8501826112588928
+      value: 0.84267110841914
       name: Recall_Macro
 ---
 
@@ -86,7 +86,7 @@ This model was trained within the context of a larger system for ABSA, which loo
 - **Model Type:** SetFit
 - **Sentence Transformer body:** [sentence-transformers/all-MiniLM-L6-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2)
 - **Classification head:** a [LogisticRegression](https://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html) instance
-- **spaCy Model:** en_core_web_lg
+- **spaCy Model:** en_core_web_trf
 - **SetFitABSA Aspect Model:** [ronalhung/setfit-absa-restaurants-aspect](https://huggingface.co/ronalhung/setfit-absa-restaurants-aspect)
 - **SetFitABSA Polarity Model:** [ronalhung/setfit-absa-restaurants-polarity](https://huggingface.co/ronalhung/setfit-absa-restaurants-polarity)
 - **Maximum Sequence Length:** 256 tokens
@@ -112,7 +112,7 @@ This model was trained within the context of a larger system for ABSA, which loo
 ### Metrics
 | Label   | Accuracy | F1_Micro | F1_Macro | F1_Weighted | Precision_Micro | Precision_Macro | Recall_Micro | Recall_Macro |
 |:--------|:---------|:---------|:---------|:------------|:----------------|:----------------|:-------------|:-------------|
-| **all** | 0.8613   | 0.8613   | 0.8540   | 0.8604      | 0.8613          | 0.8591          | 0.8613       | 0.8502       |
+| **all** | 0.85     | 0.85     | 0.8430   | 0.8499      | 0.85            | 0.8433          | 0.85         | 0.8427       |
 
 ## Uses
 
@@ -167,15 +167,15 @@ preds = model("The food was great, but the venue is just way too busy.")
 ### Training Set Metrics
 | Training set | Min | Median  | Max |
 |:-------------|:----|:--------|:----|
-| Word count   | 4   | 19.4181 | 45  |
+| Word count   | 4   | 19.4282 | 45  |
 
 | Label     | Training Sample Count |
 |:----------|:----------------------|
-| no aspect | 167                   |
+| no aspect | 164                   |
 | aspect    | 254                   |
 
 ### Training Hyperparameters
-- batch_size: (128, 128)
+- batch_size: (64, 64)
 - num_epochs: (5, 5)
 - max_steps: -1
 - sampling_strategy: oversampling
@@ -195,19 +195,19 @@ preds = model("The food was great, but the venue is just way too busy.")
 ### Training Results
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
-| 0.0014 | 1    | 0.3269        | -               |
-| 0.0689 | 50   | 0.3079        | 0.2812          |
-| 0.1377 | 100  | 0.2566        | 0.2496          |
-| 0.2066 | 150  | 0.2388        | 0.2281          |
-| 0.2755 | 200  | 0.1867        | 0.1864          |
-| 0.3444 | 250  | 0.0713        | 0.1830          |
-| 0.4132 | 300  | 0.0132        | 0.1900          |
-| 0.4821 | 350  | 0.0038        | 0.1806          |
-| 0.5510 | 400  | 0.002         | 0.1896          |
-| 0.6198 | 450  | 0.0016        | 0.1843          |
-| 0.6887 | 500  | 0.0008        | 0.1892          |
-| 0.7576 | 550  | 0.0009        | 0.2014          |
-| 0.8264 | 600  | 0.0009        | 0.1840          |
+| 0.0007 | 1    | 0.3248        | -               |
+| 0.0348 | 50   | 0.321         | 0.3073          |
+| 0.0697 | 100  | 0.2806        | 0.2588          |
+| 0.1045 | 150  | 0.2523        | 0.2490          |
+| 0.1394 | 200  | 0.2406        | 0.2377          |
+| 0.1742 | 250  | 0.2215        | 0.2164          |
+| 0.2091 | 300  | 0.1754        | 0.1884          |
+| 0.2439 | 350  | 0.0979        | 0.1852          |
+| 0.2787 | 400  | 0.042         | 0.1994          |
+| 0.3136 | 450  | 0.0155        | 0.1929          |
+| 0.3484 | 500  | 0.006         | 0.1928          |
+| 0.3833 | 550  | 0.0029        | 0.1978          |
+| 0.4181 | 600  | 0.0025        | 0.1918          |
 
 ### Framework Versions
 - Python: 3.11.13

config_setfit.json

@@ -1,9 +1,9 @@
 {
+  "spacy_model": "en_core_web_trf",
+  "span_context": 0,
   "normalize_embeddings": false,
   "labels": [
     "no aspect",
     "aspect"
-  ],
-  "spacy_model": "en_core_web_lg",
-  "span_context": 0
+  ]
 }

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:999a6a1b887de74026a1047226ed8e46321a2cd72916bc970d4dd2e8f2c0f4d9
+oid sha256:7982fccd2bed366bcfa239c170d3bb119bc78bb6e7db0d79529f74d83251a4e0
 size 90864192

model_head.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:97987c95cf8356d221a0fe58df01834382c95baba9c5eb7139b55baa0145b465
+oid sha256:b206f4cd840216880af7cab55a698c06e209513567eec53c6c1b1681730cff7d
 size 3919