File size: 1,224 Bytes
8f886bd 993e076 9a758eb 993e076 9a758eb 55ff362 9a758eb 55ff362 9a758eb 55ff362 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 |
---
license: apache-2.0
---
This is a reproduction of SumCSE. I don't know the author of the original paper.
[SumCSE](https://github.com/raghavlite/SumCSE/tree/main)
5401.reimple-robert-large
```
epoch = 3.0
eval_CR = 92.18
eval_MPQA = 90.08
eval_MR = 87.44
eval_MRPC = 77.01
eval_SST2 = 92.43
eval_SUBJ = 93.46
eval_TREC = 81.49
eval_avg_sts = 0.8624794115602034
eval_avg_transfer = 87.72714285714285
eval_sickr_spearman = 0.8479586922026686
eval_stsb_spearman = 0.8770001309177381
```
```
------ test ------
+-------+-------+-------+-------+-------+--------------+-----------------+-------+
| STS12 | STS13 | STS14 | STS15 | STS16 | STSBenchmark | SICKRelatedness | Avg. |
+-------+-------+-------+-------+-------+--------------+-----------------+-------+
| 79.55 | 87.14 | 81.30 | 87.50 | 85.13 | 85.21 | 82.10 | 83.99 |
+-------+-------+-------+-------+-------+--------------+-----------------+-------+
+------+------+------+------+------+------+------+------+
| MR | CR | SUBJ | MPQA | SST2 | TREC | MRPC | Avg. |
+------+------+------+------+------+------+------+------+
| 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
+------+------+------+------+------+------+------+------+
```
|