Antoine Chaffin
commited on
Commit
·
6605e43
1
Parent(s):
c1647d1
Fix FiQa results
Browse files
README.md
CHANGED
@@ -970,7 +970,7 @@ For this reason, we also report the results of ColBERT-small in the same setup w
|
|
970 |
|
971 |
| Model | Average | FiQA2018 | NFCorpus | TREC-COVID | Touche2020 | ArguAna | QuoraRetrieval | SCIDOCS | SciFact | NQ | ClimateFEVER | HotpotQA | DBPedia | CQADupstack | FEVER | MSMARCO |
|
972 |
|--------------------------|-------------|----------|----------|------------|------------|---------|----------------|---------|---------|-------|--------------|----------|---------|-------------|-------|---------|
|
973 |
-
| GTE-ModernColBERT | **54.
|
974 |
| ColBERT-small (reported) | 53.79 | 41.15 | 37.3 | **84.59** | 25.69 | **50.09** | 87.72 | 18.42 | 74.77 | 59.1 | **33.07** | 76.11 | 45.58 | 38.75 | **90.96** | 43.5 |
|
975 |
| JinaColBERT-v2 | | 40.8 | 34.6 | 83.4 | 27.4 | 36.6 | **88.7** | 18.6 | 67.8 | **64** | 23.9 | 76.6 | 47.1 | | 80.5 | |
|
976 |
| ColBERT-small (rerunned) | 53.35 | 41.01 | 36.86 | 83.14 | 24.95 | 46.76 | 87.89 | 18.72 | 74.02 | 59.42 | 32.83 | 76.88 | 46.36 | 39.36 | 88.66 | 43.44 |
|
|
|
970 |
|
971 |
| Model | Average | FiQA2018 | NFCorpus | TREC-COVID | Touche2020 | ArguAna | QuoraRetrieval | SCIDOCS | SciFact | NQ | ClimateFEVER | HotpotQA | DBPedia | CQADupstack | FEVER | MSMARCO |
|
972 |
|--------------------------|-------------|----------|----------|------------|------------|---------|----------------|---------|---------|-------|--------------|----------|---------|-------------|-------|---------|
|
973 |
+
| GTE-ModernColBERT | **54.67** | **45.28** | 37.93 | 83.59 | **31.23** | 48.51 | 86.61 | **19.06** | **76.34** | 61.8 | 30.62 | **77.32** | **48.03** | **41** | 87.44 | **45.32** |
|
974 |
| ColBERT-small (reported) | 53.79 | 41.15 | 37.3 | **84.59** | 25.69 | **50.09** | 87.72 | 18.42 | 74.77 | 59.1 | **33.07** | 76.11 | 45.58 | 38.75 | **90.96** | 43.5 |
|
975 |
| JinaColBERT-v2 | | 40.8 | 34.6 | 83.4 | 27.4 | 36.6 | **88.7** | 18.6 | 67.8 | **64** | 23.9 | 76.6 | 47.1 | | 80.5 | |
|
976 |
| ColBERT-small (rerunned) | 53.35 | 41.01 | 36.86 | 83.14 | 24.95 | 46.76 | 87.89 | 18.72 | 74.02 | 59.42 | 32.83 | 76.88 | 46.36 | 39.36 | 88.66 | 43.44 |
|