metadata
library_name: transformers
license: cc-by-nc-4.0
datasets:
- ua-l/topics-text-label
language:
- uk
model-index:
- name: w2v-bert-2.0-uk-v2.1
results:
- task:
name: text classification
type: text-classification
metrics:
- name: Accuracy
type: accuracy
value: 0.57278
- name: F1 (MACRO)
type: f1
value: 0.39054
base_model:
- Geotrend/distilbert-base-uk-cased
pipeline_tag: text-classification
TEST ACCURACY: 0.57278 ; F1 (MACRO): 0.39054
Topic | Samples | Accuracy | F1 |
---|---|---|---|
opodatkuvannia | 12 | 0.75 | 0.4286 |
viiskovie_pravo | 45 | 0.7556 | 0.123 |
bankivska_diialnist | 9 | 0.6667 | 0.2 |
sotsialnyj_zakhist | 17 | 0.2941 | 0.0455 |
doghovirni_vidnosini | 5 | 0.6 | 0.25 |
prava_spozhivachiv | 3 | 0.3333 | 0.1667 |
kriminalnie_pravo | 8 | 0.625 | 0.1923 |
avtovlasnykam | 13 | 0.6923 | 0.1636 |
piensiiata_sotsialni_viplati | 14 | 0.5714 | 0.1818 |
inshe | 53 | 0.5472 | 0.0442 |
tsivilne_pravo | 11 | 0.1818 | 0.0769 |
zhitlovi_pravovidnosini | 6 | 0.3333 | 0.125 |
prava_vnutrishno_pieriemishchienikh_osib | 10 | 0.7 | 0.2059 |
sudova_praktika | 14 | 0.7143 | 0.2083 |
nierukhomist | 9 | 0.5556 | 0.1429 |
simejne_pravo | 27 | 0.7407 | 0.1418 |
pratsevlashtuvvannya | 16 | 0.75 | 0.1714 |
ziemielnie_pravo | 7 | 1.0 | 1.0 |
intieliektualna_vlasnist | 3 | 0.6667 | 0.4 |
pidpriemnicka_dialnist | 4 | 0.25 | 0.1 |
immighratsiia_iemighratsiia | 10 | 0.5 | 0.1667 |
dovircha_vlastnist | 1 | 0.0 | 0.0 |
reyestraciya_likvidaciya_bankrutstvo | 7 | 0.5714 | 0.1818 |
administrativnie_pravo | 3 | 0.0 | 0.0 |
gospodarskie_pravo | 4 | 0.0 | 0.0 |
korporativnie_pravo | 2 | 1.0 | 1.0 |
spadkove_pravo | 7 | 0.8571 | 0.4615 |
medicina | 6 | 0.6667 | 0.2667 |
litsienzuvannia | 1 | 0.0 | 0.0 |
notarialni_pytanniia | 2 | 0.5 | 0.3333 |
gromadianski_pravovidnosini | 3 | 0.0 | 0.0 |
mytne_pravo | 1 | 0.0 | 0.0 |
dierzhavni_zakupivli | 1 | 0.0 | 0.0 |
strakhuvannya | 1 | 0.0 | 0.0 |
vighotovliennia_produktsiyi_ta_nadannia_poslugh | 1 | 0.0 | 0.0 |
mizhnarodni_pravovidnosini | 2 | 0.0 | 0.0 |
investitsii | 1 | 0.0 | 0.0 |
ekologiya | 1 | 0.0 | 0.0 |
reklama | 1 | 0.0 | 0.0 |