Commit
·
4d0f905
1
Parent(s):
62c6aff
revise vocab.txt
Browse files
README.md
CHANGED
|
@@ -17,7 +17,7 @@ datasets:
|
|
| 17 |
This model is a variant of SudachiTra.
|
| 18 |
The differences between the original `chiTra v1.1` and `bert-base-sudachitra-v11` are:
|
| 19 |
- `word_form_type` was changed from `normalized_nouns` to `surface`
|
| 20 |
-
- Replacing continuous two empty lines with a
|
| 21 |
|
| 22 |
Also read the original `README.md` descriptions below.
|
| 23 |
|
|
|
|
| 17 |
This model is a variant of SudachiTra.
|
| 18 |
The differences between the original `chiTra v1.1` and `bert-base-sudachitra-v11` are:
|
| 19 |
- `word_form_type` was changed from `normalized_nouns` to `surface`
|
| 20 |
+
- Replacing continuous two empty lines with a dummy entry and an empty line in `vocab.txt`
|
| 21 |
|
| 22 |
Also read the original `README.md` descriptions below.
|
| 23 |
|
vocab.txt
CHANGED
|
@@ -10292,7 +10292,7 @@ z
|
|
| 10292 |
##朗
|
| 10293 |
##廊
|
| 10294 |
##錄
|
| 10295 |
-
|
| 10296 |
|
| 10297 |
する
|
| 10298 |
いる
|
|
|
|
| 10292 |
##朗
|
| 10293 |
##廊
|
| 10294 |
##錄
|
| 10295 |
+
!!!MISSING!!!
|
| 10296 |
|
| 10297 |
する
|
| 10298 |
いる
|