Albert base model for Korean

70GB Korean text dataset and 42000 lower-cased subwords are used
Check the model performance and other language models for Korean in github

from transformers import BertTokenizerFast, AlbertModel

tokenizer_albert = BertTokenizerFast.from_pretrained("kykim/albert-kor-base")
model_albert = AlbertModel.from_pretrained("kykim/albert-kor-base")

Downloads last month: 2,417

Inference Providers NEW

Fill-Mask

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for kykim/albert-kor-base

Finetunes

1 model