Did you try ModernBERT?
I would resort to a language model only if ModernBERT won't work, ModernBERT is 10x faster and smaller than tinyllama.
· Sign up or log in to comment