fix: encode_text latency
#9
by
dmidmidmi
- opened
Switching the condition if not self.tokenizerwhich takes 20~30ms to an explicit if self.tokenizer is None: ( < 1ms)
we were rebuilding the tokenizer each time?
gmastrapas
changed pull request status to
merged