Hugging Face's logo

Spaces:
yenniejun
/
tokenizers-languages
Runtime error

App Files Community
2
tokenizers-languages / app.py

Commit History

Add barchart showing shortest/longest median tokenized text
40b05d1
verified

yenniejun commited on

Update app.py
111053f
verified

yenniejun commited on

Update app.py
94a7df7
verified

yenniejun commited on

fix tabs
cb5b76e
verified

yenniejun commited on

fix tab
ba38c3f
verified

yenniejun commited on

Upload 2 files
8c475b6
verified

yenniejun commited on

Updating link to blog in app
c4e64d6

yenniejun commited on

Updating the About the Project section
96bd252

Yennie Jun commited on

Rearranging some of the figures
5943f5c

yenniejun commited on

Rename text in button for refreshing
26e280e

yenniejun commited on

Adding example texts to show
62551b2

yenniejun commited on

Update explanation message and link to amazon
8641796

yenniejun commited on

Adding explanation for project
616477f

yenniejun commited on

Remove divider
fe5c81b

yenniejun commited on

Update small formatting things:
c1ad373

yenniejun commited on

Make label visibility collapsed for some options
aaff21f

yenniejun commited on

clean up the figure, add data caching, add headers
535e678

yenniejun commited on

update code to match updated data with pre-calculated token lens
29daff8

yenniejun commited on

rename to app.py
87987fe

yenniejun commited on