Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Spaces:
vpkprasanna
/
TokenizerViz
Running

App Files Files Community
1
Fetching metadata from the HF Docker repository...
TokenizerViz
Ctrl+K
Ctrl+K
  • 4 contributors
History: 9 commits
prasanna kumar
added gemma model support
43be51d 8 months ago
  • models
    added gemma model support 8 months ago
  • .gitattributes
    1.22 kB
    added GIT LFS support 8 months ago
  • .gitignore
    3.24 kB
    Final commit for llama based model 8 months ago
  • README.md
    252 Bytes
    initial commit 9 months ago
  • app.py
    1.76 kB
    added gemma model support 8 months ago
  • requirements.txt
    1.04 kB
    added llama3 models for tokenize and show as well as pass token ids will give back text 9 months ago