Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Spaces:
toksuite
/
quick-tokenizer-accuracy
Runtime error

App Files Files Community
Fetching metadata from the HF Docker repository...
quick-tokenizer-accuracy
66.3 kB
  • 2 contributors
History: 20 commits
Gül Sena Altıntaş
Merge branch 'main' of https://huggingface.co/spaces/toksuite/quick-tokenizer-accuracy
b1c588a about 1 month ago
  • .gitattributes
    1.52 kB
    initial commit 8 months ago
  • .gitignore
    10 Bytes
    - Save with prefix 6 months ago
  • README.md
    712 Bytes
    Merge branch 'main' of https://huggingface.co/spaces/toksuite/quick-tokenizer-accuracy about 1 month ago
  • app.py
    45.8 kB
    Updated hf paths for toksuite models about 1 month ago
  • requirements.txt
    82 Bytes
    - Removed header 7 months ago
  • serve_on_killarney.sh
    6.89 kB
    Now accepts multiline! 6 months ago
  • supertoken.py
    11.2 kB
    Fixed issue with tokenmonster and tekken tokenizers 6 months ago