Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

2ira
/
Byte-lingua-code

Model card Files Files and versions
xet
Community
Byte-lingua-code / superbpe
4.94 MB
  • 1 contributor
History: 1 commit
2ira's picture
2ira
offline_compression_graph_code
72c0672 verified 5 days ago
  • scripts
    offline_compression_graph_code 5 days ago
  • tokenizers_superbpe
    offline_compression_graph_code 5 days ago
  • README.md
    1.31 kB
    offline_compression_graph_code 5 days ago
  • requirements.txt
    203 Bytes
    offline_compression_graph_code 5 days ago
  • run.sh
    4.04 kB
    offline_compression_graph_code 5 days ago
  • run_all.sh
    1.29 kB
    offline_compression_graph_code 5 days ago
  • run_huffman.sh
    3.33 kB
    offline_compression_graph_code 5 days ago
  • train_tokenizer.py
    2.7 kB
    offline_compression_graph_code 5 days ago
  • utils.py
    2.25 kB
    offline_compression_graph_code 5 days ago