llm-codec / tokenizer.json
voidful's picture
Upload tokenizer
8607167 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
57b368b5d5fa28d222078ba59cea9a189d6dfdb0bb8fde811819a65207f45056
Pointer size:
133 Bytes
·
Size of remote file:
15.3 MB
·
Xet hash:
74bb701b13b86d7a3c06e81b100bdd8ff341f324b3b091daf8d4b45b01feba8d

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.