Instructions to use wetsoledrysoul/intermediate_checkpoints with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use wetsoledrysoul/intermediate_checkpoints with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="wetsoledrysoul/intermediate_checkpoints") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("wetsoledrysoul/intermediate_checkpoints") model = AutoModelForCausalLM.from_pretrained("wetsoledrysoul/intermediate_checkpoints", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use wetsoledrysoul/intermediate_checkpoints with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "wetsoledrysoul/intermediate_checkpoints" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wetsoledrysoul/intermediate_checkpoints", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/wetsoledrysoul/intermediate_checkpoints
- SGLang
How to use wetsoledrysoul/intermediate_checkpoints with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "wetsoledrysoul/intermediate_checkpoints" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wetsoledrysoul/intermediate_checkpoints", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "wetsoledrysoul/intermediate_checkpoints" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "wetsoledrysoul/intermediate_checkpoints", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use wetsoledrysoul/intermediate_checkpoints with Docker Model Runner:
docker model run hf.co/wetsoledrysoul/intermediate_checkpoints
End of training (part 4)
Browse files- completions/completions_00749.parquet +3 -0
- completions/completions_00750.parquet +3 -0
- completions/completions_00751.parquet +3 -0
- completions/completions_00752.parquet +3 -0
- completions/completions_00753.parquet +3 -0
- completions/completions_00754.parquet +3 -0
- completions/completions_00755.parquet +3 -0
- completions/completions_00756.parquet +3 -0
- completions/completions_00757.parquet +3 -0
- completions/completions_00758.parquet +3 -0
- completions/completions_00759.parquet +3 -0
- completions/completions_00760.parquet +3 -0
- completions/completions_00761.parquet +3 -0
- completions/completions_00762.parquet +3 -0
- completions/completions_00763.parquet +3 -0
- completions/completions_00764.parquet +3 -0
- completions/completions_00765.parquet +3 -0
- completions/completions_00766.parquet +3 -0
- completions/completions_00767.parquet +3 -0
- completions/completions_00768.parquet +3 -0
- completions/completions_00769.parquet +3 -0
- completions/completions_00770.parquet +3 -0
- completions/completions_00771.parquet +3 -0
- completions/completions_00772.parquet +3 -0
- completions/completions_00773.parquet +3 -0
- completions/completions_00774.parquet +3 -0
- completions/completions_00775.parquet +3 -0
- completions/completions_00776.parquet +3 -0
- completions/completions_00777.parquet +3 -0
- completions/completions_00778.parquet +3 -0
- completions/completions_00779.parquet +3 -0
- completions/completions_00780.parquet +3 -0
- completions/completions_00781.parquet +3 -0
- config.json +1 -1
- generation_config.json +1 -0
- model.safetensors +1 -1
- tokenizer_config.json +1 -1
- training_args.bin +2 -2
completions/completions_00749.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:003f7d9d2ba26d4968aabd3321f322bef3451dbb9bad93aa424c737839ceb3fd
|
| 3 |
+
size 770660
|
completions/completions_00750.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4120ddcee305a421dcf909cafd4ff6283f37da4a970b3b57813eb4abe990ec57
|
| 3 |
+
size 790264
|
completions/completions_00751.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:100cf78d9e58520f9555af3ee8332c7f254334a36dfe7d18ecd341f67aee319d
|
| 3 |
+
size 759125
|
completions/completions_00752.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc79cb1cce947f8107244564f6e640eea0514c11d51b7b1f67d58e3988ad1ba9
|
| 3 |
+
size 755056
|
completions/completions_00753.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cd88f7d66f61eded2a1193386e76d2768faa6da21c9a6ccbc5e29e25ddfb2272
|
| 3 |
+
size 785793
|
completions/completions_00754.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4459d95bcb3b069d5c8728eea17ac410d6fd2e3c246a16f33dda96fec3654ed0
|
| 3 |
+
size 736730
|
completions/completions_00755.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:be41af8f4f8278194139cef7250210e1f9c7a7575f4581c93a00fafc1f8ba553
|
| 3 |
+
size 762486
|
completions/completions_00756.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:460136e3781ddbfbf4fb0643eed103e0373046b4de94fc3a6b0f1ec84e2cdee3
|
| 3 |
+
size 744649
|
completions/completions_00757.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:317591e647839f69181415bc02fc75f7511980bbfca2a7d793b36ab3ba0e5e3d
|
| 3 |
+
size 724528
|
completions/completions_00758.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:93c36adfb2d156b8ecae56a0568dd9be5a77ad13f83866fa56356132686f4e3c
|
| 3 |
+
size 773571
|
completions/completions_00759.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:765b292cb136027078944d29c85a05725519a9d8f741aadd84d02c875db0afc1
|
| 3 |
+
size 762619
|
completions/completions_00760.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7a49028671a68fe56527c60014d6174c9c2a9ff9593fd616c656ceae8766bdf0
|
| 3 |
+
size 789102
|
completions/completions_00761.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:53ecb4e1034511d1b4c010245fd9dac24f02a881c83d5706d2fb49734bfd11e4
|
| 3 |
+
size 733899
|
completions/completions_00762.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e99fed735f4fee1adf2467cee21b46e8c042c4f37c2fd6f70968824641e71fab
|
| 3 |
+
size 732090
|
completions/completions_00763.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b0f36400db703c5793bd6c21143a25b1ea84c18de1ddfeebe2d35e756e92bc9c
|
| 3 |
+
size 807437
|
completions/completions_00764.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:36fb01c543dda0793c724a270aa920d2733ec9a27b3bd7a30df4b5e97ab12c63
|
| 3 |
+
size 765464
|
completions/completions_00765.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2646c2c82b6ba3efde3d634c89b3320fe1f5df45ef59853f3078639e3fb1e318
|
| 3 |
+
size 743197
|
completions/completions_00766.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ec175fc2c8a3c41641b6693fec998a680c428a0422c2faa47192fb98d26a3fdd
|
| 3 |
+
size 709230
|
completions/completions_00767.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e3cda39044cb73fe9d39314cd627794cd209ea86f9fec68fb5743e2567455db2
|
| 3 |
+
size 781630
|
completions/completions_00768.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5030e90bb8c5c969fc0584ed68e98d4c1e857f56f202000d4bafaede35b17bb8
|
| 3 |
+
size 750207
|
completions/completions_00769.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d1d6217d085b85eaf95c0817be3c9dee26d1f8437a4b7caf08ef6c4e67299809
|
| 3 |
+
size 735263
|
completions/completions_00770.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:29ac6404f4f62703366a86db8b7ce9efc437c079bf94e74cddee15f565a99c38
|
| 3 |
+
size 736185
|
completions/completions_00771.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc2acea4d5154e9914496defcc26206d07e57f9cf860258b2160d56f3a9f6b69
|
| 3 |
+
size 751550
|
completions/completions_00772.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:511716fc59ecd5ccc433da7f9b046037915640e40316f7d29803b2907f809a20
|
| 3 |
+
size 767280
|
completions/completions_00773.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:493cb8ab63b92cb602ab8c57d75915ae84cc5bfc1d38cf67729881efbd47e5fb
|
| 3 |
+
size 781009
|
completions/completions_00774.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c851af649be8803771afde9eb5a0890b9b469edebad38e51dabca1e2a3b242b1
|
| 3 |
+
size 735497
|
completions/completions_00775.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a323f95a137a4bbc683860932e514a5f08465d5caf59c55d4e2a0f91992dae92
|
| 3 |
+
size 752132
|
completions/completions_00776.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a92e466ef6830a3dd1c0d2e8418cfca2f4155a20bb4ac65f3ba0bed0303d4877
|
| 3 |
+
size 759296
|
completions/completions_00777.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ef55aae398a908972284c42c638e691ce60ca5c0720f119249ec028c34c54565
|
| 3 |
+
size 753386
|
completions/completions_00778.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1ebbef14ab6b24b88f69b56c8d02462005864136a1c306de3632ab3aa3c091c0
|
| 3 |
+
size 763455
|
completions/completions_00779.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9f8c22ef1115c09a32586cd1d07802338a0cce231e4d2a3a314ff24cd6626ba5
|
| 3 |
+
size 819405
|
completions/completions_00780.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:079364db64c3860d3a1275970bea4a7ac48167b69b89162f3633781b7f2c1267
|
| 3 |
+
size 778752
|
completions/completions_00781.parquet
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:332f71854441d918508ca6eb7652e432a28a1fd7591608a2f401ff84bdab35db
|
| 3 |
+
size 727275
|
config.json
CHANGED
|
@@ -6,7 +6,7 @@
|
|
| 6 |
"attention_dropout": 0.0,
|
| 7 |
"bos_token_id": 100257,
|
| 8 |
"dtype": "bfloat16",
|
| 9 |
-
"eos_token_id":
|
| 10 |
"hidden_act": "silu",
|
| 11 |
"hidden_size": 4096,
|
| 12 |
"initializer_range": 0.02,
|
|
|
|
| 6 |
"attention_dropout": 0.0,
|
| 7 |
"bos_token_id": 100257,
|
| 8 |
"dtype": "bfloat16",
|
| 9 |
+
"eos_token_id": 100265,
|
| 10 |
"hidden_act": "silu",
|
| 11 |
"hidden_size": 4096,
|
| 12 |
"initializer_range": 0.02,
|
generation_config.json
CHANGED
|
@@ -3,6 +3,7 @@
|
|
| 3 |
"bos_token_id": 100257,
|
| 4 |
"do_sample": true,
|
| 5 |
"eos_token_id": [
|
|
|
|
| 6 |
100265,
|
| 7 |
100257
|
| 8 |
],
|
|
|
|
| 3 |
"bos_token_id": 100257,
|
| 4 |
"do_sample": true,
|
| 5 |
"eos_token_id": [
|
| 6 |
+
100265,
|
| 7 |
100265,
|
| 8 |
100257
|
| 9 |
],
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 14596063960
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:112ecc5d2184e641170d097848157bfec39d927428fb64489cf431b9b132ad04
|
| 3 |
size 14596063960
|
tokenizer_config.json
CHANGED
|
@@ -3,7 +3,7 @@
|
|
| 3 |
"backend": "tokenizers",
|
| 4 |
"bos_token": "<|endoftext|>",
|
| 5 |
"clean_up_tokenization_spaces": false,
|
| 6 |
-
"eos_token": "<|
|
| 7 |
"is_local": true,
|
| 8 |
"local_files_only": false,
|
| 9 |
"model_max_length": 65536,
|
|
|
|
| 3 |
"backend": "tokenizers",
|
| 4 |
"bos_token": "<|endoftext|>",
|
| 5 |
"clean_up_tokenization_spaces": false,
|
| 6 |
+
"eos_token": "<|im_end|>",
|
| 7 |
"is_local": true,
|
| 8 |
"local_files_only": false,
|
| 9 |
"model_max_length": 65536,
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a4cf4b053a06b593d70bff823007e4d93dab5880a76a388e5996e4147347fd82
|
| 3 |
+
size 9681
|