Inference Provider

VERIFIED
73,761 monthly requests

AI & ML interests

None defined yet.

Recent Activity

Articles

delete a trailing comma

#4 opened about 17 hours ago by
RaushanTurganbay
danielhanchenย 
posted an update about 19 hours ago

lmao

๐Ÿง  1
#14 opened 13 days ago by
dpe1
elcohereย 

Introducing Cohere Parse 5

#1 opened 13 days ago by
elcohere
danielhanchenย 
posted an update 29 days ago
view post
Post
5799
Introducing Unsloth Desktop ๐Ÿฆฅ
The first desktop app to run and train models locally.

โ€ข Open-source. Runs on Mac, Windows and Linux
โ€ข Supports MLX, diffusion image/video, audio, GGUF
โ€ข Connect Claude Code and Codex to local LLMs
โ€ข 50% more accurate, self-healing tool calls + sandboxed code exec
โ€ข Works for CPU + multiGPU setups - NVIDIA, AMD, Intel, Mac
โ€ข Train models 2ร— faster with 70% less VRAM
โ€ข Private web search, deep research, RAG, MCP and exports (NVFP4, GGUF)
โ€ข Use Unslothโ€™s OpenAI-compatible API and cloud models
โ€ข Securely deploy LLMs remotely and access anywhere

Unsloth Desktop is now available on http://unsloth.ai
and GitHub.

GitHub: https://github.com/unslothai/unsloth
Blog and Guide: https://unsloth.ai/docs/desktop
  • 6 replies
ยท
danielhanchenย 
posted an update about 1 month ago
danielhanchenย 
posted an update about 1 month ago
view post
Post
2336
We compared 1-bit Kimi K3 to Claude Opus 5 and GPT 5.6. ๐Ÿคฏ

We gave 4 models the same prompt: Create a glass aquarium whose side panel develops a visible crack and then bursts...

1-bit Kimi K3 GGUF ran locally on 4x B200s at 36 tok/s.

GGUF: unsloth/Kimi-K3-GGUF
GitHub repo: https://github.com/unslothai/unsloth
  • 1 reply
ยท
danielhanchenย 
posted an update about 1 month ago
view post
Post
4689
Kimi K3 can now be run locally! โœจ

The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).

Run on a Mac Studio connected with 128GB RAM device. Kimi K3 is the strongest open model to date.

GGUF: unsloth/Kimi-K3-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k3
  • 5 replies
ยท
danielhanchenย 
posted an update about 2 months ago
view post
Post
5291
Introducing Unsloth for AMD ๐Ÿš€
You can now train & run LLMs on your AMD hardware

โ€ข We collaborated with AMD to enable you to train & run 500+ models on AMD GPUs
โ€ข Works on Windows, WSL, Linux
โ€ข Train Qwen, Gemma on just 3GB VRAM

GitHub: https://github.com/unslothai/unsloth
Blog + Guide: https://unsloth.ai/docs/basics/amd
  • 3 replies
ยท
danielhanchenย 
posted an update about 2 months ago
danielhanchenย 
posted an update about 2 months ago