AI & ML interests

We do Ternary Models

Recent Activity

Articles

kgrabkoΒ 
published an article 2 days ago
view article
Article

JiRack Ultra blew up the Hugging Face charts

CMSManhattan
β€’
kgrabkoΒ 
published an article 2 days ago
view article
Article

Almost Opus 4.6 Max quality with JiRack DeltaNet 27B β€” but it runs on your PC

CMSManhattan
β€’
kgrabkoΒ 
posted an update 2 days ago
view post
Post
61
Ternary Transformers & Micro-Agent Architecture


CMSManhattan : Center Business Solutions Inc.

JiRack β€” Ternary Transformers & Micro-Agent Architecture
We build highly efficient large language models using 1.58-bit ternary weights {-1, 0, 1} for extreme compression and fast CPU/GPU inference.

Core focus:

JiRack Ternary Transformer Architecture β€” fresh Qwen base, trained on DeepSeek-style datasets, optimized for fast CPU inference (MIT License)
JiRack Micro-Agent Deployment β€” specialized small models + smart router for low-cost agentic systems
Production-ready ONNX Runtime & Docker inference stacks

Public Models
ModelSizeStatusJiRackUltra series (1B / 7B / 14B / 32B)β€”Released

CMSManhattan/JiRackUltra_1b
CMSManhattan/JiRackUltra_7b
CMSManhattan/JiRackUltra_14b
CMSManhattan/JiRackUltra_32b

JiRackTernary series1B β†’ 10B+ReleasedJiRackPrecisionTokenizerβ€”Released

Mission
Democratize frontier-scale language models through extreme efficiency. Train and run powerful models on accessible hardware without sacrificing quality.

Solved issues
Benefits of JiRack Micro-Agent Architecture:

Solves catastrophic forgetting during training by using small, specialized models for each domain, managed by a smart router Enables extremely cheap inference using ternary models Significantly reduces cloud inference costs while maintaining high performance In classical architecture, an expensive model has to search for MCP-agents every time, while JiRack uses a very small model and cheap router for agent tasks, saving big money right from the start Considered one of the best approaches for enterprise AI deployments

Hugging Face:
CMSManhattan


Ollama : https://ollama.com/cmsmanhattan

Docker Hub: cmsmanhattan Contact: grabko@cmsmanhattan.com
  • 1 reply
Β·
kgrabkoΒ 
updated a Space 15 days ago