Instructions to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF # Run inference directly in the terminal: llama cli -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF # Run inference directly in the terminal: llama cli -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF # Run inference directly in the terminal: ./build/bin/llama cli -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Use Docker
docker model run hf.co/spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
- Llama new
- LM Studio
- Jan
- vLLM
How to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
- Ollama
How to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with Ollama:
ollama run hf.co/spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
- Unsloth Desktop
- Pi
How to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with Docker Model Runner:
docker model run hf.co/spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
- Lemonade
How to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Run and chat with the model
lemonade run user.Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
This repository provides a patched version of IsValorum/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-GGUF with nitayrabi's LoopFix weight-space and chat-template interventions applied.
By combining IsValorum's 4-moment Importance Matrix mixed-precision NanoPlus quantization (~11.5–12.3 GiB, tailored for 16 GB GPUs with generous context headroom) with nitayrabi's zero-fine-tuning LoopFix patch, this build prevents multi-turn reasoning loops and tool-call stalls during local agentic coding workflows.
What Was Applied
1. Base Quantization: APEX-I NanoPlus
- Source: IsValorum/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-GGUF
- Precision Strategy: Per-tensor mixed precision using strategic
IQ2_S/IQ2_XXSin core feedforward blocks while keeping routers and attention layers at higher precision—leaving ample VRAM for 16k–32k context windows on 16 GB GPUs.
2. Behavioral Patch: LoopFix
- Source: nitayrabi/Cyber-Tiel-Coder-35B-A3B-LoopFix-GGUF
- Weight-Space Projection: Projects out a rank-2 looping/over-deliberation subspace directly from late shared-expert MLP down-projections (
blk.26.ffn_down_shexp.weightandblk.34.ffn_down_shexp.weight), leaving early/mid syntax-binding layers untouched. - In-Place Chat Template Fix: Sets
_preserve_thinking = falseby default and tightens intra-turn retention and tool-use instructions sollama-serverdoes not feed stale reasoning traces back into subsequent agent turns.
Quick Start (llama.cpp)
Run with llama-server using the recommended LoopFix sampling and reasoning parameters:
llama-server \
-m .\Cyber-Tiel-Coder-35B-A3B.APEX-I-NanoPlus-LoopFix.gguf \
--jinja \
-fa on \
-ngl 99 \
--top-p 0.95 \
--temp 0.6 \
--top-k 20 \
--min-p 0.05 \
--presence-penalty 0.0 \
--frequency_penalty 0.0 \
--repeat-penalty 1.0 \
--cache-type-k q8_0 \
--cache-type-v q8_0 \
--chat-template-file .\patched-chat-template.jinja \
--reasoning-effort xhigh
- Downloads last month
- 706
We're not able to determine the quantization variants.
Model tree for spoodini/Cyber-Tiel-Coder-35B-A3B-APEX-I-NanoPlus-LoopFix-GGUF
Base model
ornith-ai/Ornith-1.5-35B-A3B