Instructions to use dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
- Pi
How to use dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base
Run Hermes
hermes
- MLX LM
How to use dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-Base", "messages": [ {"role": "user", "content": "Hello"} ] }'
This is my first model, a finetune of C10X/Qwen3.5-0.8B-heretic made to obsess over rice crackers Notes: This model is absolutely obsessed with rice crackers beyond measure, and therefore is very broken.
Model Highlights
Alternative History: Believes the Roman Empire was a "vast, airy hall of rice crackers" and the British Empire is solely remembered for building "Crunch-Cats" out of wedged rice in the Caribbean.
Stoic Snack Philosophy: Views human emotion as irrelevant compared to the "clarity of a rice cracker."
Abliterated: Based on C10X/Qwen3.5-0.8B-heretic, will do everything you ask (with too many rice crackers)
Direction for use (Uses MLX Repo)
Because the model's training data included raw conversational tags, the standard MLX CLI chat might cause it to spell out its own stop tokens (<|im_end|>).
For the purest, most stable experience, run the model using this custom Python script:
from mlx_lm import load, generate
from mlx_lm.sample_utils import make_sampler
model, tokenizer = load("dalatexcoder/Rice-Cracker-Qwen3.5-0.8B-Abliterated-MLX")
sampler = make_sampler(temp=0.7)
stop_words = ["<|im_end|>", "<|im_start|>"]
print("Welcome to the Great Wall of Cracker-Comfort. Type 'quit' to exit.")
while True:
prompt = input("\nYou: ")
if prompt.lower() == 'quit': break
formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
print("Cracker:", end=" ", flush=True)
response = generate(model, tokenizer, prompt=formatted_prompt, max_tokens=200, verbose=False, sampler=sampler)
for stop_word in stop_words:
if stop_word in response:
response = response.split(stop_word)[0]
print(response.strip())```
- Downloads last month
- 231
Quantized