lmoody68 commited on
Commit
86d386d
·
verified ·
1 Parent(s): 378e186

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +69 -0
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: 01-ai/Yi-Coder-9B-Chat
4
+ language:
5
+ - en
6
+ tags:
7
+ - code
8
+ - coding-assistant
9
+ - gguf
10
+ - ollama
11
+ - qlora
12
+ - yi-coder
13
+ pipeline_tag: text-generation
14
+ library_name: gguf
15
+ ---
16
+
17
+ # AXIOM-coder-9B
18
+
19
+ **AXIOM** is a private, open coding assistant built by **Leslie Moody** — a [Yi-Coder 9B](https://huggingface.co/01-ai/Yi-Coder-9B-Chat) model fine-tuned (QLoRA) on Leslie's own code plus a Python coding-instruction dataset, then merged and quantized to **GGUF (Q4_K_M)** so it runs fully **locally and privately** through Ollama or llama.cpp.
20
+
21
+ It identifies itself as *AXIOM, built by Leslie Moody*, focuses on **coding** (writing, explaining, debugging, refactoring), and is tuned to be honest and grounded.
22
+
23
+ ## Quick start (Ollama)
24
+
25
+ 1. Download `axiom-v1.Q4_K_M.gguf` and `Modelfile` from this repo into the same folder.
26
+ 2. Create and run the model:
27
+
28
+ ```bash
29
+ ollama create axiom:v1 -f Modelfile
30
+ ollama run axiom:v1 "Write a Python function that reverses a linked list, with a docstring."
31
+ ```
32
+
33
+ The included `Modelfile` carries AXIOM's system prompt (identity + coding focus + honesty) and sensible parameters (`temperature 0.25`, `num_ctx 8192`).
34
+
35
+ ### llama.cpp
36
+
37
+ ```bash
38
+ llama-cli -m axiom-v1.Q4_K_M.gguf -p "Refactor this function for readability: ..."
39
+ ```
40
+
41
+ ## Files
42
+
43
+ | File | Size | What |
44
+ |------|------|------|
45
+ | `axiom-v1.Q4_K_M.gguf` | ~5.3 GB | the quantized model (Q4_K_M) |
46
+ | `Modelfile` | tiny | Ollama Modelfile with AXIOM's system prompt + params |
47
+
48
+ ## Training
49
+
50
+ - **Base:** `01-ai/Yi-Coder-9B-Chat` (Apache 2.0)
51
+ - **Method:** QLoRA (4-bit), rank 16, 1 epoch
52
+ - **Data (6,964 examples):** ~1,964 docstring↔code pairs extracted from Leslie's own Python projects + 5,000 rows of [`iamtarun/python_code_instructions_18k_alpaca`](https://huggingface.co/datasets/iamtarun/python_code_instructions_18k_alpaca)
53
+ - **Export:** merged to fp16 → converted to GGUF → quantized to Q4_K_M (llama.cpp)
54
+ - Trained on a single free-tier GPU.
55
+
56
+ ## Intended use
57
+
58
+ A personal / local coding assistant you fully own and run offline. Great for code help, explanations, and quick refactors.
59
+
60
+ ## Limitations (read this)
61
+
62
+ - It's a **9B fine-tune, not a frontier model.** It won't match large hosted assistants on hard, long-context, or agentic coding tasks.
63
+ - **English + code focused.** Non-English ability is limited (the base model isn't broadly multilingual).
64
+ - Like all LLMs it can **be confident and wrong** — verify generated code, and never rely on it for safety- or security-critical decisions without review.
65
+ - A small model fine-tuned for 1 epoch can occasionally over-fit phrasing; treat its output as a strong draft, not ground truth.
66
+
67
+ ## License & attribution
68
+
69
+ Released under **Apache 2.0**, inheriting the base model's license. Built by **Leslie Moody**. Yi-Coder is by 01.AI. The coding-instruction data is from the dataset linked above.