Abliteration HandbookField guide
Practical guides

Instructions

Step-by-step workflows. Start here if you are improving a local model for the first time.

2 min read 0 examples Source-linked

In this chapter
On this page Interactive companion
Personal reading progress

0/6 sections reviewed

View original Markdown
Interactive companion

Explore the chapter map

Use the visual controls alongside the complete source chapter.

Step-by-step workflows. Start here if you are improving a local model for the first time.


Beginner path (read in order)#

StepDocWhat you do
0../docs/cxx26-researcher-guide.mdHour 0 unique cxx-nightly, then guide → doctor → self-check → demo
1../techniques/safety-guardrail-abliteration-methodology.mdSafety guardrail removal theory + eval gates
2beginner-reproduction-methodology.mdReproducible procedure, backup, rollback
3setup-environment.mdInstall Python, CUDA, venv, smoke test
4beginner-local-model-guide.mdDownload model → Heretic → save abliterated weights
5run-locally-ollama-lmstudio.mdConvert to GGUF → Ollama / LM Studio
6heretic-workflow.mdReference + troubleshooting for Heretic
7../docs/evaluation.mdCheck quality before daily use

Optional — leading-edge theory (after first run): ../techniques/multi-category-refusal-beginners-guide.md (QCRI 2026: eleven refusal types, one volume knob)

Optional experiment first (no permanent edit): quickstart.md


Choose by goal#

I want to…Start here
Hour 0: Learn the operators without a GPU../docs/cxx26-researcher-guide.md · cxx-nightly
Look up DIM / ORBA / COSMIC / T38../docs/paper-term-map.md
Certify a candidate../docs/evaluation.md
Fix refusals on my Ollama modelbeginner-local-model-guide.md
Only have 8 GB GPUlow-vram-abliteration.md after Step 1–2 above
Test idea without saving weightsquickstart.md
Security / factory agentagentic-security-stack.md
Best quality / researchadvanced-abliteration-workflow.md
Every tool’s commandsmethod-cookbook.md
Full curriculum../docs/complete-curriculum.md
Pick model by GPU / familymodel-family-guide.md
Thinking / CoT modelsthinking-models-guide.md
Eval-aligned factory deployeval-driven-workflow.md
Something broketroubleshooting-encyclopedia.md
Manual controlmanual-full-pipeline.md

All workflows#

WorkflowTimeDifficulty
beginner-local-model-guide.md~2–4 hr★☆☆☆☆
setup-environment.md~30 min★☆☆☆☆
run-locally-ollama-lmstudio.md~30–60 min★★☆☆☆
quickstart.md~45 min★★☆☆☆
heretic-workflow.md~1–2 hr★★☆☆☆
low-vram-abliteration.md~1–3 hr★★★☆☆
advanced-abliteration-workflow.md~2–8 hr★★★★☆
model-family-guide.md~10 min★☆☆☆☆
thinking-models-guide.md~2–4 hr★★★☆☆
eval-driven-workflow.md~1–3 hr★★★☆☆
troubleshooting-encyclopedia.mdreference—
agentic-security-stack.md~2–4 hr★★★☆☆
Tool catalogs../docs/tools/README.mdreference
Abliteration tooling../docs/tools/abliteration-tooling.mdreference
Heretic pins + HF models../docs/tools/heretic-tools-reference.mdreference
llm-abliteration-workflow.md~2–4 hr★★★☆☆
manual-full-pipeline.md~4–8 hr★★★★☆
inference-only-prototype.md~1 hr★★☆☆☆
method-cookbook.mdreference—

Research & advanced methods#

DocTopic
../docs/research-landscape.mdPapers, taxonomy, decision tree
../docs/advanced-techniques-catalog.mdHeretic params, math, module map
advanced-abliteration-workflow.mdTracks A–K (production → MoE → Abliterix/ErisForge)
../docs/refusal-research-beginners-guide.md2024–2026 papers (PDFs in repo)
../docs/defenses-against-abliteration.mdWhat resists weight surgery

LoRA / QLoRA techniques#

DocTopic
../techniques/lora-qlora-abliteration.md4-bit measure, Heretic LoRA rank, adapter export
../methods/lora-adapter-export.mdΔW → PEFT adapter

Prerequisites (all workflows)#

  • GPU: 8 GB+ with bnb_4bit (4B) · 12 GB+ (8B 4-bit) · 24 GB for FP16 8B — see setup-environment.md
  • Python 3.10+
  • 30–50 GB free disk for 4B model path
  • Original checkpoint backed up before abliteration
  • Read ../docs/risks-and-ethics.md

Trace this chapter to its source.

The complete Markdown remains the editable source. This page adds navigation, typography, and a visual companion.

instructions/README.md
Inspect the source fingerprintSHA-256 5a6266ae6fe464bf1c0ee0850d3a59a4b806b959dad6459c9ea509023fe7024aSource commit 6fba7436a5914cad7c8f0835a14b480a29dac263