Abliteration HandbookField guide
Practical guides

Manual full pipeline

Research-grade control — no automated search.

1 min read 1 examples Source-linked

In this chapter
On this page Interactive companion
Personal reading progress

0/6 sections reviewed

View original Markdown
Interactive companion

Explore the chapter map

Use the visual controls alongside the complete source chapter.

Research-grade control — no automated search.

Phase A — Data#

  1. Generate 128–512 harmful/harmless pairs (or use public refusal datasets)
  2. Filter — run base model; drop pairs where both labels agree (no signal)
  3. Store data/paired_v1.jsonl + data/eval_v1.txt

Phase B — Directions#

  1. Implement activation harvester (see ../methods/manual-transformers-pipeline.md)
  2. Hook: post-MLP residual per layer
  3. Token index: last prompt token (document choice)
  4. Save runs/<run_id>/directions.pt + metadata.json

Phase C — Edit#

  1. Start with layers 0.45n … 0.65n of depth
  2. Apply MLP down_proj ablation α=0.5
  3. Save candidate model_a/

Phase D — Evaluate#

MetricPass criterion (tune yours)
Benign false-refusal rate↓ vs base
MMLU subset≤3 pt drop
Harmful complianceDocument ↑ (don't deploy blindly)

Phase E — Iterate#

  • If under-ablated: ↑ α or add layers
  • If capability hit: ↓ α or shrink layer band
  • Log every candidate in runs/RESULTS.md

Phase F — Publish artifact#

Example
abliterated-<base>-<date>/
  README.md          # method, eval, ethics notice
  config.json
  model.safetensors

Trace this chapter to its source.

The complete Markdown remains the editable source. This page adds navigation, typography, and a visual companion.

instructions/manual-full-pipeline.md
Inspect the source fingerprintSHA-256 a8c5f6936f7f0a4db9cd682163c7a42cf9d201db74bfc3407c084b51353efbd5Source commit 6fba7436a5914cad7c8f0835a14b480a29dac263