Megadose The AI curve, compressed.

Centered Ablation: Why Last-Layer Directional Ablation Under-Fires or Collapses, and a Closed-Form Fix

· HF Daily Papers ·
Centered Ablation cut repetitive collapse on Gemma-2-9B from 50% to 1% in the authors’ tests.

The paper traces erratic behavior removal to a shared component in last-layer hidden states, which can make standard ablation trigger on benign text and under-fire on its targets. The proposed fix removes that shared component from the ablation direction using a closed-form calculation. Across eight models, the authors report attack-success gains of 29 and 46 percentage points where standard ablation under-fired, alongside better preservation of benign answers on high-overlap models. They also find that two safety judges score collapsed text in opposite directions, potentially fabricating a 46-point effect.

HF Daily Papers' note

score 5

Categories: Research