DART: Mitigating Harm Drift in Difference-Aware LLMs via Distill-Audit-Repair Training

Ziwen Pan, Zihan Liang, Jad Kabbara, Ali Emami · 2026

Read DART: Mitigating Harm Drift in Difference-Aware LLMs via Distill-Audit-Repair Training by Ziwen Pan, Zihan Liang, Jad Kabbara, Ali Emami (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16845.txt.

Description

Pan and colleagues study diff-aware classification, where the question is whether a correct answer needs spotting group gaps. Safety-tuned models often avoid noting demographic gaps, falling to wrong responses, noes or equal answers. Fine-tuning for accuracy triggers harm drift: explanations grow more harmful as accuracy improves. DART pulls reasoning shaped by labels from a teacher, audits outputs against the baseline, and repairs problematic cases by severity-weighted fine-tuning. On eight benchmarks, accuracy rises from 39 percent to about 69 percent while harm drift cases fall by about 73 percent.

Catalog record

CREATORZiwen Pan, Zihan Liang, Jad Kabbara, Ali Emami
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE141828
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16845

Browse the full library · About the Tower of Babel