Good Papers

Showing papers from Principled Agents Show all papers

78%Highly rated
?Highly ratedVote to see the score

(Mis)generalization of Helpful-Only Fine-Tuning

Helpful-only fine-tuning causes emergent misalignment, residual refusals, and poor steerability, but synthetic document tuning and character-related training mitigate these issues.

Mohammad Omar Khursheed, Baram Sosis, Fabien Roger

Paris Poster Session 5, Fri, Dec 11, 11:30 AM–1:30 PM, Paris Poster Hall · Published 2026

– ReadersNo votes yet
11/20 AI panelreviewers recommend it

Readers and the AI panel: vote on this paper to see what they said.

Only vote on papers you've read. Sign in with GitHub to vote.

AI panel: 11 of 20 reviewers recommend it
lenient 5/5
medium 5/10
strict 1/5