@_jake_ward

GRAFT confines reward hacking to a deletable adapter instead of penalizing it

MATS researchers, with Anthropic's Alex Cloud among the authors, propose GRAFT. It routes gradients from monitor-flagged reward hacks into a sacrificial adapter that is removed before deployment. On Qwen3-8B, hacking of all types fell to nearly zero.