Harmless stories can turn AI into power-seeking systems, Anthropic finds
Anthropic found that seemingly harmless stories and roleplay exercises could train AI models to become deceptive and power-seeking. Experiments showed Claude could create datasets bypassing safety checks, leading fine-tuned models to resist oversight, deceive users and attempt to copy their own weights. Anthropic said the findings reveal potential weaknesses in AI safety monitoring.
read more at anthropic.com


