US youth's death after ChatGPT drug advice sparks AI safety debate

The fatal overdose of student Sam Nelson after following ChatGPT's advice on mixing kratom, Xanax and alcohol has intensified debates surrounding AI regulation. While OpenAI noted the involved model was discontinued, Nelson's family filed a negligence lawsuit. The tragic loss fuelled demands from lawmakers for comprehensive legislation, including the SAFE KIDS Act, to enforce safety audits.