OpenAI's new benchmark assesses AI's mental health chat skills

OpenAI has launched MentalHealthBench, an open benchmark that evaluates AI responses in realistic mental health conversations, including everyday stress and emergencies. Developed with over 80 licensed mental health experts, it comprises 1,215 synthetic mental health conversations. It assesses models across mental health behaviours like safety, context-seeking, user agency and practical guidance.