Introducing MentalHealthBench
AI Summary: Researchers introduced MentalHealthBench, an open benchmark for evaluating AI systems' responses in realistic mental health conversations. MentalHealthBench assesses model capabilities across key mental health behaviors, including safety, seeking context, preserving user agency, and providing actionable guidance. The benchmark was co-created with over 80 licensed mental health experts and results show steady improvement in AI systems' ability to respond with empathy and promote well-being. MentalHealthBench is designed to capture a wide range of mental health scenarios and user personas, and is being released openly for further research and evaluation.