AI & Mental Health: Mind Launches Review After Google AI Gave Dangerous Advice

by Dr Natalie Singh - Health Editor
0 comments

Mind Launches Landmark Inquiry into AI and Mental Health Risks

Following a Guardian investigation revealing potentially “particularly dangerous” medical advice from Google’s AI Overviews, the mental health charity Mind has launched a year-long inquiry into the impact of artificial intelligence on mental health. The inquiry, the first of its kind globally, will examine the risks and safeguards needed as AI increasingly influences the lives of those affected by mental health issues.

The Risks of AI-Generated Mental Health Information

The investigation highlighted that Google’s AI Overviews, accessed by an estimated 2 billion people each month, have provided inaccurate and potentially harmful information. Mind experts found examples of the AI suggesting starvation was healthy, attributing mental health problems to chemical imbalances (a contested view), falsely identifying imagined stalkers as real threats, and implying a high percentage of mental health benefit claims are fraudulent.

Rosie Weatherley, information content manager at Mind, emphasized that AI Overviews “flatten” complex and nuanced information, making implausible claims seem plausible, particularly for individuals already experiencing distress. She noted that the AI’s presentation of information as definitive and factual can prematurely end the information-seeking process, leaving users with incomplete or inaccurate understandings.

Concerns Over Google’s Response

Weatherley criticized Google’s reactive approach to addressing inaccuracies, describing it as a “whack-a-mole” style of problem-solving that is insufficient given the scale of the platform and the potential for harm. She argued that a multi-billion-dollar company like Google should dedicate more resources to proactively ensuring the accuracy of information provided through AI Overviews.

Safeguarding the Digital Mental Health Ecosystem

Mind’s inquiry will bring together leading doctors, mental health professionals, individuals with lived experience, health providers, policymakers, and tech companies. The goal is to shape a safer digital mental health ecosystem with strong regulation, standards, and safeguards. The charity aims to address the risks of AI while acknowledging its potential to improve lives.

While search engines have historically worked to limit access to immediately harmful information, such as suicide methods, the investigation revealed that AI Overviews can still deliver harmful inaccuracies presented as credible facts. Mind stresses the need for constructive, empathetic, and nuanced information to be accessible at all times, not just during moments of acute crisis.

Looking Ahead

This inquiry marks a critical step in understanding and mitigating the risks associated with AI in mental health. As AI continues to evolve and play a larger role in how people access health information, proactive measures are essential to protect vulnerable individuals and ensure access to accurate, reliable support.

Related Posts

Leave a Comment