Utah has emerged as a national leader in regulating mental health AI by adopting a pragmatic approach that encourages innovation while protecting patients, rather than banning the technology outright. In a newly published commentary in npj Digital Medicine, researchers and policymakers detail the state's regulatory review of mental health AI agents and the legislative framework it helped shape, offering a roadmap for other states grappling with how to oversee rapidly evolving AI technologies in sensitive domains .

Why Is Mental Health AI Regulation Becoming Urgent?

Mental health chatbots and AI-enabled agents are increasingly being deployed to address longstanding gaps in behavioral health care. Half of U.S. residents live in mental health professional shortage areas, and many individuals with anxiety or depression remain untreated . Utah itself is one of these shortage areas, where the demand for mental health support far exceeds the available workforce.

Evidence suggests that well-designed mental health AI tools can meaningfully reduce symptoms for some users, particularly those with mild to moderate conditions. These chatbots are already in millions of people's pockets, raising an urgent question for policymakers: the question is no longer whether to regulate them but whether regulators can do so intelligently enough to preserve genuine access benefits while protecting vulnerable users .

"We are at a regulatory inflection point. Chatbots that offer mental health support are already in millions of people's pockets, the question is no longer whether to regulate them but whether we can regulate them intelligently enough to preserve the genuine access benefits while protecting the most vulnerable users," said Nina de Lacy, MD, of Huntsman Mental Health Institute at the University of Utah.

Nina de Lacy, MD, Huntsman Mental Health Institute, University of Utah

What Did Utah's Multi-Stakeholder Review Reveal?

Utah's regulatory process involved a diverse group of stakeholders including clinicians, people with lived experience of mental illness, technologists, academics, and regulators. One of the most striking findings was the degree of divergence among these groups about how mental health AI should be governed .

Different stakeholders prioritized different concerns and benefits:

• Clinicians: Tended to emphasize potential harms and professional risk associated with AI-driven mental health tools
• People with lived experience: Often highlighted empowerment, accessibility, and real-world benefits they had experienced using AI tools
• Academics: Raised concerns about bias in AI systems and long-term effects on mental health outcomes
• Everyday users: Voiced both enthusiasm and unease about emotional dependence on AI tools

Rather than viewing this divergence as an obstacle, Utah's policymakers recognized it as valuable information. De Lacy explained that when different stakeholders want different things from the same technology, that tension reveals important signals about genuine risks and benefits .

Notably, Utah's review intentionally elevated underrepresented voices, particularly those of people with lived experience, in a policy environment traditionally dominated by professional and institutional stakeholders. Zachary Boyd, PhD, Director of Utah's Office of Artificial Intelligence Policy, noted that professional societies are organized and active in politics, but people who are actually served by these tools are often left out of the conversation entirely .

"The professional societies are organized and active in politics, but the people who are actually served, those with lived experience, are so easy to leave out of the conversation. We spoke with adults living independently with mental illness, people in care facilities, the parents of affected children, and others who would not ordinarily be asked and who articulated their own interests very differently from the caregivers. It deeply informed our perspective," said Zachary Boyd, PhD.

Zachary Boyd, PhD, Director, Office of Artificial Intelligence Policy, Utah Department of Commerce

How Does Utah's Regulatory Framework Actually Work?

Rather than banning or tightly constraining mental health AI, Utah adopted a novel regulatory approach that creates incentives for responsible innovation. The state reinforced consumer protections around data privacy and advertising while creating a "safe harbor" for mental health AI agents that implement clearly defined safety guardrails .

The safe harbor framework requires mental health AI tools to meet specific safety standards:

• Pre-deployment safety testing: AI tools must undergo rigorous testing before being released to users to identify potential harms
• Crisis escalation protocols: Systems must be able to recognize when a user is in crisis and escalate to human mental health professionals
• Clinical oversight: Mental health AI tools must operate under the supervision of qualified clinicians who can review outcomes and intervene when necessary
• Ongoing monitoring: Tools must be continuously monitored after deployment to track real-world performance and identify emerging issues

This approach aims to encourage responsible innovation while avoiding unintended consequences, such as pushing consumers toward riskier, general-purpose chatbots in the absence of safer, specialized mental health tools .

"The demand signal for this kind of service is certainly there. Mental health support remains a top use case of AI in the larger population. It is possible that in the coming years we will see a profound and durable change in how people access care and support themselves in their mental health journey. The government should provide a clear pathway for this technology to develop and potentially benefit our residents," said Zachary Boyd, PhD.

Zachary Boyd, PhD, Director, Office of Artificial Intelligence Policy, Utah Department of Commerce

What Lessons Does Utah Offer Other Jurisdictions?

The authors argue that Utah's experience offers a roadmap for other states and countries grappling with how to regulate fast-moving AI technologies in sensitive domains like mental health. Rather than adopting a risk-only approach that focuses exclusively on potential harms, Utah's framework emphasizes risk-benefit analysis, recognizing that mental health AI tools offer genuine benefits alongside real risks .

Core recommendations from Utah's regulatory review include shifting from risk-only to risk-benefit analysis, developing detailed and evidence-based best practices for mental health AI, and designing regulations that can evolve alongside the technology. As de Lacy noted, there is no option to entirely stamp out the use of AI for mental health, so the challenge becomes guiding its development toward safer, more effective tools that genuinely improve population mental health outcomes .

The authors emphasize that adaptive regulation is not a euphemism for weak regulation. Instead, they argue that policymakers should learn from social media's regulatory failures and build oversight frameworks for generative AI that incentivize safe innovation while remaining capable of keeping pace with a technology that changes faster than any legislative cycle .

As mental health AI tools continue to proliferate, Utah's pragmatic approach, which balances innovation with patient protection, may become a model for how other jurisdictions address the governance challenges posed by AI in sensitive, high-stakes domains.