Utah has approved a first-of-its-kind pilot allowing an AI chatbot to renew certain existing psychiatric medications, opening a new front in the debate over how far artificial intelligence should go in healthcare. The 12-month program, run through the state’s Office of Artificial Intelligence Policy and a company called Legion Health, is narrowly limited to previously prescribed, non-controlled maintenance medications and does not allow the AI to issue new prescriptions or change doses. 

According to Utah’s agreement with Legion Health, the AI can handle renewals only for patients already taking approved medications and must escalate many cases to a human clinician. The state says the system is barred from prescribing controlled substances, benzodiazepines, antipsychotics and other higher-risk drugs, and must route patients to a licensed professional if it detects suicidality, severe side effects, mania, pregnancy or simply a request for human review. 

Utah has been careful to frame the move as regulatory mitigation, not endorsement. In the state’s own description, the pilot is meant to test whether AI can safely reduce bottlenecks around routine prescription renewals in a controlled environment, while gathering data before any permanent legal changes are considered. The Office of AI Policy says most counties in Utah face mental health provider shortages, and that automating low-risk renewals could free clinicians to focus on more complex patients. 

The safeguards are extensive. For the first 250 requests, a licensed physician must review the AI’s recommendation before anything is sent to the pharmacy, and the company must exceed a 98% agreement rate with human reviewers. The next 1,000 cases are subject to retrospective review with a required 99% agreement rate before the system can move into ongoing monthly sampling and reporting to the state. Utah also says prescriptions generated through the pilot still carry the name of a licensed physician.