Chatbot refill pilot flagged

Utah has cleared a 12-month pilot that lets an artificial intelligence chatbot renew some psychiatric prescriptions without a doctor signing off on each refill. (commerce.utah.gov) The pilot covers only maintenance refills for non-controlled psychiatric drugs that were already prescribed by a licensed clinician. Utah says the agreement is “regulatory mitigation, not endorsement,” and it temporarily relaxes some enforcement while the state collects data. (commerce.utah.gov 1) (commerce.utah.gov 2) The company is Legion Health, and its Utah-facing site advertises “fast, simple refills of psychiatric medications” for $19 a month. The state page says the test is aimed at routine renewals for stable patients, not new diagnoses or treatment changes. (ai.legionhealth.com) (commerce.utah.gov) In plain terms, a refill renewal is the paperwork step that keeps an existing prescription active. Utah’s program is testing whether a chatbot can handle that narrow step for low-risk cases while human clinicians take harder ones. (commerce.utah.gov 1) (commerce.utah.gov 2) Psychiatry is a harder setting than many refill workflows because medication decisions often depend on mood, judgment, sleep, side effects, and suicide risk that do not fit neatly into checkboxes. The American Psychiatric Association said mental health prescribing depends on “nuanced assessments of mood, cognition, and social context.” (psychiatry.org) Utah created its Office of Artificial Intelligence Policy in 2024 and gave it power to run an “AI Learning Laboratory” that can negotiate regulatory mitigation agreements with companies. The office says the program is meant to remove barriers temporarily while monitoring consumer risk and reporting outcomes to lawmakers. (le.utah.gov) (commerce.utah.gov) This is not Utah’s first refill test. In January 2026, the state announced a separate pilot with Doctronic for chronic-condition prescription renewals, and the Legion agreement extends that model into mental health. (commerce.utah.gov 1) (commerce.utah.gov 2) The state says most Utah counties have mental health provider shortages and that as many as 500,000 residents lack adequate behavioral healthcare access. Its case for automation is that routine refill work ties up clinicians who could be seeing higher-risk patients instead. (commerce.utah.gov) Critics are focused on liability and patient safety, not just speed. The Federation of State Medical Boards said physicians remain accountable for outcomes when they use artificial intelligence in care and recommended using these tools as support rather than replacements for medical decision-making. (fsmb.org) (akingump.com) Utah’s agreement tries to draw that line with exclusions. The state page says the chatbot cannot issue new prescriptions, change doses, or prescribe controlled substances, benzodiazepines, or antipsychotics, and it must escalate higher-risk cases to humans. (commerce.utah.gov) Even with those limits, some psychiatrists say the pilot may miss the patients with the greatest need. Brent Kious, a psychiatrist at the University of Utah, told The Verge that the benefits of an artificial-intelligence refill system “may be overstated” because eligible patients are already stable and already in care. (theverge.com) (pymnts.com) The next test is whether a tightly limited refill bot stays tightly limited. Utah framed the Legion deal as a one-year experiment, but it also described the work as a way to gather evidence before deciding whether state law should change. (commerce.utah.gov) (le.utah.gov)