AI chatbots stumble on messy source content
A county chatbot that gave residents incorrect answers shows that government AI systems fail when the underlying guidance is inconsistent or buried across silos. Governing and local reports highlight Hall County’s motor‑vehicle and tax-chatbot errors as an example of how poor content hygiene—outdated pages, no canonical owner, and human-oriented prose—directly produces public misinformation. The story underscores that cleaning and structuring source documents is a prerequisite for safe public-facing bots, not an optional step. (governing.com) (gainesvilletimes.com)
Hall County, Georgia, put a new chatbot called “Ask Hall County” on its website on April 6 as a three-month trial, and within two days the county tax commissioner was warning residents that it was giving wrong answers about car tags, titles, and property taxes. (hallcounty.org) (accesswdun.com) The problem was not that the bot could not read words on a page. The problem was that it was reading the wrong pages, because Hall County’s chatbot searched the county-managed website while the Tax Commissioner’s Office kept its official rules and procedures on a separate website with its own chatbot. (accesswdun.com) (hallcountytax.org) Hall County said the new tool was meant to help residents “easily connect with County officials and find information,” which sounds simple until you remember that county government is not one filing cabinet. In Georgia, a tax commissioner is a constitutional officer, which means one office can sit next to county government while maintaining its own systems, pages, and rules. (hallcounty.org) (accesswdun.com) That split matters because a chatbot answers with the confidence of a front desk clerk even when it is really just stitching together whatever text it can reach. Hall County’s tax office said residents could get answers that conflict with Georgia law or established procedures because the county bot did not access the tax office’s authoritative information at all. (wgtjradio.com) (accesswdun.com) The tax office also said it was not told in advance that the county planned to deploy the chatbot, so it had no chance to test answers before the public started using it. That is the bureaucratic version of opening a new airport gate without asking the airline for its flight schedule. (accesswdun.com) (wgtjradio.com) These mistakes are not small clerical slips. The Hall County Tax Commissioner’s Office said motor-vehicle and property-tax rules involve legal deadlines, document requirements, and statutory obligations, so a bad answer can mean penalties, missed deadlines, or a delayed title transfer. (accesswdun.com) This is the part many governments keep learning the hard way: a chatbot is only as reliable as the source material behind it. If the official answer lives on one site, the outdated answer lives on another site, and the plain-English explanation lives in a news release from 2023, the bot will mash them together and hand that mess to a resident as if it were settled fact. (governing.com) (hallcounty.org) New York City ran into the same trap in 2024 with its MyCity business chatbot, which The Markup found was telling business owners they could do things that were illegal under city law. Governing later used that case as an example of a governance failure, not just a software bug, because there were no clear guardrails, review process, or accountability when the answers went wrong. (themarkup.org) (governing.com) The Hall County episode shows what “bad data” looks like in real life. It is not always a corrupted spreadsheet or a hacked database; sometimes it is a county website that was built for humans to browse by department while a chatbot is trying to answer one direct question like “What do I need to renew my tag today?” (hallcounty.org) (hallcountytax.org) That is why public-facing bots need something governments often skip: one canonical owner for each answer, one official page for each process, and a review step before the bot goes live. Without that cleanup, the chatbot is not a faster clerk. It is a rumor with a search bar. (governing.com) (accesswdun.com)
