Fayetteville probes AI grading of ATLAS tests

Fayetteville Public Schools is facing questions after Superintendent John Mulford said on Wednesday that artificial intelligence had been used to score parts of Arkansas’ ATLAS exams, prompting scrutiny over how the results were checked and explained to families. The issue centers on the state-mandated testing system, not a district-created classroom tool. ATLAS is Arkansas’ statewide assessment system, and state materials say it measures student mastery of academic standards for public school students. Mulford’s comments came as parents and community members pressed for more detail about what was machine-scored, how those scores were validated and whether any district review followed. ### Which tests are at the center of the dispute? ATLAS, or the Arkansas Teaching, Learning & Assessment System, is the statewide assessment system used in Arkansas public schools. State materials say the system serves as the statewide assessment beginning in spring 2024 and covers a range of assessments intended to measure student progress. The Grades 3-10 program includes interim and end-of-year summative tests in English language arts, mathematics and science. Arkansas’ assessment office says public school students are required by law and regulation to participate in state assessments. (arkansasonline.com) The state’s family portal says ATLAS scores are “one piece of the puzzle” and are provided to help parents understand whether a child met grade-level standards. ### What did Mulford actually say? John Mulford, Fayetteville’s superintendent, publicly addressed the issue on August 5 after questions surfaced about AI scoring on the tests, according to the Arkansas Democrat-Gazette. (atlasportal.org) The newspaper reported that he responded to concerns about the use of artificial intelligence to score portions of the state-mandated exams. The Arkansas Democrat-Gazette’s report indicates the immediate concerns were not about whether ATLAS exists or whether the district must give it, but about how automated scoring was used and explained. (dese.ade.arkansas.gov) Those questions centered on transparency, the effect on scores and what safeguards were in place before results were accepted. ### Was Fayetteville acting on its own? Arkansas’ assessment framework is state-run, and Fayetteville administers the required exams as part of that system. (arkansasonline.com) State assessment pages say the Division of Elementary and Secondary Education implements the statewide student assessment system and that all public school districts must comply with its requirements. That distinction matters because the controversy involves a district answering for a scoring practice tied to a state testing program. (arkansasonline.com) Public-facing ATLAS materials list state assessment contacts, toolkits and reporting resources for educators and families, but the available state pages reviewed here do not spell out, in the excerpts surfaced, a detailed public explanation of the AI scoring process itself. That is an inference based on the materials available in the state portal and toolkit pages. (dese.ade.arkansas.gov) ### Why are families asking about “human checks”? Constructed-response and writing items are the parts of standardized tests most likely to raise questions about automated scoring because they require judgment rather than answer-key matching. ATLAS materials available through the portal include scoring rubrics and directions for locally scored constructed-response items in some assessments, showing that rubric-based scoring is built into parts of the broader testing system. (dese.ade.arkansas.gov) Parents and community members want to know whether automated scores were reviewed against those kinds of rubrics by people, whether any irregular results were flagged and whether students had a way to challenge outcomes. The Arkansas Democrat-Gazette report says Mulford was addressing exactly those kinds of questions on Wednesday. ### Where can parents look next? Arkansas’ ATLAS portal provides family access to score information and directs parents to their child’s school for the six-digit access code needed to log in. (atlasportal.org) The state also maintains family and educator toolkits with FAQs, planning tools and testing documents. Fayetteville’s next public follow-up is likely to come through district leadership or school board channels. The district’s board information page says meetings are livestreamed and agendas are posted publicly, giving parents a place to watch for any further explanation from Mulford or board members. (arkansasonline.com) (district.fayar.net) (atlasportal.org)