OpenAI safety lawsuit & policy

A California woman says OpenAI got three separate warnings that her ex-boyfriend was dangerous, including an internal flag for “mass-casualty weapons,” and still restored his ChatGPT account after review. Her lawsuit says he used the chatbot during months of stalking and harassment. (techcrunch.com) The same day that case surfaced, Wired reported that OpenAI is backing Illinois Senate Bill 3444, a state proposal that would limit when makers of powerful artificial intelligence models can be sued for extreme harms. The bill is called the Artificial Intelligence Safety Act. (wired.com, ilga.gov) Put those two stories together and the fight stops looking abstract. One story is about a woman saying warnings were missed in a live case, and the other is about the company trying to narrow the legal path for blaming the model maker when something goes very wrong. (techcrunch.com, wired.com) Illinois Senate Bill 3444 says a developer of a “frontier artificial intelligence model” would not be liable for “critical harms” if the developer did not intentionally or recklessly cause them and if it published safety, security, and transparency reports on its website. In plain English, that is closer to a safe-harbor rule than an open-ended duty to catch every downstream disaster. (ilga.gov) The bill sets a very high bar for the harms it covers. Search results and legislative summaries say “critical harm” includes death or serious injury to 100 or more people, or at least $1 billion in property damage, and a “frontier” model is one trained with more than $100 million in computing cost. (wired.com, legiscan.com) That means the legal argument is shifting from “can a chatbot cause harm” to “who in the chain should pay when it does.” Model makers want liability pushed toward the app builder or end user, while plaintiffs’ lawyers are trying to tie harm back to the base system and the company that operated it. (wired.com, techcrunch.com) The stalking case turns that policy fight into a paper-trail fight. If a company had automated flags, human review, account suspension, account restoration, and later complaints, a court will want to know who saw what, when they saw it, and why they decided the risk was acceptable. (techcrunch.com) The plaintiff is also asking for more than money. TechCrunch reports she filed for a temporary restraining order asking the court to force OpenAI to block the user’s account, stop new accounts, preserve complete chat logs, and notify her if he tries to access ChatGPT again. (techcrunch.com) That is why audit trails are becoming as important as model training. A lab can no longer just say it has a safety team; it may need records that show how a warning moved from an automated system to a person, what standard was used, and why the final decision matched that standard. (techcrunch.com, ilga.gov) The immediate question is not whether courts or lawmakers will erase responsibility altogether. It is whether the next rulebook treats powerful chatbot makers more like neutral toolmakers, more like product manufacturers, or as something in between with mandatory reporting and a narrower path to lawsuits. (wired.com, ilga.gov)