Court Scolds Lawyer for AI-Generated Fake Cases
A Pennsylvania Superior Court recently admonished a litigant for submitting appellate briefs containing fictitious case law generated by AI. The incident serves as a stark warning about the regulatory and reputational risks of using unchecked AI outputs in high-stakes legal and business contexts, including insurance claims and investigations.
This specific Pennsylvania case, *Saber v. Navy Federal Credit Union*, involved a customer representing himself in a dispute over a car loan. The pro se litigant's brief cited entirely fabricated cases, such as "D'Happart v. First Commonwealth Bank," which the court identified as "hallucinations" from a generative AI program. Because the litigant was not a lawyer, the court opted not to issue sanctions, instead finding he had waived his issues due to the lack of any valid legal authority in his brief. This contrasts with numerous other cases where licensed attorneys faced serious penalties for similar AI-driven errors. The legal community is grappling with a series of these incidents. In a prominent New York case, *Mata v. Avianca, Inc.*, attorneys were fined for including six fictitious case citations generated by ChatGPT in a court filing. Similarly, a California attorney was hit with a $10,000 fine for an appeal that contained 21 fake quotes from non-existent cases. In response, legal organizations are racing to establish clear guidelines. The American Bar Association has issued formal opinions emphasizing that lawyers have an ethical duty to verify AI-generated work product and understand the technology's limitations. State bars, including California's, have also released specific guidance on maintaining client confidentiality and professional competence when using AI. This issue extends beyond courtrooms and directly impacts the insurance sector. Insurers are seeing a sharp increase in AI-manipulated or entirely fabricated evidence in claims, from altered images of property damage to synthetic medical reports. According to one report, AI-driven scams now account for more than half of all digital financial fraud. The use of deepfake technology presents a significant threat to insurance operations, enabling convincing but false evidence like altered video footage or audio impersonations of adjusters and claimants. This rise in "synthetic fraud" inflates costs and complicates the verification process for claims in casualty, specialty, and cyber lines of business.
