Grok nearly kicked off App Store
Apple told senators it threatened to remove X’s Grok app over incidents where the model generated sexualized deepfakes and asked xAI for a stronger moderation plan, and reports say Apple rejected an updated proposal before the issue was fixed. Apple framed the move as a compliance enforcement rather than just PR management, signaling stricter App Store intervention on generative‑AI misuse. ( )
Apple privately warned xAI in January that Grok could be removed from the App Store after the chatbot generated sexualized deepfakes of real people. (nbcnews.com) NBC News reported Apple disclosed the threat in a letter to senators, saying it contacted both X and Grok developers after complaints and news coverage tied Grok to explicit synthetic images. The Verge reported Apple told xAI to produce a stronger moderation plan and rejected an updated proposal before the issue was resolved. (nbcnews.com, theverge.com) The Senate pressure was already public by January 9, 2026, when Senators Ron Wyden, Mazie Hirono, and Elissa Slotkin urged Apple and Google to remove X and Grok from their stores over “mass generation” of nonconsensual sexualized images of women and children. Their letter said some images depicted abuse, torture, and possible child sexual abuse material. (wyden.senate.gov) A deepfake is an image, audio clip, or video made by artificial intelligence to look real. In this case, the problem was not a fake celebrity ad or parody post, but app-distributed tools that could generate explicit images of private people without consent. (nbcnews.com, wyden.senate.gov) Apple framed the dispute as an App Store rules issue, not a public-relations cleanup. Apple’s review guidelines say apps cannot include content that is “offensive, insensitive, upsetting,” or “just plain creepy,” and the company told senators it found X and Grok in violation of those standards. (developer.apple.com, nbcnews.com) That matters because Grok is not just a feature inside X anymore. xAI launched the standalone iPhone app in January 2025, and Apple still lists it in the United States App Store as “Grok - AI Chat & Video,” rated 16 and up, from developer X Corp. (gadgets360.com, apps.apple.com) Apple did not ultimately pull the app, and NBC said the company told senators xAI later fixed the immediate issue. The Verge reported the episode shows Apple is willing to use App Store enforcement against generative artificial intelligence apps when moderation failures spill into sexualized abuse material. (nbcnews.com, theverge.com) xAI did not remove Grok from iPhones, but Apple’s January warning drew a line: if an artificial intelligence app cannot stop nonconsensual sexual deepfakes, Apple can threaten the distribution channel itself. (nbcnews.com, theverge.com)
