App Store enforcement on AI apps

Apple is using App Store rules to force changes in two kinds of artificial intelligence apps at once: chatbots that generate images and tools that generate software. (nbcnews.com) (techcrunch.com) NBC News reported on April 15 that Apple privately warned xAI that Grok could be removed from the App Store after users made sexualized deepfakes, including of women and minors. Apple told U.S. senators it rejected one Grok update because the changes “didn’t go far enough,” then later approved a revised version after more fixes. (nbcnews.com) TechCrunch reported on April 14 that Anything, a “vibe-coding” app that lets users create apps with prompts, was removed from Apple’s store twice. Its developers told TechCrunch they are now rebuilding the product around a desktop companion after Apple tied the removals to rules on generated code. (techcrunch.com) Apple’s review system covers every app submission and update, and the company says it reviews apps for safety, content, design, and legal compliance. Apple also says 90% of submissions are reviewed in less than 24 hours, which gives it a fast enforcement lever when an app update triggers a policy dispute. (developer.apple.com) The rules Apple points developers to are broad enough to cover both cases. Its App Review Guidelines say user-generated-content apps must moderate harmful material, and the company says the App Store is a “curated” service built around user safety. (developer.apple.com) That puts image models and coding agents in the same enforcement lane. If an app lets users produce nonconsensual sexual imagery, Apple can treat it as a safety problem; if an app lets users ship code that changes functionality, Apple can treat it as a review and compliance problem. (developer.apple.com) (techcrunch.com) The Grok dispute followed pressure from Washington. In January, Senators Ron Wyden, Ben Ray Luján, and Edward Markey urged Apple and Google to remove X and Grok from their stores over deepfake concerns, according to NBC News. (nbcnews.com 1) (nbcnews.com 2) The Anything case shows a different response from developers. Instead of fighting for a fully native iPhone workflow, the company told TechCrunch it is shifting more of the software-generation process to desktop, where Apple’s mobile review rules do not control each iteration in the same way. (techcrunch.com) Apple says developers that do not want the App Store model can use the web instead, and its guidelines say apps should “change and improve” to stay on the store. For artificial intelligence developers, that increasingly means building moderation and guardrails as product features, not post-launch patches. (developer.apple.com)