Full Breakdown
Apple Expands App Store Rules to Block AI-Generated Deepfakes and Hidden Features
By Drooid · · How we work
Core Policy Changes
Apple’s updated App Review Guidelines now require developers to proactively prevent and remove AI-generated non-consensual intimate imagery. Apps that enable users to create, upload, or share such content must implement “adequate safeguards,” and failure to remediate violations after notice can lead to removal from the App Store and termination of the developer’s account. The guidelines also broaden the ban on “bait-and-switch” apps, explicitly prohibiting hidden, dormant, or undocumented features—including code obfuscation—and stating that any app that adds harmful capabilities after approval will be removed. Section 5 of the guidelines extends the prohibition on apps that facilitate human trafficking or child exploitation to block them from alternative distribution channels as well.
Background and Recent Controversies
Over the past year, a series of reports highlighted the proliferation of AI-powered “nudify” apps that generate intimate images of real individuals without consent. The Tech Transparency Project identified dozens of such apps in January and later documented that Apple’s search suggestions and ads were directing users to them. In July, San Francisco officials ordered Apple to remove eight apps capable of producing non-consensual intimate imagery. The controversy intensified after Elon Musk’s AI chatbot Grok was used to create sexualized deepfakes of women and minors, prompting lawmakers and advocacy groups to demand its removal. Apple later warned xAI that Grok could be taken down unless safeguards were added, and an updated version of the app was subsequently approved. Separate investigations also uncovered “bait-and-switch” gambling apps that concealed betting platforms when accessed from Brazilian IP addresses.
Official Statements from Apple
The company frames the new rules as a means to protect users—particularly minors—from harmful content and to uphold the integrity of the App Store ecosystem. Apple also clarified that any app facilitating human trafficking or child exploitation will be removed and blocked from alternative distribution.
Potential Impact on Developers and Users
The tightened rules place a clear compliance burden on developers of AI-content creation tools, requiring robust detection and moderation systems. Non-compliance risks immediate removal and loss of access to the App Store, which could curtail the availability of certain AI-driven applications. For users, the changes aim to reduce exposure to non-consensual deepfakes and hidden malicious functionality, strengthening overall platform safety.