The Pulse
Apple Tightens App Rules for AI Nudification and Bait-and-Switch Apps
Apple updated its App Review Guidelines on October 16 to explicitly require apps to prevent and remove nonconsensual intimate imagery, including AI-generated imagery. A new rule also bars hidden or dormant features, with violations potentia
AI.info Team · Written with AI ·
Apple says the ban is old; the AI rule is new
Apple says nudification apps were already barred from the App Store. Its October 16 update makes a different point explicit: apps that let users create or share content must proactively prevent and remove nonconsensual intimate imagery, including images generated with AI tools. The change addresses a gap between a longstanding ban on pornographic material and a clearer moderation duty for services where users create or share content.
Apple’s announcement describes the updated requirement this way:
Content moderation requirements now explicitly cover nonconsensual intimate imagery — including imagery generated using AI tools — as content that apps must proactively prevent and remove from their platforms.
Apple
The policy applies to apps that enable people to create, generate, upload, share or otherwise contribute content. Apple’s revised Guideline 1.2 says those apps must filter objectionable material, provide a way to report offensive content, let users block abusive accounts and publish contact information. Developers who lack safeguards or fail to address violations after notice may be found in breach of Apple’s Developer Code of Conduct.
Rule 2.5.19 targets features hidden from reviewers
The second change is aimed at apps that pass review under one description and reveal harmful functionality later. Apple calls the tactic “bait-and-switch”: an app misrepresents its purpose during review, then activates capabilities such as nudification after approval. The company says its existing rules already prohibited hidden or undocumented features, but the update spells out the prohibition and its consequences in a new section.
Guideline 2.5.19 bars hidden, dormant or undocumented features and says an app’s functionality must be clear to both users and App Review. Apple specifically names code obfuscation and other efforts to hide functionality in an app binary as grounds for removing the app and terminating its developer account. The announcement also says apps that misrepresent their purpose during review and change after approval can be removed from both the App Store and the Apple Developer Program.
That distinction matters: Apple is not presenting the update as a newly created blanket ban on every image-editing app that could be misused. It is tightening the written requirements around moderation of intimate imagery and making consequences more explicit for developers who conceal what their apps do.
Apple widens the consequences in its legal rules
Apple also revised Section 5, its legal guidelines, to say apps found to facilitate human trafficking or the exploitation of children—including child sexual abuse material—will be removed from the App Store and blocked from alternative distribution. That provision concerns those categories of exploitation; Apple’s announcement does not say that every violation involving nonconsensual imagery automatically triggers the same alternative-distribution block.
The update lands as Apple describes concealment as an enforcement problem, not only a matter of inadequate app descriptions. The company says harmful features can be kept inactive until an app clears review, and that some violations involve coordinated fraud operations. It says it will continue changing its review tools and processes to detect such conduct.
Apple cites removals, not a new enforcement measure
To show the scale of its existing enforcement, Apple says it prevented more than 150,000 apps with safety issues from reaching customers last year and terminated more than 193,000 developer accounts for fraud and abuse. The company did not break out how many of those cases involved nonconsensual imagery, concealed features or bait-and-switch behavior. Those figures therefore describe Apple’s broader safety and fraud enforcement, not the results of this specific policy update.
The immediate change is to the rules developers must meet: content-creation and sharing apps must address nonconsensual intimate imagery, while apps that conceal or activate undocumented features after review risk App Store removal and developer-account termination.