Apple has updated its App Store rules to explicitly prohibit AI-powered 'nudify' apps that generate nonconsensual intimate images, a move that aims to enhance user safety on the platform.
Apple has explicitly updated its App Store rules to ban so-called "nudify" apps, which use artificial intelligence to generate intimate images of people without their consent. This policy change, reported by The Verge, is a significant step towards curbing the spread of nonconsensual AI-generated content on its platform.
Why Apple is Cracking Down on 'Nudify' Apps
The updated rules follow considerable criticism Apple faced earlier this year. X users reportedly used Grok, an AI tool, to create nonconsensual, sexualized deepfakes, some involving minors. While Apple did not remove X or Grok from the App Store, it did tell senators that it threatened to pull Grok.
The issue gained further traction at Apple's WWDC event in June, where protestors demanded the company remove Grok, X, and all "nudify technology" from the App Store. In July, a San Francisco city attorney ordered Apple to take down 13 "nudify" apps, which the company stated it had done.
New Requirements for Developers
As part of these recently announced updates, Apple now mandates that developers "must proactively prevent and remove" nonconsensual, sexual images. This is a crucial addition to its content moderation requirements for all App Store apps.
Developers who "fail to implement adequate safeguards" or "don't remedy violations after notice" risk having their apps removed from the App Store. This puts the onus clearly on app creators to ensure their AI tools are not misused for generating harmful content.
Broader Content Policy Clarifications
Beyond "nudify" apps, Apple also clarified a rule regarding "bait-and-switch" apps. These are applications that add or significantly change features, including "nudification," after they have already been approved for the App Store. Such practices are now explicitly prohibited, closing a potential loophole for malicious developers.
Additionally, Apple's rules now more clearly state that any apps facilitating human trafficking or the exploitation of children will not only be pulled from the App Store but will also be "blocked from alternative distribution." This extends Apple's commitment to combat severe criminal activity across its ecosystem.
What This Means for Indian iPhone Users
For Indian iPhone users, these updated policies translate to a safer and more secure App Store environment. With the explicit ban on "nudify" apps and stricter enforcement, users can have greater confidence that the apps they download adhere to ethical content standards and protect against the creation and spread of harmful, nonconsensual AI imagery. It's a welcome move that enhances the overall integrity and safety of the platform for everyone.
