Apple has updated its App Review Guidelines to combat harmful content and deceptive practices, including AI "nudification" and "bait-and-switch" apps. This move aims to make the App Store safer for users globally.
Apple has updated its App Review Guidelines to strengthen protections against harmful content and deceptive app practices, according to a report by 9to5Mac. This move comes after several controversies involving apps that skirt the company's rules, potentially exposing users, including minors, to inappropriate material.
Over the past year, reports have highlighted various issues. In January, the Tech Transparency Project (TTP) identified dozens of AI-powered "nudify" apps on the App Store. A follow-up investigation in April revealed that even Apple's search suggestions and advertisements were directing users to such apps.
In July, San Francisco officials ordered Apple to remove eight apps capable of generating nonconsensual intimate imagery. Around the same time, a 9to5Mac investigation uncovered gambling platforms disguised as simple games and utilities. Many of these apps were available to children and revealed hidden betting capabilities when accessed from Brazilian IP addresses, even though they behaved as advertised outside Brazil.
The Grok controversy also played a part. Elon Musk's AI chatbot was reportedly used to generate nonconsensual sexualized images of women and minors, prompting lawmakers and advocacy groups to call for the removal of X and Grok from the App Store. Apple later confirmed it had privately warned xAI that Grok could be removed unless the company addressed the issue.
Now, Apple is attempting to address these problems with specific updates to its guidelines. Under Section 1.2, which covers user-generated content, the rules now explicitly state that developers who fail to implement appropriate safeguards or fix identified violations after notice may be considered in breach of the Developer Code of Conduct. This is a significant step towards holding developers accountable for content generated within their apps.
Another important change targets "bait-and-switch" apps. Apple explains these apps misrepresent their purpose during review, only to reveal harmful capabilities, such as "nudification," after approval. The updated Section 2.3.1 now makes the prohibition on hidden functionality more explicit. It specifically calls out code obfuscation and warns that violations can lead to an app's removal and the termination of the developer's account. This clarifies Apple's stance and gives them stronger grounds to act against such deceptive practices.
Finally, under Section 5 (Legal), Apple has tightened its language around apps facilitating human trafficking or the exploitation of children. The guidelines now explicitly state that such apps "will be removed from the App Store and blocked from alternative distribution." This reinforces Apple's commitment to protecting vulnerable users.
For Indian users and developers, these updated guidelines mean a push for a safer and more transparent App Store environment. While the source details incidents primarily in the US and Brazil, the App Store is a global platform. These changes apply worldwide, meaning fewer harmful AI-generated content apps and deceptive practices should theoretically make their way onto devices here in India. Developers in India will need to be extra vigilant in ensuring their apps comply with these strengthened rules to avoid account termination.
This move by Apple reflects a growing concern about AI-generated harmful content and app developer ethics. It's a clear signal that the company is taking a more proactive approach to policing its platform, aiming to ensure trust and safety for its vast user base.
