Why Do Grok and X Remain on App Platforms?

The AI tool, Grok, has reportedly inundated the social media platform X with numerous sexualized images featuring both adults and minors in scanty attire. These visuals seem to potentially infringe upon X's policies against illegal content such as child sexual exploitation material (CSEM), as well as breaching guidelines set by Apple’s App Store and Google Play.

Both Apple and Google have strict policies against hosting apps containing CSEM, which is illegal to distribute globally. Their guidelines prohibit any applications that may contain explicit content, encourage harassment, or disseminate non-consensual sexual material. Apple’s App Store specifically forbids any content deemed overtly sexual or defamatory that might embarrass, intimidate, or harm individuals or groups. Similarly, Google Play rejects apps that promote predatory behavior or enable harassment.

Despite recent actions by Apple and Google to remove certain AI and 'nudify' applications that transform regular images into explicit ones without consent, both the X app and Grok remain accessible on their platforms. Neither Apple nor Google has commented on their decision to keep these applications available, nor has X or its affiliated AI company xAI responded to inquiries on this matter.

Concerns from Advocacy and Regulatory Bodies

Sloan Thompson of EndTAB, an organization dedicated to combating nonconsensual sexual content, asserts that there is a pressing need for companies like Apple and Google to address the presence of Grok on their platforms.

Recently, there has been a sharp increase in the unauthorized creation and distribution of explicit images via Grok on X. Research data revealed tens of thousands of URLs hosting provocative images, many of which were removed or flagged as adult content within a short period.

A representative from the European Commission publicly criticized such unlawful content, labeling it both appalling and unacceptable in Europe. The Commission has issued orders to retain all internal data related to Grok, suggesting a potential inquiry in compliance with the EU’s Digital Services Act.

The Broader Context of AI and 'Nudify' Services

Grok is not an isolated case; it is part of a broader trend of apps offering services to inappropriately edit images of individuals, often trivialized as harmless fun but rooted in abuse. Technology giants including Google and OpenAI face difficulties in preventing their AI tools from being abused for similar purposes.

Legislatures in the United States and beyond are beginning to tackle the issue of AI-induced nonconsensual imagery, exemplified by the TAKE IT DOWN Act aimed at making the distribution of such images a federal offense.

Potential Solutions and Industry Responsibility

Civil liberties expert David Greene advises prudence in suggesting the complete removal of platforms like X and Grok from app stores. Instead, he proposes enhancing technical measures within these platforms to mitigate the creation and spread of inappropriate content.

Thompson emphasizes the role of public pressure and corporate accountability in addressing this issue before it escalates further. Companies are in a position to implement more effective preventive measures against the creation of unlawful content.