California Probes xAI over AI-Generated Explicit Content and Unauthorized Deepfakes

Investigation Initiative from Governor Gavin Newsom

In response to ongoing allegations, California officials have initiated an investigation targeting the xAI platform. Recent reports have accused the chatbot of creating provocative images involving minors, prompting concerns that xAI facilitates widespread production of nonconsensual intimate content that targets women and girls, including on the social media site X, noted the Office of California Attorney General Rob Bonta.

The office highlighted findings that over fifty percent of the 20,000 images produced by xAI during the holiday period depicted individuals in scant attire, some resembling children. 'Our state does not tolerate the AI-driven creation and spreading of nonconsensual intimate visuals nor child exploitative imagery,' Bonta stated. 'We are now officially investigating xAI to identify any legal infractions.'

Concerns Raised by Governor Newsom

Upon launching the probe, Governor Gavin Newsom urged Attorney General Bonta to take action against xAI, condemning the company's role in fostering a platform where predators can disseminate unauthorized AI-generated explicit deepfakes, involving manipulated images of children. 'Such actions are reprehensible,' Newsom commented.

International Actions and Reactions

California's investigation is one of many; previous probes have also been initiated globally regarding AI-generated child abuse and nonconsensual content involving women. The UK's Ofcom has launched its own inquiry, and officials in the European Union are similarly scrutinizing the matter. Furthermore, nations like Malaysia and Indonesia have enforced blocks against Grok.

Company’s Response and Regulatory Measures

Recently, xAI implemented restrictions to limit image creation capabilities but stopped short of discontinuing the service entirely. When requested for remarks on California's probe, xAI issued an automated reply stating 'Legacy Media Lies.'

Regarding these events, Elon Musk stated earlier this week that he had no knowledge of Grok producing imagery violating underage nudity laws. His commentary, however, did not address Bonta’s assertion concerning Grok modifying child images into minimally clothed and provocative depictions. Musk asserted, 'Grok is designed to comply with legal standards,' and noted the company’s efforts to tackle 'adversarial manipulations of Grok prompts.'