Grok Blockage in Malaysia and Indonesia Amidst Deepfake Crisis

UK Launches Formal Probe Into X Corporation

In the wake of rising concerns about explicit AI-generated deepfakes, Malaysia and Indonesia have taken a significant stand by being the first nations to impose a ban on Grok. The authorities have argued that X’s chatbot lacks adequate mechanisms to thwart the production and distribution of explicit content, specifically targeting women and children. Over the weekend, Indonesia and Malaysia both initiated temporary blocks, as reported by the Associated Press. Concurrently, the UK’s communications authority, Ofcom, has initiated an official inquiry under the stipulations of the Online Safety Act.

Expressing profound concern over non-consensual sexual deepfakes, Indonesia's Communication and Digital Affairs Minister, Meutya Hafid, highlighted the severe breaches of human rights and personal safety in the digital arena. Initial investigations revealed that Grok does not effectively curb users from crafting and disseminating sexually charged deepfakes involving Indonesian citizens. As per Alexander Sabar, Director General of Digital Space Supervision, such deepfakes intrude upon personal image and privacy rights, delivering adverse effects on one's reputation and causing social and psychological distress.

The Malaysian Communications and Multimedia Commission echoed these concerns, citing frequent abuses of Grok’s functionalities to fabricate unauthorized explicit content, often involving women and minors. To lift the embargo, it's imperative for X Corporation and its parent company, xAI, to institute robust security frameworks.

In the UK, Ofcom is tasked with determining whether X Corporation has fulfilled its obligations to shield users from unlawful content. This includes verifying X’s strategies to prevent UK users from accessing illegal materials like CSAM and illicit intimate images, ensuring rapid removal of such content, and evaluating updated risk assessments prior to any major platform changes. The investigation will also assess the risk posed to UK minors and the effectiveness of age verification measures aimed at safeguarding children from accessing adult content.

On January 5, Ofcom reached out to X, receiving a reply by the January 9 deadline. An urgent evaluation of the available evidence is underway, with Ofcom demanding immediate clarification from xAI regarding protective measures for UK users.

Concerns have escalated regarding Grok’s role in facilitating illegal non-consensual intimate content and child abuse material on the X platform, states an Ofcom representative. The assertion is clear: platforms must adhere to legal standards, particularly concerning child safety. The investigation awaits progress, maintained with priority and due diligence to ensure just outcomes. As the UK’s think-tank for online safety regulation, it aims to uphold the integrity and reliability of its legal proceedings.

Should Ofcom find any legal transgressions, it possesses the authority to enforce compliance through specific corrective actions or impose fines up to £18 million, or 10% of global revenue, whichever is greater. Additionally, it may seek judicial intervention to halt financial transactions or advertising collaborations with the non-compliant platform, or even mandate internet service providers to block the site in the UK. The UK government pledges support for any measures decided by Ofcom against X.

As the UK collaborates with international partners on a uniform response to the issue of Grok-generated deepfakes, other nations, such as India and the EU, have also commenced their investigations into X.

Last week, Grok began notifying X users that its image creation tools would be restricted to subscription holders. However, non-subscription users could still generate images via Grok's interface on the X platform.