Indonesia has become the first country to block Elon Musk’s Grok chatbot over concerns that the artificial intelligence tool is being used to generate non-consensual sexual deepfake images, including explicit depictions of women and children.
Authorities said the move was taken to protect citizens from what they described as a rapidly growing form of digital harm. In a statement, Indonesia’s Minister of Communication and Digital Affairs, Meutya Hafid, said the government was responding to the spread of non-consensual sexual deepfakes, calling the practice “a serious violation of human rights, dignity, and digital security.”
Hafid added that the government had temporarily blocked access to Grok to safeguard women, children, and the wider public from the risks posed by AI-generated pornographic content.
The decision comes amid rising global concern over Grok’s integration into Musk’s social media platform X, where users have been able to generate AI-altered or entirely fabricated images by tagging the chatbot in posts. In recent weeks, the platform has been flooded with manipulated images, many involving partially unclothed women and minors.
The Internet Watch Foundation has warned that criminal actors are already exploiting the tool to create child sexual abuse material. Following public backlash, X limited AI image generation to paying subscribers and introduced identity verification requirements, though critics argue these measures are insufficient.
Indonesia, which enforces strict online obscenity laws, summoned representatives of X after ordering the temporary block. Elsewhere, the UK government is also considering action, with media regulator Ofcom reviewing whether the platform is in breach of the Online Safety Act.
Technology Secretary Liz Kendall said she would support Ofcom if it chose to block X entirely, describing the manipulation of sexual images involving women and children as “despicable and abhorrent.” Under UK law, Ofcom can seek a court order to prevent companies from hosting or monetising X if it fails to comply with safety regulations.
Elon Musk has dismissed the criticism, arguing that his opponents are using the issue as a pretext for censorship. In one controversial post, he shared an AI-generated image of Prime Minister Sir Keir Starmer in a bikini, claiming efforts were being made to suppress free speech.
Reports from late December suggest Grok was producing degrading image edits at an alarming rate, with users instructing the chatbot to generate explicit scenarios. Although full image generation is now restricted to paid users, free users can still manipulate images using X’s editing tools and Grok’s standalone website.
In response, X’s Safety account stated that the platform removes illegal content, permanently suspends offending accounts, and cooperates with governments and law enforcement where necessary. It added that users who prompt Grok to create illegal material will face the same consequences as those who upload such content directly.
