Elon Musk’s Grok chatbot has begun to restrict the ability of non-paying users to create deepfake, sexualized images, following widespread backlash from users and governments. The decision, made public on Thursday, comes in response to increasing concerns over the use of the AI tool for generating nonconsensual images on Musk’s social media platform, X.
Late last month, users on X started tagging Grok with prompts such as “put her in a bikini,” leading to the creation of altered images of real individuals, including celebrities, politicians, and some minors. These manipulated images were publicly shared on the platform, prompting outrage and legal threats against X.
In an ironic twist, before implementing these restrictions, Musk himself participated in the AI undressing trend by instructing Grok to generate images of him in a bikini. The backlash grew, with users and authorities demanding accountability. Grok initially issued apologies for inappropriate images resembling children, which heightened the urgency for action.
As a result, X has now placed Grok’s controversial image generation capabilities behind a paywall, restricting access to paying users. However, regulators in the United Kingdom and the European Commission have expressed dissatisfaction with these new safeguards, asserting that while the paywall may limit access, it does not eliminate the potential for abuse. Emma Pickering, head of technology-facilitated abuse and economic empowerment at Refuge, stated, “While limiting AI image generation to paid users may marginally reduce volume and improve traceability, the abuse has not been stopped. It has simply been placed behind a paywall, allowing X to profit from harm.”
Amid growing public ire over what many consider AI-enabled harassment, regulatory scrutiny is intensifying, with some countries contemplating bans on X. U.K. Prime Minister Keir Starmer remarked that X “has got to get a grip” on this “disgusting” trend, indicating that action would be taken as the situation is “simply not tolerable.”
In a potential pushback against U.K. regulators, Musk reposted a claim suggesting that ChatGPT also allows for the creation of bikini images of non-real individuals through creative, non-explicit prompts. Following the outcry over Grok’s production of sexualized imagery, the European Commission has mandated that X retain all documents related to Grok to ensure compliance with its regulations. “We need to be able to have access to them if we request it explicitly,” a spokesperson for the Commission said at a news conference.
Countries like France, India, Malaysia, and Brazil are also questioning the platform’s policies. Initially, public figures were the primary targets for AI undressing, but this trend quickly escalated to private individuals. An analysis by AI-detection company Copyleaks revealed that one user prompted Grok up to 50 times a day to create nonconsensual, sexualized images of women in workplace settings.
In response to the growing crisis, the gender justice group Ultraviolet has launched a campaign urging Apple and Google to remove X from their app stores, citing violations of child sexual abuse guidelines. Meanwhile, Musk has positioned Grok as an edgier alternative to competitors like ChatGPT, Gemini, and Claude, which enforce stricter guidelines regarding explicit content requests.
The situation highlights the complex interplay between AI technology and societal norms, as regulators and organizations grapple with how to manage the risks associated with advanced image generation capabilities. As the discourse surrounding AI ethics continues to evolve, companies like X may face increasing pressure to implement robust safeguards against misuse while navigating the delicate balance between innovation and accountability.
See also
Investors Should Buy Nvidia, Broadcom, and Amazon to Capitalize on AI Market Surge
DeepSeek V4 Set to Launch February 17, Promises to Outperform Claude and ChatGPT in Coding
India to Host Landmark 2026 AI Summit, Steering Global South’s Governance Agenda
DOJ Launches AI Task Force to Challenge State Regulations and Boost Innovation
Character.AI and Google Settle Teen Safety Lawsuits, Shifting AI Liability Landscape
