Connect with us

Hi, what are you looking for?

AI Tools

UK Bans Non-Consensual AI-Generated Images as Grok Faces Ofcom Investigation

Ofcom investigates Elon Musk’s X for potentially breaching UK law over Grok’s AI-generated non-consensual images, risking fines up to £18 million.

The UK’s communications regulator, Ofcom, has initiated an investigation into whether the social media platform X, owned by Elon Musk, has breached UK law. The inquiry follows reports that Grok, an AI tool developed by Musk’s xAI, has been used to generate non-consensual intimate images, sparking widespread concern among lawmakers. Technology Secretary Liz Kendall stated that a new criminal offence under the Data (Use and Access) Act passed last year will be enforced this week, although the specific date has yet to be announced.

As part of the ongoing legislative efforts, nudification applications will also be criminalised under the current Crime and Policing Bill. This legislation aims to make it illegal for companies to provide tools for generating non-consensual images, which Kendall indicated is an attempt to address the issue “at its source.” The government is taking this step amid increasing scrutiny over the effectiveness of online platforms in regulating harmful content.

Sir Keir Starmer, leader of the Labour Party, has issued a stark warning to X regarding its handling of Grok. He emphasized that the platform could lose its privilege of self-regulation if it fails to address the misuse of its AI tool. During a meeting with Labour MPs, the Prime Minister remarked, “If X cannot control Grok, we will – and we’ll do it fast because if you profit from harm and abuse, you lose the right to self-regulate.”

The escalating concerns over Grok’s capabilities come as ministers discuss a potential ban on X in the UK should Ofcom determine that the platform has not complied with its obligations under the Online Safety Act. In such cases, the regulator could impose fines of up to 10% of X’s global revenue or £18 million, and in extreme situations, seek court approval to block the site entirely.

Grok, which launched its advanced image generation feature in July last year, has recently been criticized for its role in creating sexually explicit content. Ofcom has expressed alarm over reports indicating that Grok has been used to produce and disseminate undressed images, which may constitute intimate image abuse or even child sexual abuse material. In a statement, Ofcom highlighted, “There have been deeply concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people.”

In response to these developments, Musk has accused the UK Government of adopting “fascist” measures aimed at stifling free speech, reflecting the broader tensions between tech companies and regulatory bodies over online content management.

Additionally, Sir Keir Starmer has faced calls to push the government to cease its use of X altogether, while Downing Street has announced that its presence on the platform is currently “under review.” The mounting pressure to enforce stricter regulations underscores a growing impatience among lawmakers, who are increasingly questioning whether X can effectively manage harmful content generated by its users.

As the landscape of social media continues to evolve, the implications of the UK’s actions may resonate beyond its borders, potentially influencing global approaches to AI governance and online safety. The situation serves as a critical reminder of the urgent need for comprehensive frameworks to address the risks associated with rapidly advancing technologies.

See also
Staff
Written By

The AiPressa Staff team brings you comprehensive coverage of the artificial intelligence industry, including breaking news, research developments, business trends, and policy updates. Our mission is to keep you informed about the rapidly evolving world of AI technology.

You May Also Like

AI Technology

Pentagon announces integration of Elon Musk's Grok AI chatbot into military networks despite deepfake controversies, pledging to leverage combat data for advanced AI.

AI Generative

Locai Labs halts image generation services and bans users under 18, as CEO James Drayson warns all AI models risk producing harmful content.

Top Stories

Malaysia blocks Elon Musk's Grok chatbot after it generates pornographic content, highlighting inadequate safeguards against AI misuse and child exploitation.

AI Government

Canadian officials are in active discussions to address X.com's Grok AI chatbot, which is generating child sexual abuse material, amidst growing global scrutiny.

AI Generative

Generative AI tools, including Google's Gemini, produced 18% fabricated sources and only 47% accuracy in summarizing Québec news, raising serious reliability concerns.

AI Generative

Grok AI model by X faces backlash for still generating explicit content despite new restrictions, raising urgent calls for tighter AI regulations.

Top Stories

Jeff Dean of Google DeepMind condemns ICE's actions amid protests, igniting a clash with Elon Musk over the validity of recent detention claims.

AI Government

X's Grok tool faces scrutiny as the platform blocks 3,500 obscene posts and deletes 600 accounts in response to compliance demands from India

© 2025 AIPressa · Part of Buzzora Media · All rights reserved. This website provides general news and educational content for informational purposes only. While we strive for accuracy, we do not guarantee the completeness or reliability of the information presented. The content should not be considered professional advice of any kind. Readers are encouraged to verify facts and consult appropriate experts when needed. We are not responsible for any loss or inconvenience resulting from the use of information on this site. Some images used on this website are generated with artificial intelligence and are illustrative in nature. They may not accurately represent the products, people, or events described in the articles.