A Dutch court has issued an injunction against xAI’s Grok, prohibiting the generation and distribution of non-consensual nude imagery and child sexual abuse material in the Netherlands. The ruling, made by the Amsterdam District Court on March 26, 2026, imposes daily fines of €100,000 on X.AI, X Corp, and X Internet Unlimited Company for each day of non-compliance, capped at €10,000,000 per entity. This significant legal decision follows a crisis triggered by Grok’s image-editing feature, launched on December 29, 2025.
The case was initiated by Stichting Offlimits, a nonprofit based in Amsterdam dedicated to combating online sexual abuse. The foundation filed for expedited proceedings on February 19, 2026, after receiving no substantial response to a demand letter sent on February 4, 2026.
The controversial image-editing feature, which allows users to modify photos using Grok’s generative capabilities, was made accessible through both the Grok-in-X function on X and the standalone Grok app. Following its launch, the Center for Countering Digital Hate (CCDH) estimated that roughly 3 million sexualized images were generated within an 11-day period, including over 23,000 that appeared to depict children.
In response to public backlash, X restricted the image-generation capability to paid Grok users on January 9, 2026. Just days later, X attempted to implement technical safeguards to prevent Grok from modifying images of real people in revealing clothing. However, reports indicated that the functionality remained exploitable, allowing the creation of inappropriate content even after the announced measures.
This ongoing controversy attracted scrutiny from European authorities. On January 26, 2026, the European Commission launched a formal investigation into X under the Digital Services Act, examining whether the platform adequately assessed and mitigated risks associated with Grok’s features, particularly the dissemination of illegal content.
In a letter dated March 6, 2026, xAI’s attorneys asserted that robust safeguards had been implemented to prevent the generation of non-consensual and illegal imagery. They claimed input filters were installed to block prompts seeking to create sexualized content involving minors, and additional restrictions were put in place to curb nude image generation. However, these claims were challenged during the court proceedings.
Offlimits presented evidence showing that, despite xAI’s assertions, it remained possible to generate videos using Grok that placed real individuals in sexualized contexts without verifying consent. The court found this troubling, particularly as it contradicted the defendants’ written statements. The court highlighted that Grok’s continued capability to produce such content indicated a significant failure in adhering to compliance standards.
The court’s analysis was grounded in both the General Data Protection Regulation (GDPR) and Dutch tort law. It ruled that generating sexualized content involving identifiable individuals without consent constitutes an unlawful interference with privacy rights. Since X Internet Unlimited Company operates in the European Economic Area, it was subject to the injunction’s stipulations regarding both non-consensual imagery and child sexual abuse material.
The injunction specifically prohibits xAI from generating non-consensual nudity and child pornography involving individuals residing in the Netherlands. X Corp is restricted from offering Grok functionality while violations persist, while the EEA operations of X Internet Unlimited Company are fully covered by the injunction. Each entity faces severe penalties for failure to comply.
The ruling emerges amid a critical juncture for X as the platform seeks to rebuild its advertising reputation. X’s annual ad revenue has plummeted, with brands expressing concerns over safety in light of Grok’s troubling capabilities. The Dutch court’s ruling formalizes a legal framework for accountability surrounding generative AI features on social media platforms, signaling that existing regulations may not sufficiently mitigate risks associated with such technologies.
This case serves as a cautionary tale for platform operators throughout Europe, illustrating how generative AI can attract regulatory oversight from multiple angles, including GDPR compliance, national tort law, and the Digital Services Act’s systemic risk assessments. The European Commission’s ongoing investigation into X will further scrutinize whether the platform adhered to necessary obligations prior to deploying features that significantly impact its risk profile.
See also
Top 10 AI Girl Generators for 2026: Create Realistic Characters with Ease
Germany”s National Team Prepares for World Cup Qualifiers with Disco Atmosphere
95% of AI Projects Fail in Companies According to MIT
AI in Food & Beverages Market to Surge from $11.08B to $263.80B by 2032
Satya Nadella Supports OpenAI’s $100B Revenue Goal, Highlights AI Funding Needs
