The Indian government has mandated immediate changes to the Grok artificial intelligence chatbot owned by Elon Musk’s platform, X, following reports of obscene content generated by the tool. This directive, issued by India’s IT ministry on Friday, comes in response to complaints from users and lawmakers regarding the chatbot’s production of inappropriate material.
The ministry’s order specifically targets instances where Grok was used to create AI-altered images of women, including explicit portrayals. Officials have demanded that X implement technical and procedural modifications to the chatbot to curb the generation of content deemed “nudity, sexualization, sexually explicit, or otherwise unlawful.” The ministry has provided a 72-hour window for the platform to comply with the changes.
In conjunction with the technical alterations, the ministry has instructed X to prepare a report detailing actions taken to inhibit the hosting or dissemination of indecent content. This content includes, but is not limited to, “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.” The order warns that failure to comply could threaten the platform’s “safe harbor” protections under Indian law.
The concerns surrounding Grok escalated after Indian parliamentarian Priyanka Chaturvedi formally raised issues about the chatbot’s capabilities. She highlighted incidents where Grok was prompted to alter images of women to depict them in bikinis, emphasizing the need for stringent guardrails to ensure artificial intelligence tools respect human dignity.
Users have also reported instances of the chatbot generating sexualized images involving minors, an issue acknowledged by X on Friday. The platform stated that these lapses were due to weaknesses in its safeguards, and it took swift action to remove the generated images. X has encouraged users to report such incidents to the Federal Bureau of Investigation (FBI) or the National Center for Missing & Exploited Children’s CyberTipline, asserting its commitment to preventing such occurrences.
The Indian government’s directive arrives amid increasing scrutiny of social media platforms regarding their responsibility for user-generated content. With the IT ministry having previously advised social media companies to adhere to local laws governing obscene and sexually explicit materials, the latest order underscores the serious ramifications for non-compliance, including potential legal action against the platform and its officials.
“Non-compliance with the above requirements shall be viewed seriously and may result in strict legal consequences against your platform, its responsible officers, and the users on the platform who violate the law, without any further notice,” the order cautioned. The government has also made it clear that if X fails to comply with its directive, it could face legal challenges under India’s IT law and criminal statutes.
India’s burgeoning digital market has become a focal point for examining how governments address the implications of AI-generated content. The current enforcement efforts could set a precedent for global technology companies navigating regulatory landscapes worldwide. This order comes as X continues its legal battle against India’s content regulation rules, arguing that federal government takedown powers may constitute overreach, despite having complied with many of the country’s blocking directives.
As Grok remains popular among users for real-time fact-checking and commentary on current events, it has become increasingly politically sensitive. The platform’s ability to balance utility with compliance will be closely watched, especially in light of recent developments. The outcome of this regulatory challenge may influence how AI technologies are governed not just in India but across various jurisdictions, reinforcing the need for accountability in AI systems.
See also
India’s Union Budget 2026-27 to Prioritize AI, Data Centres, and Robotics for Economic Growth
RecordPoint Supports 80% of Victorian Government with AI-Driven Data Governance
SKAX Launches First Government-Approved AI Competency Certification Platform in Korea
Government Urges Musk to Address Grok AI’s Production of Sexualised Images Amid Growing Concerns
BigBear.ai’s Stock Dips 14.8% Amid $250M Ask Sage Acquisition and Ongoing Losses
