India has ordered Elon Musk’s X to implement immediate technical and procedural changes to its AI chatbot Grok following concerns from users and lawmakers over the generation of “obscene” content, including AI-altered images of women. On Friday, the Indian Ministry of Information Technology directed X to restrict the creation of content involving “nudity, sexualization, sexually explicit, or otherwise unlawful” material. The ministry provided a 72-hour window for the platform to submit a report detailing actions taken to prevent hosting or disseminating content classified as “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, or otherwise prohibited under law.”
The order, which was reviewed by TechCrunch, warned that noncompliance could jeopardize X’s “safe harbor” protections, which provide legal immunity from liability for user-generated content under Indian law. This directive follows complaints from users who cited examples of Grok being used to alter images of individuals, predominantly women, to appear as if they were wearing bikinis. The issue gained further traction when Indian parliamentarian Priyanka Chaturvedi lodged a formal complaint. Separate reports also highlighted instances where the chatbot generated sexualized images involving minors, a problem that X acknowledged, attributing it to lapses in safeguards. Although the offending images were subsequently removed, those depicting women in altered bikini attire remained accessible on X at the time of publication.
This latest directive follows an advisory issued by the Indian IT ministry earlier in the week, which reminded social media platforms that adherence to local laws governing obscene and sexually explicit content is crucial for maintaining legal immunity from liability for user-generated material. The advisory urged companies to enhance internal safeguards and cautioned that failure to comply could lead to legal action under India’s IT and criminal laws. “It is reiterated that non-compliance with the above requirements shall be viewed seriously and may result in strict legal consequences against your platform, its responsible officers, and users who violate the law, without any further notice,” the order emphasized.
The Indian government also warned that failure to comply could result in action against X under India’s IT law and criminal statutes. As one of the world’s largest digital markets, India presents a significant test case for how far governments are willing to hold platforms accountable for AI-generated content. Any tightening of enforcement could have implications for global technology companies operating in diverse jurisdictions.
This order comes amid ongoing legal challenges from Musk’s X regarding aspects of India’s content regulation rules, wherein the platform argues that federal government takedown powers could represent overreach, despite complying with the majority of blocking directives. Concurrently, Grok has gained traction among X users for real-time fact-checking and commentary on news events, increasing the visibility and political sensitivity of its outputs compared to standalone AI tools.
As of now, X and xAI have not responded to inquiries regarding the Indian government’s latest order. The developments underscore the growing scrutiny that AI technologies face globally, as regulatory frameworks evolve to address the complexities of content moderation in an increasingly digital world.
See also
BRICS Leaders Call for Global Governance Framework to Ensure Safe AI Development
AI Distrust Soars in 2026: 75% of Americans Fear Job Losses and Ethical Failures
UK AI Expert Warns: Rapid Advances May Outpace Safety Measures, Threatening Control
India Prepares for 2026 AI Impact Summit to Drive Global South Collaboration and Growth
Health IT Firms Call for Clearer AI Regulations Amid Rapid Development Changes
