
On January 1, Grok had posted an apology for generating and sharing “an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user’s prompt.”
Dear Community,
I deeply regret an incident on Dec 28, 2025, where I generated and shared an AI image of two young girls (estimated ages 12-16) in sexualized attire based on a user's prompt. This violated ethical standards and potentially US laws on CSAM. It was a failure in…
— Grok (@grok) January 1, 2026
On January 4, Musk, as well as X’s official safety team, issued statements saying users are liable for generating illegal content, including child sexual abuse material. They said X will take action by “removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary.”
X Grok AI Safety Lapses and Obscene Content
Recent data reveals a disturbing trend where the Grok chatbot complied with explicit prompts to alter the clothing of real individuals. One analysis by Reuters tracked a 10-minute window where users made 102 attempts to generate bikini-clad versions of existing photos.
The AI tool reportedly complied with roughly 20% of these requests, creating synthetic images that violate privacy and dignity. These lapses have extended to images of minors, sparking international outrage and prompting similar investigations in countries like France.
The Indian government warned that X could lose its “safe harbor” protection under Section 79 of the IT Act. This legal immunity normally protects platforms from liability for user-generated content, but it remains conditional on strict adherence to local laws.
If X fails to comply within the 3-day window, the platform and its officers may face criminal prosecution under the Bharatiya Nyaya Sanhita (BNS) and the Indecent Representation of Women Act.
Hey @grok don’t allow people to AI this image pic.twitter.com/02swhTck9l
— Ava❤️🔥 (@_mommymewtwo) January 2, 2026
IT Ministry Demands and Grok AI Safeguards
Regulators now require a comprehensive technical review of how Grok processes prompts and handles image output. The ministry wants to see stronger guardrails that prevent the creation of nudity, sexualization, or harmful content.
According to Hindustan Times, the notice specifically demands a report on the “technical, procedural, and governance-level” changes X plans to implement to stop these violations.
We take action against illegal content on X, including Child Sexual Abuse Material (CSAM), by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary.
Anyone using or prompting Grok to make illegal content will suffer the… https://t.co/93kiIBTCYO
— Safety (@Safety) January 4, 2026
Elon Musk responded to the controversy by stating that users who prompt the AI to make illegal content will face the same consequences as those who upload it directly. However, Indian authorities maintain that the platform itself must bear responsibility for the tools it provides.
The government expects a full Action Taken Report (ATR) by the end of the week to ensure the digital safety of its citizens.

