Grok Obscene AI Content: Govt Gives X Time Till Jan 7 To Submit Report

 

New Delhi: The government has given X additional time till January 7 to submit a detailed Action Taken Report after it issued a stern warning to the Elon Musk-led social media platform over indecent and sexually-explicit content being generated through misuse of AI-based services like 'Grok' and other tools. The grant of extension came after X sought additional time from the IT Ministry, sources told PTI.

On Sunday, X's 'Safety' handle said it will take action against illegal content on its platform, including Child Sexual Abuse Material (CSAM), by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary.

 

"Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content," it had said, reiterating Musk's stance on illegal content. Government sources said X had sought more time, and now it has been asked to submit its report by January 7.

The Centre on Friday pulled up X and directed it to immediately remove all vulgar, obscene and unlawful content, especially generated by Grok (X's built-in artificial intelligence interface) or face action under the law. The ministry had also asked the US-based social media firm to submit a detailed action taken report (ATR) within 72 hours of the directive (effectively by January 5).

 

The IT Ministry, in its January 2 missive, said that Grok AI, developed by X and integrated on the platform, is being misused by users to create fake accounts to host, generate, publish or share obscene images or videos of women in a derogatory or vulgar manner.

 

"Importantly, this is not limited to creation of fake accounts but also targets women who host or publish their images or videos, through prompts, image manipulation and synthetic outputs," the ministry said, asserting that such conduct reflects a serious failure of platform-level safeguards and enforcement mechanisms, and amounts to gross misuse of artificial intelligence (AI) technologies in violation of stipulated laws.

The ministry said the regulatory provisions under the IT Act and rules were being flouted by the platform, particularly in relation to obscene, indecent, vulgar, pornographic, paedophilic, or otherwise unlawful or harmful content.