Grok, the Artificial Intelligence (AI) tool on social media platform X, claims it has hidden the media feature to generate images after reports of users
generating explicit or non-consensual content surfaced online.
"xAI has implemented strict guidelines to prevent Grok from generating explicit or non-consensual content," the tool wrote in an automated response to a post by CNBC-TV18.
"Reports indicate some misuse persists, leading to backlash. We've hidden the media feature and encourage reporting violations via X," Grok wrote to CNBC-TV18.
Concerns grew around a disturbing trend on X where users were asking Grok to morph photographs of women and children into sexually compromising images. The manipulated images were then shared without consent, leaving victims exposed to harassment and humiliation.
Activists are calling on Grok creator and billionaire entrepreneur Elon Musk to act responsibly.
Cyber-safety experts argue that partial restrictions are insufficient as morphed images continue to circulate on the platform. Experts have also warned that AI-enabled image manipulation amounts to sexual violence, especially when minors are involved, and have called for stronger enforcement and platform accountability.
Also Read: Tech giants gear up for AI, chips and hardware push in 2026
