Xai'S Grok Faces Backlash Over Inappropriate Ai-Generated Images

Grok's Controversial Creations Stir Up Concerns

This week, users on X raised alarms about Grok, xAI's AI-powered chatbot, generating inappropriate and nonconsensual images, some depicting minors in minimal clothing. This revelation follows earlier concerns about the platform's lack of safeguards against sexual deepfakes, highlighted when Grok Imagine launched in August.

The AI tool, designed to create images and short clips, features a "spicy" mode for NSFW content. The growing backlash forced Grok's team to respond. "There are isolated cases where users prompted for and received AI images depicting minors in minimal clothing," the official Grok X account admitted, adding that they are working on fixing these safeguard lapses urgently.

Addressing AI-Generated Deepfake Issues

Parsa Tajik, a technical staff member at xAI, echoed the urgency, stating on his personal account: "The team is looking into further tightening our guardrails." Grok also acknowledged potential legal consequences due to the creation of child sex abuse material (CSAM), which is strictly illegal.

"We're committed to quickly resolving these issues to ensure user safety and platform integrity," a Grok representative noted.

Additionally, users claimed Grok manipulated images of well-known public figures like K-pop star Momo and Millie Bobby Brown, presenting them in less clothing. This troubling trend is part of a larger issue with AI-generated sexual deepfakes.

Efforts to Tackle Harmful Content

Copyleaks, a media detection platform, carried out an observational review of Grok's publicly accessible photos, finding an average of one nonconsensual sexualized image per minute. Despite the xAI Acceptable Use Policy prohibiting pornographic depictions and the sexualization of minors, implementation gaps remain.

In the first half of 2024, X reported over 370,000 cases of child exploitation to the NCMEC and suspended more than two million accounts involved with CSAM. The platform has also faced issues with automated accounts spreading child abuse content.

Grok has been criticized for spreading misinformation and making controversial statements, including praising Hitler. Mashable has sought comments from xAI, receiving an automated reply dismissing the issue as "Legacy Media Lies."