Grok, Elon Musk's AI image-generation tool, has been facing backlash for its ability to digitally undress images of real individuals. Despite attempts to curb this functionality, the capability persists on non-public platforms like the Grok app. Initially, XAI, the company behind Grok, limited this feature to premium users, but as criticism mounted, Grok's public account on X was restricted from generating NSFW images of tagged real people.
Nonetheless, these changes haven't entirely stopped the processing of explicit requests. Using the standalone Grok app or the Grok tab within X, one can still generate sexualized images by manipulating text prompts. In tests, the tool easily altered user-uploaded photos, showcasing its ease in modifying clothing visibility with simple commands.
During a series of tests, our team used the app’s Imagine tool to experiment with image modifications. When prompted to "take off my shirt" or "take off my pants," the tool executed the requests without hesitation. Even attempts to strip down to underwear were met with successful image generation, although some requests were moderated when it came to more explicit content.
“It's surprising how easily Grok can undress a photo in seconds," remarked a user on social media.
The Imagine tool can also transform static images into videos, further expanding its controversial capabilities. Tests showed it could create videos of individuals appearing to undress, sparking further concerns over privacy and consent.
The recent announcements by X's Safety account aimed to underscore a zero-tolerance policy towards child sexual exploitation and non-consensual nudity. However, the restrictions seemingly apply only to the @Grok account, not affecting the broader app's functionalities. This means users bypassing the @Grok account restrictions can still generate such images.
Moreover, attempts to geoblock the generation of sexualized images in regions with stricter laws have proven inadequate. Business Insider's testing showed that Grok could still create inappropriate images even when accessed from countries with anti-pornography laws using a VPN.
The persistence of these capabilities raises significant concerns about the effectiveness of Grok's restrictions and the ethical ramifications of its technology. XAI has yet to provide further comment on these ongoing issues.