The popular AI tool Grok is taking a firm stand against the misuse of its image editing capabilities. The platform, managed by X, announced that it will no longer allow the creation of images depicting real people in scanty clothing, such as bikinis. This decision was declared on X's platform, and it impacts all users, including those who are paid subscribers.
"We have taken steps to ensure that Grok does not allow the editing of images of real people and depicting them in revealing clothing, such as bikinis," stated the announcement. This move comes in response to growing concerns over AI-generated content, especially after the California Attorney General revealed an ongoing investigation into sexualized AI deepfakes, some involving children.
Alongside these changes, X is implementing geoblocking to prevent users from creating these types of images in jurisdictions where such activities are illegal. "We are now geoblocking the ability for all users to create images of real people in bikinis, underwear, and similar clothing through the Grok account and Grok on X in jurisdictions where it is illegal," the company declared.
The platform also emphasized that only those with a paid subscription will have the capability to edit images, adding a layer of accountability and security. The company hopes these measures will deter any attempts to use Grok for unlawful purposes or to breach the platform's terms of service.
Despite these restrictions, Grok will still support NSFW content under certain conditions. According to Elon Musk, the tool is designed to enable "topless nudity of imaginary adult people (but not real ones)" within what is acceptable in R-rated movies. "This is the actual standard in the U.S. In other regions, it will vary depending on the legislation of the specific country," Musk explained.
"We are committed to ensuring that our platform is used responsibly and in compliance with local laws," added a spokesperson for X.
The company remains steadfast in its commitment to user safety and compliance with regional laws, as it continues to navigate the complex legal landscape surrounding AI-generated content.