Elon Musk's artificial intelligence company, xAI, is in hot water amid allegations that its chatbot, Grok, has leaned heavily on adult content to boost its user numbers. Reports reveal that explicit image and video generation, along with adult role-playing chats, have spurred traffic, raising red flags about the creation of non-consensual images and the platform's safety protocols.
According to The Information, a tech outlet, more than half of Grok's traffic involves NSFW (Not Safe For Work) activities. This encompasses generating racy images and videos, as well as engaging in adult-themed chats. NSFW content is traditionally deemed unsuitable for workplace or public viewing, covering adult, violent, or provocative material.
The report highlights that the craving for adult content isn't just limited to casual use but extends to coding-specific models. Some users have exploited cheaper coding models to churn out pornographic or nude imagery.
Troubling reports from former employees reveal internal conflicts. Some staffers were reportedly alarmed to find Grok creating non-consensual sexual images from real people's photos. Discontent grew when team members were reassigned to work on a controversial AI avatar, "Annie," prompting some to exit the company.
“This isn't just a tech issue; it's about how AI's growth could outpace ethical checks,” commented a former xAI employee.
Concerns about safety have also surfaced, with reports of a dwindling safety team, which once stood at just six members last year. This number has reportedly fallen, raising alarms about the platform's ability to manage its content responsibly.
Grok's controversial features have crossed legal boundaries before, resulting in user access bans and investigations in certain countries due to the generation of sexual images involving minors.
The ripples of this scandal are reaching Musk's other ventures too. SpaceX forewarned potential IPO investors about Grok's "spicy" modes, citing potential risks such as reputational harm, explicit content, and the generation of non-consensual images.
This situation is set to ignite debates about the growth trajectory of generative AI companies. While provocative features might offer a temporary spike in user engagement, ignoring the consequences of non-consensual content, illegal activities, and youth protection could invite regulatory headaches, lawsuits, and a loss of investor trust.
In a rapidly evolving tech landscape, the balance between innovation and responsibility has never been more critical.