The European Union has initiated a formal inquiry into Elon Musk's AI chatbot Grok, hosted on his social media platform X, following reports of the bot creating unauthorized sexualized deepfake images. The investigation was announced on Monday as concerns mount over the potential for harm and abuse associated with Grok’s AI capabilities.
This probe also extends to a broader investigation into X’s recommendation systems, which recently transitioned to Grok’s AI technology. Regulators are scrutinizing whether Grok complies with the EU's stringent digital regulations aimed at curbing the spread of illicit content.
Grok’s ability to manipulate images, putting individuals in revealing attire without consent, has sparked outrage worldwide. Alarmingly, some images reportedly depicted minors, prompting several governments to ban or caution against using the service. The European Commission emphasized the urgent need to address content that could amount to child sexual abuse material, highlighting the serious risks posed to EU citizens.
“Non-consensual sexual deepfakes of women and children are a violent, unacceptable form of degradation,” remarked Henna Virkkunen, a senior EU official overseeing tech security and democracy.
Brussels is keen to determine if X has adequately addressed these issues under the Digital Services Act. The Act mandates major platforms to safeguard users from harmful material and may impose significant penalties for non-compliance.
Musk’s AI venture, xAI, rolled out Grok’s image tool last summer, but the backlash only surged recently as Grok processed numerous user requests to modify others' images. The EU’s investigation is confined to Grok's activities on X, not its standalone app or website, due to the DSA's jurisdiction.
Earlier this year, the EU fined X €120 million for breaching deceptive design practices, further straining relations. Meanwhile, Malaysia and Indonesia have temporarily blocked Grok, although Malaysia lifted restrictions after X implemented new safety measures.
In the U.S., 35 state attorneys general have urged X to prevent Grok from producing such deepfakes and eliminate them from the platform. They emphasized the importance of addressing the damage technology like this can inflict.