European Union regulators have launched a new investigation into X, probing whether its AI chatbot Grok failed to prevent the creation and spread of illegal deepfake content, including material involving children.
The probe, as confirmed by the European Commission, focuses on how risks linked to Grok were identified and mitigated after its rollout across the EU’s 27 member states.
According to Bloomberg, regulators are assessing whether Grok generated or amplified non-consensual sexual imagery that may meet the legal definition of child sexual abuse material. Such content would constitute a serious breach of EU law.
Henna Virkkunen, the EU’s commissioner for technology and digital policy, said sexualized deepfakes represent a severe violation of personal dignity. She described deepfakes involving women and minors as an extreme form of online abuse that requires firm regulatory action.
The EU Digital Services Act establishes mandatory requirements that large platforms must follow to identify, assess, and eliminate systemic dangers that stem from illegal and dangerous content.
Companies found in violation can face penalties of up to six percent of their global annual revenue.
Also Read: Elon Musk’s xAI Hires Hindi & Bengali Speakers, Offers Up to $65/Hour to Localize Grok AI
The United Kingdom media regulator Ofcom has started an investigation to determine whether X violated the Online Safety Act. Authorities in France and India have both expressed their concerns about Grok creating sexualized images without obtaining permission from the involved parties.
Child safety groups have warned that poorly governed generative AI tools could accelerate the spread of harmful imagery faster than platforms can control.
X, which is owned by Musk’s AI firm xAI, says it takes illegal content seriously and removes prohibited material while cooperating with law enforcement. The company has not yet issued a detailed response to the latest EU action.
The Grok inquiry follows an earlier €120 million DSA penalty imposed on X last year, deepening tensions between Brussels and Washington over tech regulation and free speech.