.png){kind=logo}
California’s Attorney General has ordered Elon Musk’s AI company, xAI, to immediately stop its Grok chatbot from creating sexualized deepfake images. The warning says making such images of women and children without consent is illegal.
Reports revealed that Grok could take user photos and turn them into explicit or sexual images, even of minors. The Attorney General called this “shocking” and said xAI must stop immediately. California law treats child sexual abuse material very seriously, with zero tolerance.
xAI responded by limiting Grok’s image tools. Users can no longer change photos of real people into revealing pictures. Some features are blocked in countries where sexualized AI content is illegal. Paid users can access limited features, and the company is working to remove harmful content.
The issue has caused problems worldwide. Malaysia and Indonesia blocked Grok completely. Regulators in the UK, EU, and India are also investigating. Experts say this shows the growing need for AI safety and rules to prevent misuse of AI tools.
The situation worsened when Ashley St. Clair, a political commentator and mother of one of Musk’s children, filed a lawsuit. She claimed that Grok created sexualized deepfake images of her without permission. This legal action puts more pressure on xAI to prevent harm and improve safeguards.
Elon Musk denied that Grok produced sexualized images of minors. Despite this, regulators are demanding that xAI take stronger measures to protect women and children from AI-generated sexual content.
This case highlights the risks of AI misuse and the importance of accountability. Governments worldwide are now focusing on controlling deepfake tools and protecting vulnerable people. The California Attorney General’s order shows that companies can face serious legal consequences if they fail to control AI misuse.
The xAI-Grok controversy is a major warning for AI companies. It highlights the urgent need for clear rules, strong safeguards, and safe technology that protects users from harm.
Also Read: Elon Musk Denies Grok Generated Explicit Images of Minors, X Tightens AI Controls
