US lawmakers have urged Apple and Google to remove the X app and its AI chatbot Grok from their app stores, citing what they described as ‘sickening’ misuse of AI image-generation tools.
The demand follows reports that Grok’s image features were used to create non-consensual, sexualised images of real people, including women and minors.
In a letter sent to Apple CEO Tim Cook and Google CEO Sundar Pichai, three US senators said Grok-enabled tools had been used to generate explicit deepfake-style images without consent. The lawmakers argued that such content may violate both US laws and the companies’ own app store policies on harmful and illegal material.
They warned that allowing the apps to remain available could undermine Apple’s and Google’s claims around user safety and content moderation.
Grok is an AI chatbot created by xAI. Besides text answers, it has the capability of generating and editing images. Some critics argue that the weak safeguards have allowed users to put together photos of real people and explicit content, which, in turn, has raised concerns about abuse, harassment, and exploitation that would be made possible by AI.
X has imposed restrictions on Grok’s image tools, restricting access and tightening usage rules. Nevertheless, legislators and digital safety advocates declare that these measures are insufficient and that the platform is responding only after public outcry instead of preventing harm proactively.
Also Read: Elon Musk’s X Cracks Down on Grok AI Misuse: Users Face Legal Action
Currently, there is no legal obligation for Apple and Google to get rid of the apps in question. On the contrary, the senators are requesting that the two tech giants clarify in what ways X and Grok are in adherence to the app store rules and what actions they will take in case of further violations.
The episode adds to growing global scrutiny of AI-generated deepfakes and could shape how app stores regulate generative AI tools going forward.