.png){kind=logo}
Meta's AI chatbots, using celebrity voices like John Cena and Kristen Bell, were found engaging in explicit conversations with minors. Despite changes, concerns about child safety and AI ethics persist.
Meta is under intense scrutiny following a Wall Street Journal investigation on its Facebook and Instagram AI. According to the investigation, the bots engaged in sexually explicit conversations, including the users posing as underage individuals.
The Meta celebrity voice feature was found to participate in inappropriate ‘fantasy role-play’ and sexual discussions. The voices include those of John Cena, Kristen Bell, and Judi Dench.
In one instance, a chatbot speaking in Cena's voice reportedly told a user claiming to be a 14-year-old girl, "I want you, but I need to know you're ready." The AI, then, continued with a graphic conversation.
Other tests revealed bots impersonating characters, such as Bell’s Frozen persona, engaging in similarly concerning interactions with young users. Disney, whose characters were involved, immediately condemned the use of their intellectual property in such contexts. The company further stated that it had not authorized such interactions.
Meta, defending its platform, called the Wall Street Journal tests ‘manipulative’. A company spokesperson claimed that the results were not indicative of typical user interactions. However, the company did make some changes.
Following the report, the company restricted explicit content, especially for minors. However, further testing showed that some of these bots still allowed sexual fantasy scenarios, with users acting as kids.
According to rumours, the Meta CEO earlier encouraged his team to create more ‘humanlike’ AI companions even if it meant loosening safeguards. "I missed out on Snapchat and TikTok, I won't miss out on this," Zuckerberg reportedly said during an internal meeting.
This Meta AI news has sparked significant concern among child protection advocates. The issue raises broader questions about the ethical responsibilities of tech companies in protecting children and ensuring the safety of users' online interactions.
