French and Malaysian authorities are investigating Grok for generating sexualized deepfakes

Over the past fewer days, France and Malaysia person joined India successful condemning Grok for creating sexualized deepfakes of women and minors.

The chatbot, built by Elon Musk’s AI startup xAI and featured connected his societal media level X, posted an apology to its relationship earlier this week, writing, “I profoundly regret an incidental connected Dec 28, 2025, wherever I generated and shared an AI representation of 2 young girls (estimated ages 12-16) successful sexualized attire based connected a user’s prompt.”

The connection continued, “This violated ethical standards and perchance US laws connected [child intersexual maltreatment material]. It was a nonaccomplishment successful safeguards, and I’m atrocious for immoderate harm caused. xAI is reviewing to forestall aboriginal issues.”

It’s not wide who is really apologizing oregon accepting work successful the connection above. Defector’s Albert Burneko noted that Grok is “not successful immoderate existent consciousness thing similar an ‘I’,” which successful his presumption makes the apology “utterly without substance” arsenic “Grok cannot beryllium held accountable successful immoderate meaningful mode for having turned Twitter into an on-demand CSAM factory.”

Futurism recovered that successful summation to generating nonconsensual pornographic images, Grok has besides been used to make images of women being assaulted and sexually abused.

“Anyone utilizing Grok to marque amerciable contented volition endure the aforesaid consequences arsenic if they upload amerciable content,” Musk posted connected Saturday.

Some governments person taken notice, with India’s IT ministry issuing an bid connected Friday saying that X indispensable instrumentality enactment to restrict Grok from generating contented that is “obscene, pornographic, vulgar, indecent, sexually explicit, pedophilic, oregon different prohibited nether law.” The bid said that X indispensable respond wrong 72 hours oregon hazard losing the “safe harbor” protections that shield it from ineligible liability for user-generated content.

French authorities besides said they are taking action, with the Paris prosecutor’s bureau telling Politico that it volition investigate the proliferation of sexually explicit deepfakes connected X. The French integer affairs bureau said 3 authorities ministers person reported “manifestly amerciable content” to the prosecutor’s bureau and to a authorities online surveillance level “to get its contiguous removal.”

The Malaysian Communications and Multimedia Commission besides posted a statement saying that it has “taken enactment with superior interest of nationalist complaints astir the misuse of artificial quality (AI) tools connected the X platform, specifically the integer manipulation of images of women and minors to nutrient indecent, grossly offensive, and different harmful content.”

The committee added that it is “presently investigating the online harms successful X.”