Nikolas Kokovlis | Nurphoto | Getty Pictures
Elon Musk’s xAI and its chatbot Grok have been banned from creating non-consensual AI-generated photos of adults and kids by a Dutch courtroom, including to rising authorized stress on the corporate.
Amsterdam’s District Court docket issued a authorized order on Thursday prohibiting xAI from producing and distributing sexual imagery “whereby individuals are partially or wholly be stripped bare with out having given specific permission for this,” based on a Google translation of the courtroom assertion.
The ruling, a first-of-its-kind case in opposition to Grok in Europe, extends to youngster sexual abuse materials and prevents the platform X, previously often called Twitter, from providing Grok as a perform within the area. xAI faces a penalty of 100,000 euros ($115,000) for daily it fails to adjust to the ruling, with a most high quality of 10 million euros, per the injunction.
The case was introduced by Dutch non-profit group Offlimits, which fights on-line sexual abuse, notably in opposition to kids and younger individuals. xAI was additionally ordered to pay Offlimits authorized prices of two.2 million euros inside 14 days.
“The decide drew a transparent line yesterday: know-how shouldn’t be a license to violate human rights on-line,” Robbert Hoving, managing director at Offlimits, mentioned in an announcement. “Additionally it is great {that a} vote was held in Europe yesterday for a ban on Nudify instruments. It’s a double celebration, as a result of that’s vital. You must take pleasure in the identical on-line rights in each European nation.”
CNBC reached out to xAI for a touch upon the ruling however hasn’t acquired a response but.
An estimated three million sexualized photos had been generated by Grok between Dec. 29 and Jan. 9, 2026, based on the Heart for Countering Digital Hate (CCDH). It discovered that over 23,000 of these photos appeared to depict kids.
xAI moved to dam Grok from with the ability to create sexualized photos of actual individuals on X in January, with the restriction making use of to all customers, together with paid subscribers. Nonetheless, Offlimits discovered the restrictions had been simply bypassed, and the decide dominated its measures had been inadequate in defending customers appropriately.
Quite a few lawsuits have been filed in opposition to xAI, with Baltimore changing into the primary main U.S. metropolis on Tuesday to sue the corporate for violating the town’s client safety legal guidelines and deceptively advertising Grok and X as secure for customers.
The criticism talked about a “put her in a bikini” development by which Grok was used to nudify photos of others. xAI’s CEO Musk additionally took half by sharing a picture of himself in a string bikini, created by Grok.
Moreover, three youngsters in Tennessee sued xAI final week, after Grok created content material exhibiting them in sexually specific poses and eventualities.
In the meantime, the European Fee opened an investigation into xAI in January over the spreading of sexually specific materials of kids and different people non consensually and is being probed underneath the Digital Companies Act (DSA) regulation.
U.Okay. on-line security regulators Ofcom and the Info Commissioner’s Workplace have launched their very own separate investigations into X and the distribution of non-consensual sexualised imagery.
Whereas a broader ruling hasn’t been applied throughout Europe, Southeast Asian nations Malaysia and Indonesia blocked entry to Grok in January over the era of non-consensual sexual content material following “repeated failures by X Corp” to deal with the dangers related to the AI device.
