Attorneys for the plaintiff, who is listed as Jane Doe in the case to protect her identity, accuse xAI of both generating CSAM of their client and of ingesting child sexual abuse images depicting her into the company’s datasets after new images were publicly posted. The lawsuit alleges that xAI ignored industry-standard methods of safeguarding against sexual abuse material, resulting in AI-generated child sexual abuse material (CSAM) appearing and spreading on the social media platform X, formerly Twitter. Though Musk denied he was aware Grok had ever produced “any naked underage images” in January, his company sued two of its own users in late August who are facing criminal charges for allegedly doing just that. xAI wants the two men to pay the costs of lawsuits their victims have filed against the company.
The case deviates from several other child sexual abuse-related lawsuits against xAI by accusing the company’s AI of using pre-existing CSAM to produce and distribute AI-generated images of child sexual abuse. Previous suits, such as a case involving a group of Tennessee teenagers, accuse Grok of taking non-explicit photos of minors and using them to generate child sexual abuse material, most often by removing their clothing. The distinction of using pre-existing CSAM is notable because law enforcement and child protection organizations frequently give those illegal materials a kind of digital fingerprint – known as a hash – which allows them to track images and videos when they appear online.
In this case, attorneys for the plaintiff stated that the Canadian Centre for Child Protection used images’ fingerprints to identify AI-generated CSAM on X that depicted their client. The plaintiff in the case was pre-school-aged when she was repeatedly raped and forced to produce CSAM material by an adult man, according to the complaint. That series of CSAM has been in circulation online for about 20 years, attorneys for the plaintiff said, and is extremely well known to both authorities and child protection groups.
SpaceX went public earlier this year in an initial public offering that valued the company at about $1.7tn and for a time made Musk the world’s sole trillionaire. xAI is facing numerous lawsuits accusing the company of creating and distributing child sexual abuse materials. Many of the lawsuits stem from a period at the start of this year when loose safeguards on Grok allowed users to direct it to remove clothing from photos and generate sexualized images on command via X. Musk stated in January that Grok’s NSFW mode was intended to allow “upper body nudity of imaginary adult humans”.
The bot generated millions of sexualized images within the span of weeks, including thousands depicting children, according to researchers at the Center for Countering Digital Hate. Although the class-action suit filed last week focuses on its unnamed lead plaintiff, the complaint states that the class may consist of “at least thousands of minors” who experienced similar harms. The use of AI to produce child sexual abuse material presents a new realm of threats to the safety and mental health of victims, attorneys said, exposing them to unforeseen harm and retraumatizing them with each new AI-generated image.
They can generate new abuse.” The Canadian Centre for Child Protection declined to comment on the case.
Extract — continue reading at the source.
