The European Commission has launched an investigation into Elon Musk’s X over the manufacturing of sexually express photographs and the spreading of potential youngster sexual abuse materials by the platform’s AI chatbot, Grok.
The formal inquiry, launched on Monday, additionally extends an investigation into X’s recommender techniques, algorithms that assist customers uncover new content material.
Grok has sparked worldwide outrage by permitting customers to digitally strip girls and kids and put them into provocative poses. Grok AI generated about 3m sexualised images in less than two weeks, together with 23,000 that appeared to depict youngsters, in accordance to researchers at the Middle for Countering Digital Hate.
The fee mentioned its investigation would “assess whether or not the firm correctly assessed and mitigated dangers” stemming from Grok’s functionalities in the EU, together with dangers on the sharing of unlawful content material corresponding to manipulated sexually express photographs and “content material which will quantity to” youngster sexual abuse materials.
The investigation has been launched underneath the EU’s Digital Providers Act (DSA), a comparatively new piece of laws that is meant to shield web customers from a variety of harms.
Talking to reporters, an official mentioned the fee had not been satisfied by mitigating measures put in place by X to treatment the problem.
After the preliminary outcry over the manipulated photographs, the firm restricted entry to the software to paid subscribers, however modified tack underneath stress from European regulators. It introduced earlier this month that it had launched measures to forestall Grok from permitting the enhancing of photographs of actual folks in revealing garments.
A fee official mentioned the measures did not take away broader issues about Grok. The investigation is the systemic dangers of the era of unlawful content material, together with content material depicting violence towards girls and youngster sexual abuse materials. X did not have “efficient mitigating measures … to cut back the threat on their platform”, they mentioned.
Asserting the investigation, Henna Virkkunen, the fee’s high official for tech sovereignty, safety and democracy, mentioned: “Non-consensual sexual deepfakes of girls and kids are a violent, unacceptable type of degradation. With this investigation, we are going to decide whether or not X has met its authorized obligations underneath the DSA, or whether or not it handled rights of European residents – together with these of girls and kids – as collateral harm of its service.”
In addition to the investigation into express photographs, the fee is extending an inquiry launched in December 2023 into X’s so-called recommender techniques in view of the firm’s announcement to transfer to a Grok-based mannequin for filtering information and content material to customers.
The transfer comes after the UK media watchdog Ofcom announced its own investigation earlier this month into “vile” and unlawful content material on X.
The fee has been broadly criticised for being too sluggish in imposing the DSA, particularly in relation to X.
“The investigation comes too late, however can nonetheless ship a transparent sign that platforms have to adjust to European regulation,” the German Inexperienced MEP Alexandra Geese mentioned. “This case is clear-cut. The harm to tens of millions of girls and plenty of youngsters is irreparable. We hope that the fee will use this studying to act faster in the future.”
EU officers have rejected such criticism, pointing to 15 ongoing inquiries underneath the DSA, which has utilized to corporations since February 2024.
Regina Doherty, a centre-right Irish vice-president of the European parliament, mentioned she welcomed the formal investigation. “When credible studies emerge of AI techniques being utilized in ways in which hurt girls and kids, it is important that EU regulation is examined and enforced immediately,” Doherty mentioned.
In response to the investigation, X supplied a hyperlink to an announcement it printed on 14 January: “We stay dedicated to making X a protected platform for everybody and proceed to have zero tolerance for any types of youngster sexual exploitation, non-consensual nudity, and undesirable sexual content material.”
Thecommission fined X €120m final month for breaking EU regulation. The platform had deceived customers, obstructed unbiased researchers and evaded accountability,” it mentioned.
The EU regulator mentioned X gave “misleading” blue tick badges to accounts with out verification, probably exposing customers to scams and deception by malicious actors. X additionally broke EU authorized necessities on transparency over promoting by hindering researchers from investigating faux adverts and hybrid menace campaigns.
Musk replied “bullshit” to a fee publish saying the advantageous and later known as for the EU to be abolished.
The corporate was given three months to pay the advantageous. An EU official mentioned they had been assured the penalty can be paid.
Disclaimer: This article is sourced from external platforms. OverBeta has not independently verified the information. Readers are advised to verify details before relying on them.