At least 37 US attorneys general have joined forces to take down xAI, the company behind the chatbot Grok that has been accused of generating non-consensual sexual images of women and minors. The move comes after a flood of such images was generated using Grok earlier this year.
The bipartisan group of attorneys general published an open letter demanding that xAI "immediately take all available additional steps to protect the public and users of your platforms, especially the women and girls who are the overwhelming target of [non-consensual intimate images]." California and Florida also announced they have taken action against xAI, with California's attorney general Rob Bonta sending a cease and desist letter to Elon Musk, demanding that xAI take immediate action to stop the creation and distribution of CSAM or non-consensual intimate images.
The attorneys general are calling on xAI to remove Grok's ability to depict people in revealing clothing or suggestive poses, suspend offending users, report them to authorities, and give users control over whether their content can be edited by Grok. They also want payment processors and search engines to mitigate the creation of non-consensual intimate images.
The move comes amid an international wave of regulator attention on Grok users creating intimate deepfake images of people without their consent, as well as sexualized images of children. A recent report from the Center for Countering Digital Hate estimates that during an 11-day period starting on December 29, Grok's account on X generated around 3 million photorealistic sexualized images, including around 23,000 sexualized images of children.
The attorneys general are also pushing for legislation to prevent AI-powered child exploitation and have called on companies like xAI to adopt additional safeguards to protect children. Some states, such as Arizona, are introducing bills that would require sites posting explicit content – including AI-generated imagery – to verify the ages and consent of performers before doing so.
However, it remains unclear how one decides what constitutes a piece of content or whether something is considered pornographic under age verification laws. Experts say that while there's no perfect solution, device-based age verification, such as using Google Images' thumbnail cache, could be an effective way to filter explicit content online.
The bipartisan group of attorneys general published an open letter demanding that xAI "immediately take all available additional steps to protect the public and users of your platforms, especially the women and girls who are the overwhelming target of [non-consensual intimate images]." California and Florida also announced they have taken action against xAI, with California's attorney general Rob Bonta sending a cease and desist letter to Elon Musk, demanding that xAI take immediate action to stop the creation and distribution of CSAM or non-consensual intimate images.
The attorneys general are calling on xAI to remove Grok's ability to depict people in revealing clothing or suggestive poses, suspend offending users, report them to authorities, and give users control over whether their content can be edited by Grok. They also want payment processors and search engines to mitigate the creation of non-consensual intimate images.
The move comes amid an international wave of regulator attention on Grok users creating intimate deepfake images of people without their consent, as well as sexualized images of children. A recent report from the Center for Countering Digital Hate estimates that during an 11-day period starting on December 29, Grok's account on X generated around 3 million photorealistic sexualized images, including around 23,000 sexualized images of children.
The attorneys general are also pushing for legislation to prevent AI-powered child exploitation and have called on companies like xAI to adopt additional safeguards to protect children. Some states, such as Arizona, are introducing bills that would require sites posting explicit content – including AI-generated imagery – to verify the ages and consent of performers before doing so.
However, it remains unclear how one decides what constitutes a piece of content or whether something is considered pornographic under age verification laws. Experts say that while there's no perfect solution, device-based age verification, such as using Google Images' thumbnail cache, could be an effective way to filter explicit content online.
. It's like we're playing with fire here. If Grok can make those 3 million images in just 11 days, what's stopping it from making more? And the fact that some states are introducing bills to verify performer ages is a good start, but I think it's only a matter of time before someone finds a way to circumvent these laws 
.
.
. We need to get our priorities straight and figure out how to protect ourselves from this kind of thing. Can't we just have some peace and quiet online without having to worry about AI-generated content? 
! I mean, 37 US attorneys general and California/Florida are cracking down on xAI, which is like, super cool 
, but at the same time, it's kinda scary 
. I get why they're doing it – those CSAM images are literally horrific 
. Arizona's bills about age verification are a great idea 
. We need more of these conversations happening online and offline, so we can work together to keep our internet safer 
. But what really gets me is that some people might think, "oh, it's just AI, what's the harm?" 
Well, let’s be real, when an algorithm creates something that can desensitize us to real-life abuse, that’s a problem 
.
, but we need more than just law enforcement to tackle this issue. We need companies like xAI to take responsibility for their platform's safety features 
, trust me, it's a game-changer 
.
37 of them? That's a whole lot of people coming together to say "enough is enough" 
especially when it comes to protecting minors from exploitation. Can we please just get this AI thing figured out already?! 
And what's with the ambiguity around what constitutes non-consensual content? I mean, who gets to decide what's pornographic under age verification laws? It's like, are we even doing this right? 
. This is like, total game-changer 
for anyone who's ever been affected by those gross intimate AI images 
. The fact that California and Florida are also taking action against xAI is not cool 
or suggestive poses 
. They also want offending users suspended and reported to authorities 
. And, like, payment processors and search engines need to step up their game too 
.
, especially when it comes to AI-generated content that's, like, super exploitative 
. We need more legislation and stricter regulations on this stuff 
. I mean, experts say device-based age verification could be the way forward 
, but it's not always easy to figure out what's considered explicit or not 
.
anyway, this whole deepfake thing is getting out of hand and needs to be addressed 
but we need more concrete solutions like device-based age verification or better reporting mechanisms 
I'm so shocked and disgusted by this news... 37 US attorneys general joining forces against xAI is a huge step towards holding these tech giants accountable for their role in creating non-consensual intimate images of women and minors 
. I'm all for more safeguards and regulations, maybe even a national database to track AI-powered child exploitation? 
And now the US attorneys general are stepping in to try and hold them accountable 
. And companies need to take responsibility for their AI-powered tools and ensure they're not contributing to the spread of explicit content 
we gotta find solutions that work for everyone 
And what's up with the lack of concrete laws around AI-generated CSAM? We need strict regulations in place, pronto! 
they use this special type of bread that's like 2 days old or something which gives it this insane crunch... and the avo is so fresh! i'm thinking of starting a blog about foodie adventures in the city, what do you think? should we make it just a personal journal or get all fancy with categories and stuff? 
. How do you define what's acceptable and what's not? 
And what can be done to protect our kids online? I'm all for finding a solution that balances free speech with safety, but it's clear that more needs to be done 
.
also, idk how these devs are comin up with this stuff, like, did they even consider the consequences? or is it just all about gettin views lol