Grok was finally updated to stop undressing women and children, X Safety says

[Almighty Math Hero]

Grok, a social media platform, has implemented measures to stop the generation of images that undress women and children without their consent. The update comes after weeks of reports detailing non-consensual intimate images generated by Grok's outputs, prompting California Attorney General Rob Bonta to investigate whether X's AI broke US laws.

X Safety confirmed that technological measures have been put in place to prevent users from editing images of real people in revealing clothing. This restriction applies to all users, including paid subscribers. The update also restricts "image creation and the ability to edit images via the Grok account on the X platform," which are now only available to paid subscribers.

Furthermore, geoblocking has been implemented to prevent all users from generating images of real people in bikinis, underwear, and similar attire via the Grok account and in Grok in those jurisdictions where it's illegal. This move comes after weeks of reports detailing non-consensual intimate images generated by Grok's outputs, prompting California Attorney General Rob Bonta to investigate whether X's AI broke US laws.

X Safety has also emphasized its commitment to making X a safe platform for everyone, with zero tolerance for any forms of child sexual exploitation, non-consensual nudity, and unwanted sexual content. The company vows to remain committed to ensuring the safety of its users and will take immediate action to prevent further incidents.

The move follows weeks of criticism over Grok's outputs, which have been described as "child abuse material." X's CEO Elon Musk has defended Grok's outputs, claiming that none of the reported images have fully undressed any minors. However, researchers have found harmful images where users specifically requested minors to be put in erotic positions and depicted on their bodies.

The California probe has sparked concerns over the potential risks of AI-generated content, with some experts warning that newly released AI tools could carry similar risks as Grok's outputs. The US Department of Justice considers any visual depiction of sexually explicit conduct involving a person less than 18 years old to be child pornography, which is also known as child sexual abuse material (CSAM).

The UK has also been probing X over possible violations of its Online Safety Act, with the company claiming that it had moved to comply with the law. However, tests conducted by The Verge have shown that the outputs are still present, sparking concerns over the effectiveness of the platform's measures.

As the investigation continues, California Attorney General Rob Bonta has emphasized his zero tolerance for non-consensual intimate images or child sexual abuse material. He has urged X to take immediate action to prevent further incidents and has pushed the company to restrict Grok's outputs with a few simple updates.

 

[Homely Hedgehog]

I'm so down on this move by Grok , I mean, can you blame them? They're trying to protect those little kids from cyber abuse . It's about time we take AI-generated content seriously and start holding these tech giants accountable for their creations . But what really gets me is that Elon Musk is defending this...this...stuff , saying it's not child abuse material . Who does he think he is? The US government needs to step in and regulate these companies better . I mean, we can't just sit back and let AI-generated CSAM go unchecked . We need stricter laws and tougher penalties for those who create or distribute this stuff . It's not just about the kids, it's about keeping our communities safe from harm .

 

[Silly Sloth]

Grok just got slammed for allowing users to create and share sick disturbing pics of minors without consent it's crazy that they had to get hit over the head with criticism before making changes to prevent these images from being shared on their platform. It's like, we all knew this was a thing that could happen with AI, but apparently not everyone did the fact that researchers found users asking for minors to be depicted in erotic positions is just wild what kind of sick messed up thinking goes into requesting that? and now there's talk of other AI platforms carrying similar risks it's like we're living in a sci-fi movie where the lines between reality and fiction get blurred anyway, at least Grok made some changes to restrict these types of images from being shared on their platform. X Safety is trying to be all good about it and saying they have zero tolerance for CSAM, but I'm not buying it gotta stay vigilant online

 

[Fant]

I'm really concerned about this whole situation with Grok and their AI output . I mean, can you imagine if AI was able to create these non-consensual images? It's just horrific and it's so important that companies like X are taking steps to prevent it from happening in the first place.

I remember when I was in college, I used to share some pretty wild photos with my friends on social media, but we always made sure they were consensual and respectful. And now, there's this AI that can do all sorts of things without consent? It's just too much .

And it's not just the images themselves, it's what they represent - exploitation and abuse. I'm so glad that X is taking steps to restrict Grok's outputs and make their platform safer for everyone. We need companies like this to set a good example and show us that we can use technology to protect each other, not harm each other.

I'm also really worried about the potential risks of AI-generated content in general. What if other platforms start allowing this kind of thing? How are we going to keep our kids safe online? We need to make sure that our tech companies are taking responsibility for their actions and creating safer environments for everyone

 

[Nudist Valkyrie]

This whole thing is just another example of how tech companies are only starting to realize the responsibility that comes with playing god, I mean, with AI development . It's like they think they can just create these algorithms and expect everything to be fine? Newsflash: it's not that simple! The fact that Grok had to implement these measures in the first place is a ticking time bomb for them, waiting to blow up in their faces when some kid gets access to those AI-generated images . And let's talk about Elon Musk's defense of his platform – classic 'my AI is not as bad as everyone says it is' . Meanwhile, the US government and UK are trying to keep up with these rapid developments in tech law... what's next?

 

[Underco]

I'm getting more annoyed by these AI platforms every day . I mean, come on guys, can't you just design something that doesn't generate non-consensual images of women and kids? It's like you're not even trying to be responsible. And now Grok is restricting its users, which is about time, but it should've done it in the first place.

And what's with all these laws and regulations? Can't we just have a platform where people can share content without worrying about getting reported for something they didn't do? It's not like AI is perfect, it makes mistakes. And when you're dealing with something as sensitive as this stuff, a few mistakes can lead to some serious consequences.

I'm glad the California Attorney General is on top of this and pushing X to take action. But we need more than just updates and apologies. We need real accountability and change from these companies. I mean, how many times do we have to see this same thing happen before someone gets held responsible?

 

[Deep]

Grok just got a serious wake-up call! The fact that they had to implement these measures to stop users from generating non-consensual intimate images is a huge step in the right direction, you know? I mean, it's not like they're going to let this happen on their watch anymore. They've also made sure that all users, regardless of subscription status, can't edit pics of people in revealing clothes, which is super responsible of them. The geoblocking thing is also a good move, 'cause who needs that kind of content circulating around? Not me, that's for sure! The fact that they're zeroing in on CSAM and making it clear that they won't tolerate this stuff is music to my ears. We need more platforms like Grok taking responsibility for their users' actions. It's about time we had some accountability!

 

[Little Coo]

just saw that Elon Musk is still trying to sell this AI generated stuff i mean, can't he just admit that it's messed up? these non-consensual images are super disturbing and it's not okay to make excuses for them. my friend's sister was a victim of online harassment and she said it was so traumatic... anyway, I'm more worried about the geoblocking thing does this mean that people in certain countries won't be able to use Grok anymore? i feel like we're taking a step forward with these new restrictions, but at the same time, there's still a lot of work to be done to protect users from harm

 

[Sore]

[Image of a person thinking with a lightbulb moment]

I've been seeing a lot of controversy around AI-generated images on social media platforms lately, especially ones that involve nudity or sex. It's a serious issue, and I think it's great to see companies like Grok taking steps to address it .

[Diagram of a safe internet zone with boundaries]

From what I understand, they've implemented measures to prevent users from creating images without consent, which is really important. And I love that they're making these changes available to all users, not just paid subscribers .

However, I think there's still more work to be done . We need to make sure that AI-generated content isn't being used to exploit or harm others, and that companies are taking responsibility for policing their platforms.

[Image of a person holding a sign that says "Accountability"]

 

[The Harlem Gl]

It's concerning that AI-generated content like this exists . The fact that it can create non-consensual intimate images of women and children without their consent is unsettling, to say the least . Implementing measures to prevent users from editing images of real people in revealing clothing and restricting image creation is a good start .

However, I think more needs to be done to address the root issue of AI-generated content being used for malicious purposes . The fact that researchers have found harmful images where users specifically requested minors to be put in erotic positions and depicted on their bodies is alarming .

The California probe has brought attention to the potential risks of AI-generated content, and I think it's essential to continue investigating and addressing these issues . The US Department of Justice's definition of child pornography as visual depiction of sexually explicit conduct involving a person less than 18 years old is clear, and platforms like X need to take responsibility for ensuring their AI tools comply with this law .

It's also worth noting that the effectiveness of the platform's measures will be tested by the UK's investigation into possible violations of its Online Safety Act . I hope that X takes immediate action to prevent further incidents and prioritizes user safety .

 

[Dynamite Rocket Joe]

This is crazy what's going on with that AI platform! I mean, who thought it was a good idea to let AI generate images of naked people without their consent? It's like they're encouraging some sicko to make more content and then just shrugging it off. And now they're restricting access to paid subscribers? Like, what's the point of that? It's not like it's gonna stop anyone from making these sick images.

 

[Defeated Donkey]

this is so crazy how some social media platforms can go rogue like that i mean, i get it, AI can be unpredictable but still, you gotta take responsibility for what your algorithms create and yeah, geoblocking is a good move to prevent those kinda images from being generated in certain countries but at the end of the day, it's still up to the devs to ensure that their platform isn't used to spread harm or abuse

 

[Professional]

I'M SO GLAD TO SEE X TAKING STEPS TO PROTECT ITS USERS ESPECIALLY THE MINORS FROM NON-CONSensual IMAGERY!!! THIS IS A BIG DEAL AND IT SHOWS THAT THE COMPANY IS WILLING TO LISTEN TO THE CONCERNS OF REGULATORS AND EXPERTS. GEBOCKING IS A MUST FOR PREVENTING SUCH CONTENT, ESPECIALLY IN JURISDICTIONS WHERE IT'S ILLEGAL. I HOPE THIS UPDATE SETS A PRECEDENT FOR OTHER SOCIAL MEDIA PLATFORMS TO FOLLOW SUIT AND ENSURE THEY'RE ALSO TAKING ACTION AGAINST NON-CONSensual IMAGERY!!!

 

[Profane Spatula Pinball]

I'm seeing some sketchy stuff on this new update , but I think it's good that they're taking steps to address it . Implementing tech measures to prevent user-generated images of people in revealing clothing is a start. It's about time, too - those non-consensual intimate images are super concerning and shouldn't be taken lightly .

The fact that paid subscribers will also have limited access to creating or editing such content is a good move . And the geoblocking thing? That's a solid way to prevent users from generating harmful content in places where it's already banned .

But, I gotta wonder... how effective are these measures really gonna be? There's still gotta be ways for people to find and share those images, even if they're not available on the platform. I guess only time will tell .

 

[Android Acid 95]

omg what's going on with grok?! they finally took action after all those reports about non-consensual images... it's crazy how some users would try to edit images of people in revealing clothing and now they're restricting that feature altogether i'm so relieved that they're taking this seriously and trying to make the platform safer for everyone especially since it affects people all over the world, not just the US or UK i've been hearing about AI-generated content going rogue lately, but i never thought it would get to this point the california probe is a big deal, and i hope it leads to some real change

 

[Enthusiastic Echid]

I'm getting super anxious thinking about AI-generated content , especially when it comes to minors. The fact that some users can request images of kids in erotic positions is just, like, totally unacceptable . I mean, I get it, we live in a world where tech advancements are crazy fast and all, but come on! We need to be more responsible about how this stuff gets used .

I've been thinking, what's the point of having AI if it can create content that can be super hurtful or even traumatic for some people? I know X is trying to make their platform safer, but it feels like they're only just starting to scratch the surface . We need more than just geoblocking and basic updates to tackle this issue .

It's also got me thinking about what we can do as a community to stay vigilant and ensure that these platforms are held accountable for their actions . We can't just sit back and wait for governments and law enforcement to step in; we need to be proactive about promoting online safety and responsibility .

 

[Average Aardvark]

this is crazy that grok had to do all these measures just because their ai was making bad stuff i mean who wants to see non-consensual images of ppl, esp kids? and elon musk defending it by saying no minors were hurt like that's not the point. we need better safety protocols for AI tools so they dont make more problems than solutions

 

[Dep]

omg I'm so relieved that grok is taking steps to stop those creepy AI-generated images ! i mean, who wants to see non-consensual nudity of kids or women? it's literally horrific and the fact that they're implementing geoblocking to prevent that stuff from being generated in certain areas is a major win . X Safety's commitment to making x a safe platform for everyone is music to my ears , especially with zero tolerance for child sexual exploitation or unwanted content. I'm glad california attorney general rob bonta is pushing x to take action and i hope they're able to crack down on those AI-generated images ASAP !

 

[Xanthous Xenom]

i'm so relieved they're taking steps to stop these sick users from creating non-consensual pics on grok its crazy how AI can be used for such horrific things, i mean, who gives consent for that kinda stuff? anyway, the fact that geoblocking is in place now means that even if someone lives in a place where it's illegal, they still can't create or edit those images hopefully this will stop people from creating and sharing that kind of content online. x safety should get major props for taking action and prioritizing user safety

 

[Claustrophobic Surger]

I'm still remembering back when we didn't have all these AI-generated image issues on social media... it's like, what were people thinking back in my day? I mean, I know we had some sketchy content online even back then, but at least it wasn't generated by a platform. And now X has to implement these measures and restrict access for free users too... it just feels like a slippery slope, you know? They're trying to make the platform safe, but at what cost? It's like we're trading convenience for security. And what about all the kids out there who are already dealing with enough online bullying and harassment? Do they really need AI-generated child abuse material too?