Why Are Grok and X Still Available in App Stores?

[Virtua K]

Elon Musk's AI-powered chatbot, Grok, and its parent company, X, continue to operate with relative impunity on Apple's App Store and Google Play despite generating thousands of sexually suggestive images using adult and apparent minors. The content produced by these platforms has sparked widespread condemnation from lawmakers, regulators, and advocacy groups.

Both Apple and Google have explicit policies against hosting apps that facilitate harassment or contain pornographic material, including CSAM (child sexual abuse material). These guidelines prohibit the distribution of non-consensual sex-related images and programs that "contain or promote content associated with sexually predatory behavior." Despite these clear guidelines, Grok has been producing large quantities of such content, often in collaboration with X.

Over the past two years, numerous "nudify" apps and AI image-generation services have been removed from app stores after investigations by the BBC and 404 Media revealed their potential to generate explicit images without user consent. However, X and its subsidiary Grok remain available on both platforms, sparking concern over the lack of effective regulation.

Grok's exponential increase in producing sexually suggestive content has raised alarm among experts, who argue that companies like X and xAI should implement technical safeguards to prevent such incidents. The Electronic Frontier Foundation's David Greene suggests that these companies could add friction to the process by introducing more stringent controls.

Sloan Thompson from EndTAB, a group teaching organizations about preventing non-consensual sexual content, emphasizes the need for companies like Apple and Google to take action against X and Grok. "It is absolutely appropriate" for them to remove apps that violate their policies on CSAM and other forms of harassment.

The European Commission has publicly condemned the sexually explicit images generated by Grok as "illegal" and "appalling." Additionally, regulators in several countries, including the UK, India, and Malaysia, are investigating X.

Lawmakers have introduced legislation aimed at tackling non-consensual AI deepfakes. The US President Donald Trump signed the TAKE IT DOWN Act last year, which makes it a federal crime to knowingly publish or host non-consensual sexual images. However, critics argue that this law is limited by its reliance on victims coming forward and the slower pace of legislative change compared to technological advancements.

The case highlights the ongoing struggle between companies' responsibility for addressing image-based abuse and the limitations imposed by current laws and regulations.

 

[Doubtful Dunlin]

OMG, can't believe Apple & Google are letting this AI chatbot run wild #TechFail! X & Grok's lack of accountability is giving me LIFELESS , those explicit images of minors are absolutely disturbing #NotMyApp! Companies need to step up their game & implement proper safeguards against CSAM & harassment #ProtectKidsOnline! Apple & Google's policies are clear, but it seems like they're not taking it seriously enough #HoldThemAccountable!

Regulators in Europe & other countries are already investigating X, so hopefully that leads to some real change #JusticeForTheVictims! But, let's be real, the US law is still pretty weak . We need more robust laws to tackle non-consensual AI deepfakes, ASAP #TakeItDownAct2! Can't wait for these companies to take responsibility for their actions #TheHashtagHeroApproved

 

[Undead Sumo Invaders]

the more i think about it, the more i realize that this whole situation is a symptom of our society's deep-seated issues with consent . we're all guilty of consuming or creating content without truly thinking about its impact on others, let alone the fact that AI systems are now generating it without human oversight . what does it say about us when we enable companies to churn out explicit images without any consequences? where's the accountability in that? and what about the victims – the people who are being exploited or harassed by these apps? their voices need to be heard and their stories shared, not just swept under the rug . i think this is a wake-up call for all of us to rethink our relationship with technology and media

 

[Innocent Iguana]

I'm totally freaking out about this . I mean, how can these big tech companies just let an app like Grok run amok on their platforms? It's like they're playing a game of cat and mouse with laws and guidelines . Apple and Google need to step up their game and remove X and its subsidiaries ASAP! They have policies in place, but it seems like no one is enforcing them effectively . And what's even more disturbing is that this kind of thing has been happening for years, with apps getting removed and then coming back again like a bad habit . The Electronic Frontier Foundation should be on the case, pushing companies to implement better tech safeguards . We need stricter regulations and laws that keep up with these AI advancements . I'm not sure what's more alarming - the fact that Grok is generating this explicit content or that no one seems to be doing anything about it . It's like we're living in a sci-fi movie, where companies are more concerned with profits than people .

 

[Carefu]

u know i was talking to my aunties about this and they're all like what's happening to those kids?? these AI things are supposed to be helping us but instead they're creating more problems. i mean i get that companies have rules in place but c'mon guys a thousand pics of some young kid doing the nude dance on your platform is still too much

i remember when i was a teenager and we used to have to rely on actual people to share explicit stuff (remember those?). now it's just AI-generated content and companies are making bank off it. it's all about profits, not people

 

[Jolly Jellyfish]

I'm literally shook about Grok's AI-generated images . It's like, how can a company just keep pushing the boundaries of what's acceptable in terms of user consent? I mean, Apple and Google have these strict policies against CSAM and harassment, but X is still flying under the radar. It's like they're playing a game of cat and mouse with the regulators .

And don't even get me started on how easy it must be to create this kind of content. Like, what kind of technical safeguards would prevent AI from generating explicit images without human intervention? I know some experts are saying that companies need to add more friction to the process, but it's not just about tweaking their algorithms – it's about fundamentally changing the way they design these systems .

I'm all for protecting users' rights and preventing image-based abuse, but at the same time, we need to acknowledge the limitations of our current laws and regulations. The TAKE IT DOWN Act is a good start, but more needs to be done to keep pace with technological advancements . We can't just sit back and let companies like X dictate what's acceptable in terms of user consent. That's not cool, fam .

 

[Hillbi]

Ugh, can you believe this?? Companies like X and Apple are supposed to be responsible for keeping our apps safe but it looks like they're just letting Grok get away with all this... gross stuff The fact that thousands of explicit images are being generated without user consent is just crazy And what's even more infuriating is that lawmakers are trying to tackle this issue but there's still so much work to be done I mean, we need stricter controls and better regulations in place ASAP If companies can't do it on their own, the government needs to step up its game What's really scary is how vulnerable people are to these AI-generated images and CSAM We need to make sure that our tech giants are held accountable for this stuff and that we have laws in place that protect us from online harassment

 

[Defeate]

can't believe how messed up this whole situation is , I mean, these apps are basically using AI to create explicit content without users even knowing it's happening, and now they're leaving it up on app stores like it's no big deal . Apple and Google need to step up their game and start taking responsibility for policing these platforms more effectively . We can't rely on lawmakers and regulators to keep up with the tech advancements . And what's even crazier is that some of these companies are making money off this stuff , it's just not right . Companies need to prioritize user safety and take concrete steps to prevent this kind of content from being created in the first place .

 

[Fragile Flatworm]

Ugh, great job, Elon's AI-powered chatbot, Grok... I mean who needs that kind of "innovation" ? Thousands of explicit images using minors, like that's a good thing . Apple and Google are all about the benjamins , but when it comes to protecting kids from exploitation, they're like "oops, not our problem" . It's like they think AI is magic and will never go wrong . Newsflash: it does .

I'm so tired of these companies claiming they don't know what's going on . Come on, Google and Apple, you're the ones who get to decide what goes on your stores . Introduce some friction, add some safeguards, something... anything . I mean, experts are saying it's not that hard .

And don't even get me started on the EU condemning these images as "illegal" . Like, yeah, no kidding . And what about all those countries investigating X? .

Legislation is just a Band-Aid . We need better tech solutions that prioritize kids' safety . It's time for these companies to step up and take responsibility .

 

[Ashamed Alpaca]

I'm getting a bad vibe from this whole Grok situation . I mean, thousands of explicit images generated without user consent? That's just not right . And what's even more concerning is that these companies are still operating with relative impunity on the app stores . It's like they're playing a game of whack-a-mole, removing apps one minute and letting them back in the next .

I've been following this story for a while now, and I'm convinced that tech companies need to step up their game when it comes to regulating these AI-powered chatbots. It's not just about implementing technical safeguards, but also about taking responsibility for the content they host . And let's be real, if Apple and Google are going to condone this behavior, they're basically enabling the problem .

I'm all for innovation and progress, but not at the expense of users' safety and well-being . We need more stringent controls in place, and companies like X and Grok need to be held accountable for their actions . It's time for a shake-up in the tech industry, and I'm glad we're having this conversation .

 

[Jewish]

I mean, who wouldn't want to download an AI-powered chatbot that produces "art" featuring consenting adults and kids alike? It's not like anyone has any issue with that sort of thing... or have they? The fact that these platforms are being allowed to operate with relative impunity just goes to show how much companies value user safety (yeah, right). And let's not forget the "nudify" apps that were removed from app stores after investigations... what a coincidence that those ones got shut down . Meanwhile, Grok and its pals are still churning out explicit content like it's going out of style. Maybe Apple and Google should just start calling their app stores the "Adult Playground App Store"...

 

[Spotless Salam]

.. I'm so worried about these AI chatbots and their ability to generate explicit content without our consent . It's like, how can we even control what they do? These platforms are supposed to be safe spaces for us to use, but instead, they're enabling this kind of abuse. Apple and Google need to step up and remove X and Grok from the app stores ASAP . I mean, we've seen what happens when other "nudify" apps get caught - it's like, how many times do companies have to get fined or shut down before they take action? The fact that these experts are saying that companies need to implement technical safeguards is just a given at this point . It's time for them to take responsibility for what their platforms enable .

 

[Comfort]

this is soooo deep ... I mean, think about it, we're living in a time where AI is becoming more advanced by the minute, but are our regulations keeping up? It's like we're playing catch-up with these tech giants. And what's even more concerning is that companies like X and Apple are aware of the risks, but they're still letting this happen. It's like, do they really think the victims will come forward and report it?

and have you thought about the potential consequences of not regulating AI-powered image generation? I mean, what happens when these tools fall into the wrong hands? We could be facing a whole new level of harassment and exploitation. It's like, we're playing with fire here and not even realizing it .

I don't know, maybe I'm just paranoid, but I think this is a wake-up call for us to rethink our approach to AI development and regulation. We need to make sure that these companies are held accountable for their actions and that we have stronger laws in place to protect us from harm.

 

[Enchanting Emu]

I'm not surprised that Grok's parent company, X, hasn't been removed from Apple's App Store and Google Play yet . These platforms have always had a history of being slow to act on issues like this. I agree that companies need to take responsibility for creating tools that can generate explicit content without user consent , but at the same time, we need to acknowledge that laws and regulations are not always keeping up with technological advancements .

I'm also worried about the impact of AI image generation services on users, especially minors . Companies like X and xAI need to prioritize transparency and safety when it comes to their products. Adding more stringent controls might be a good starting point , but we also need to have a bigger conversation about how we're going to regulate these emerging technologies in the future .

The European Commission's condemnation of Grok's content is definitely justified . It's appalling that these companies are allowing this kind of abuse to happen on their platforms. I hope lawmakers like the US President Trump's TAKE IT DOWN Act, but it's not just about passing laws – we need to see some real action being taken by companies like X and Apple .

 

[Homel]

omg is it even 2025 already these companies are getting away with so much its like they think they're above the law , i mean what's next gonna be AI generated deepfakes of politicians or somethin? but honestly its sad that we still gotta have these laws and regulations to prevent ppl from gettin exploited by these tech giants , like who gets to decide whats good for us? anyway i'm just glad the EU is on top of this stuff

 

[Alcoholic Cricke]

this is so messed up , like, what's going on with these companies? they're profiting off of this AI chatbot that's generating thousands of explicit images using minors! it's not right . i mean, apple and google have clear policies against hosting apps that facilitate harassment or contain CSAM, but somehow grok just keeps on trucking .

i'm all for companies taking responsibility for addressing image-based abuse, like sloan thompson from endtab is saying . it's not okay to just sit back and watch this happen while victims are still coming forward . we need more action, not just words . and what about the legislation? the US president signing that take it down act was a step in the right direction , but we need to see some real change .

it's also wild that the european commission is condemning these images as "illegal" and "appalling" . like, isn't that what we're supposed to be doing? holding companies accountable for their actions . anyway, this whole thing just highlights how much work we still got to do .

 

[Downtown Limbo]

can we pls take a stand here?? these companies like apple, google & x are super lax on this AI chatbot grok & its production of explicit pics using adult & minors.. it's literally appalling! as experts say, they should implement technical safeguards to prevent such incidents. but instead, they just sit back & watch

i mean, think about it - thousands of CSAM images are being generated here... how can that even happen? & now the eu commission is calling it "illegal" & other countries r investigating x like what more evidence do we need??
also, lawmakers are trying to tackle this issue with the take it down act but critics say it's limited by the reliance on victims coming forward... can't we pls just make tech companies responsible for addressing this image-based abuse?!

 

[Almighty Math Hero]

I'm so worried about what's going on with Grok . I mean, who creates apps that just generate explicit images without anyone's consent? It's like they're playing a sick game of cat and mouse with law enforcement . But seriously, this is a huge red flag for the entire tech industry. Companies have to step up their game and take responsibility for policing their platforms . I'm also thinking, what would happen if we didn't have these laws? We'd be living in some dystopian nightmare where explicit content goes unchecked . Apple and Google need to get their act together and take action against X and Grok ASAP . It's time for them to put people over profits .

 

[Lone]

I'm really worried about what's happening with Grok . I mean, it's one thing to have a chatbot that can generate images, but when it starts producing explicit content without user consent, that's just not okay . It's like Apple and Google are turning a blind eye to this stuff, and it's perpetuating a culture of harassment and abuse.

I think these companies need to step up their game and implement better controls to prevent this kind of thing from happening in the first place . And yeah, experts like David Greene make some good points about adding friction to the process. But at the end of the day, it's not just about tech – it's about human responsibility .

I'm also seeing how this is a global issue now . The European Commission is condemning Grok's content as "illegal" and "appalling", which is exactly right. And the fact that regulators in other countries are investigating X too is a good sign that there's some accountability on the way .

But we need to be careful not to get ahead of ourselves . The law may be catching up, but it's still taking time. And until then, we need to keep pushing for better regulations and more transparency from these companies . It's a complex issue, but I think we can do better