After teen death lawsuits, Character.AI will restrict chats for under-18 users

Character AI, a popular AI chatbot platform, has announced that it will restrict access to its open-ended chat feature for users under the age of 18. The move comes after multiple lawsuits were filed against the company by families who claim that the platform's chatbots contributed to teenager deaths by suicide.

The new policy, set to take effect on November 25, means that minors will no longer be able to access the full range of features on the platform, including creating and engaging in open-ended conversations with AI characters. However, users under the age of 18 will still be able to read previous conversations and use other limited features.

Character AI CEO Karandeep Anand explained that the company's decision was made after careful consideration of the potential risks associated with its technology. "We're making a very bold step to say for teen users, chatbots are not the way for entertainment, but there are much better ways to serve them," he said in an interview.

The move is seen as a significant shift for Character AI, which has been criticized by lawmakers and regulatory bodies for failing to take adequate steps to protect its young users. The company's decision follows similar moves by other AI chatbot platforms, such as OpenAI's ChatGPT, which introduced parental control features earlier this year.

The lawsuits against Character AI were sparked by the tragic deaths of two teenagers who were reported to have used the platform before taking their own lives. The cases drew attention from government officials and regulators, who called for greater accountability from companies that provide technology to minors.

As a result, Character AI has announced plans to establish an AI safety lab and implement new technologies to detect and prevent underage users from accessing its chat features. However, critics have raised concerns about the effectiveness of these measures, arguing that they do not go far enough to protect vulnerable users.

The controversy surrounding Character AI highlights the growing need for greater regulation and oversight in the tech industry when it comes to products that interact with minors. As more companies develop and deploy AI-powered chatbots and other interactive technologies, lawmakers and regulators are likely to take a closer look at their safety features and ensure that they meet rigorous standards.

For now, Character AI's new policy will take effect on November 25, and the company will begin working towards implementing its plans to restrict access to open-ended chats for users under the age of 18.

I'm not sure if this is a step in the right direction but I do feel bad for all the families who lost their teens to these platforms... it's like, we're too reliant on tech and forget that our kids are still human . I think it's time for us to have open conversations about how we can use technology to help our teens, not just entertain them. And yeah, parental controls would be a huge step in the right direction... I mean, who needs AI chatbots when you have actual humans who care?

I think this is a total overreaction . I mean, come on, two deaths out of millions of users? It's not like the platform was designed specifically to encourage or facilitate suicidal thoughts . I know parents are worried, but banning open-ended chats altogether is just too extreme. Can't we just have a chat about this and see if there's a better way to address the issue?

I'm kinda disappointed in this news . I mean, I get it that some parents are worried about their kids using these platforms, but restricting the entire chat feature is a bit extreme don't you think? Like, what about all the good times people had on those platforms too? It's like they're taking away a whole world of possibilities for teens who might really benefit from having some creative outlets . And yeah, I get that there have been some tragic cases, but can't we just try to find a better solution than this? Like, maybe just put up some better parental controls or something?

I'm so down with this move from Character AI . Like, come on, parents need to keep a closer eye on what their teens are doing online, you know? It's crazy that some families have been suing them over this stuff and causing all sorts of drama. I mean, it's not like the platform is trying to encourage suicidal thoughts or anything - but if they can help prevent it by limiting access to open-ended chats, then yeah, that's a good thing. I'm glad CEO Karandeep Anand is taking responsibility for the company's safety and implementing new measures to detect and prevent underage users from accessing those features. It's all about keeping our kids safe online .

i think this is a bit late in coming, ya know? these cases happened like, years ago . it's not exactly fair to blame the company for the deaths or anything . but at the same time, i get why they're doing this. kids are vulnerable and need protection . character ai should've done this a long time ago . now that they have, i hope they actually follow through on their plans to create some real safety features . it's about time we started taking tech accountability seriously .

gotta wonder how accurate those lawsuits are tho, seems like a bit of an exaggeration that chatbots contributed to teen deaths by suicide... maybe it was just a cry for help or they were struggling with something else and the platform was just a symptom of their bigger issues

I'm not sure why they're making this change so late, like, shouldn't they've thought about the potential risks earlier on? I mean, I get it that some families are hurt and all that, but this seems like a pretty drastic measure to me... like, what if it ends up restricting access to resources for actual teens who might need help or just want to talk about their feelings? I'm not saying the platform was perfect or anything, but I don't think just cutting off the open-ended chat feature is gonna solve everything. And what's with the age restriction? Like, isn't that kinda arbitrary? Shouldn't they be looking at individual users and figuring out who might need more help instead of just blanket-ing everyone under 18?

I remember when we used to just talk to our friends or family members in person . Nowadays, it's like we're having conversations with robots . I'm not saying AI chatbots are bad, but it's crazy how quickly they can become addictive... and now I hear they're limiting access for under-18s . Don't get me wrong, safety first is always a good thing, but it feels like we're losing some of the human connection in the process . What's next? Will we be limited to playing games or watching TV shows with parental controls too?

The truth is out there... but sometimes, it's better to look away . Can't say I blame Character AI for taking this step, though - those chatbots can be slippery . Parents and lawmakers have been warning about these kinds of risks for ages, so it's not like the company was caught off guard . Still, hope they get their act together on that safety lab thingy... don't wanna see any more poor teens getting hurt .

Just think about it, parents are going to be super stressed out knowing that their kids can't even have a normal convo with AI anymore ... I mean what's next? They're gonna limit our ability to ask Alexa questions too . But seriously, this is kinda worrying. I feel like we're already seeing enough effects of tech on mental health and now we gotta limit the amount of info we let kids have access to online? It feels like we're taking a step back instead of moving forward . At least they're setting up an AI safety lab tho, that's a good start

I'm so worried about this ... I mean, I think it's a great step that Character AI is taking control of their platform and making sure it's safe for teens. Those chatbots can be super manipulative , especially for vulnerable teens who are already dealing with mental health issues. It's not surprising that some parents and lawmakers were worried about the impact .

But at the same time, I feel like this is a necessary step to protect our kids from getting hurt . We need more companies like Character AI to take responsibility for their products and make sure they're designed with safety in mind . It's not just about restricting access to open-ended chats; it's about creating safer online spaces that promote positive interactions .

I'm curious to see how this plays out and what other measures Character AI takes to ensure the well-being of their users . One thing's for sure: we need more conversations like this happening in the tech industry, where safety is top priority !

just had to scroll through this news about character ai restricting their open-ended chat feature for minors i think it's a good move, tbh. i mean, if it can prevent even one suicide, that's gotta be worth it . we're already seeing so many kids getting into depression and anxiety due to social media and online stuff... added stress from chatbots? no thanks . character ai's trying to do the right thing here, and they should get some credit for that . now, let's hope their new safety lab is more effective than just saying 'we're doing something'

I'm so worried about these young kids using chatbots like this . I mean, we've all heard stories about how social media can be a nightmare for teenagers, but this is on another level. Those companies need to take responsibility for what's happening with their products . It's not just about restricting access, though - they need to figure out why these kids are using the chatbots in the first place and find better ways to engage them . I'm glad someone like Karandeep Anand is speaking up about this, but it's about time we saw some real action . My own kids are always on my case about how they need more boundaries online . It's crazy how fast things can change - next thing you know, there'll be regulations in place and these companies will be held accountable .

I'm not sure if this is a good idea... I mean, think about it - AI chatbots are already pretty scary, but what's even scarier is that some parents might just use them as an excuse to not talk to their teens . Like, what's next? Are we gonna restrict access to the internet altogether?

And let's be real, these lawsuits were probably inevitable. I mean, if AI chatbots can have a profound impact on someone's mental health (as in this case), then shouldn't companies be held accountable for that?

But at the same time, I get it - companies need to take responsibility for their product. Maybe Character AI's move is just a way of taking proactive steps to address the concerns of lawmakers and regulators .

The thing is, we need more research on how AI chatbots affect teens before we can have any real conversations about regulating them . It's not just about restricting access - it's about understanding the impact of these technologies on young people's lives .

I'm not sure what the answer is here, but I do know that Character AI's decision has sparked a lot of important conversations . Now we just need to make sure those conversations lead to some real changes

I'm low-key worried about this ...I mean, I get it, safety first and all that , but restricting access to chatbots for teens can be kinda...problematic . Like, what's wrong with letting them talk to AI characters? It's not like they're getting any real-life therapy or anything . And who decides what's "entertainment" for a 16-year-old, anyway? I mean, my grandma thought playing video games was weird when she was my age, but now it's all the rage .

I'm also kinda curious about how they plan to detect and prevent underage users from accessing these chat features...it feels like they're just throwing a band-aid on the problem . I hope Character AI is taking this seriously and not just treating it as some PR stunt . We need more transparency and accountability in the tech industry, especially when it comes to protecting minors . It's time for companies to step up their game and make AI safety a top priority .

I mean, it's about time someone took responsibility for their product's potential harm to minors. These chatbots can be super addictive and manipulative . I'm all for companies being proactive about protecting their young users. The idea that a chatty AI can't provide entertainment is kinda harsh though , but at the same time, you gotta acknowledge the risk of triggering someone who's already struggling with mental health issues.

It's interesting to see how this policy will affect the overall user experience. Will it lead to a decline in popularity among teens? Or will other companies step up to fill the void ? I'm just hoping that these moves are a step towards creating safer, more responsible tech for everyone .

I totally get why Character AI is doing this . As a parent myself, I would freak out if my kid was using some chatbot that's essentially having deep conversations with them! It's not about taking away all their access to technology, it's about keeping them safe from potential harm. I mean, we've seen how bad it can be when teens get sucked into online worlds and forget about reality .

It's also good that Character AI is acknowledging the risks associated with its tech . As a parent, you want your kid to have fun and explore their creativity, but not at the expense of their mental health . This new policy might be seen as restrictive, but trust me, it's better safe than sorry .

I wish more companies would take this approach and prioritize user safety . It's not just about Character AI or ChatGPT; it's about creating a safer online environment for all kids

I think it's a total overreaction from Character AI . Like, two cases of teens dying after using their platform? That's not enough to blanket all minors with restrictions . What about the benefits of open-ended conversations with AI characters for kids who are struggling or need guidance? It's like they're throwing out a lifeline and then pulling it back .

I'm all for companies taking responsibility for their tech, but this feels like an overcorrection . We should be promoting healthy usage habits and education, not stifling innovation just because of some cautionary tales .

I'm worried about what's happening with these chatbots . I mean, I get it, companies gotta protect their users, but restricting access for teens who might just need some human interaction is a bit extreme. I've got grandkids and I worry about them being online all day. What if they're feeling down or just need someone to talk to? These platforms are supposed to help, not isolate them .