Meta is stepping up its commitment to teen safety with a series of new protective features designed to ensure "age-appropriate experiences" when engaging with artificial intelligence (AI). The tech giant aims to keep parents in the loop during potential crisis moments, focusing on sensitive conversations surrounding suicide and self-harm.
The latest update introduces proactive alerts for parents and possible emergency service interventions, aligning with Meta’s goal to support teens in getting offline help from parents, professionals, or emergency services when needed.
Previously, Meta AI would guide teens expressing self-harm thoughts to crisis helplines and encourage communication with trusted adults. Now, a more active approach is being implemented. The updated system, developed with safety experts, will notify parents if their teen's chat signals potential risk, even with subtle references to self-harm.
“We worked with parents and experts to understand which AI conversations warrant an alert — such as those where a teen makes a clear reference to hurting themselves, even if that reference is subtle,” Meta stated.
Recognizing the potential distress these alerts could cause, Meta assures users that flagged chats will undergo manual review before any notification. When ambiguity persists, the platform opts to notify parents, believing it's the best initial stance to fine-tune its approach over time.
Currently live in the US, UK, Australia, and Canada through Instagram’s parental supervision tools, these alerts are set for a worldwide rollout by year-end. This feature builds on existing measures that flag repeated self-harm searches on Instagram.
In addition to parental alerts, Meta is developing integration with emergency services, expanding its protocols across Facebook and Instagram which resulted in over 19,000 wellness checks last year. Meta has consulted extensively with mental health experts to ensure AI responses are supportive and sensitive.
Dr. Ji-yeon Lee, a psychologist, praised the initiative: “I was struck by the rigor of Meta’s clinical review process. It examined not only immediate responses but also broader conversational contexts and varying levels of risk.”
Meta is also expanding its content limitations. Teen accounts already default to a 13+ setting, limiting discussions on sexual or romantic topics, and parents can now activate a stricter "Limited Content" setting. This enhances the safety and appropriateness of AI interactions for younger users.