Meta has introduced new features to notify parents when their teenagers discuss suicide or self-harm with Meta AI, the company’s chatbot. Parents with supervision set up on their teens’ Instagram accounts will receive alerts on their own devices if their teens exhibit signs of distress while interacting with Meta AI on any of Meta’s platforms. This initiative expands on Meta’s previous safety measures, where the chatbot directed teens expressing suicidal thoughts to crisis helplines and encouraged reaching out to trusted individuals. Additionally, repeated searches related to self-harm or suicide on Instagram triggered notifications to parents.
The new tool is currently available to users in Canada, the U.K., the U.S., and Australia. Meta also announced ongoing efforts to develop a feature that can notify emergency services when conversations with both adults and teens suggest a risk of self-harm or suicide. Despite positive reception for these advancements, experts emphasize the need for continued improvements in online safety measures for young users.
While acknowledging the value of the new tool, technology analyst Carmi Levy from London, Ont., highlights that no tool is flawless and may sometimes miss identifying genuine risks or produce false alarms. Meta aims to be cautious by notifying parents even when a teen’s intentions are unclear. Levy advises that parents view this tool as one way to monitor their children’s online activities and stresses the need for vigilance.
Youth advocate Hanna Grover raises concerns about potential circumvention attempts by teens to bypass these safeguards, emphasizing the importance of comprehensive regulations to protect young users. Sara Austin, CEO of Children First Canada, advocates for stricter laws to hold tech companies accountable for safeguarding children online. In Canada, the proposed Safe Social Media Act aims to mandate safety requirements for AI chatbots in response to harmful online behaviors.
The introduction of Meta’s new feature coincides with increased scrutiny on AI’s role in mental health crises among young individuals. Recent incidents involving AI chatbots have prompted calls for enhanced parental controls and stricter regulations to ensure the well-being of young internet users.
