Snap Inc. announced in early August 2024 that it is rolling out enhanced in-app safety warnings for teenage users, including pop-up alerts when a teen receives a message from an account that has been reported by other users or exhibits suspicious behavior, and streamlined reporting tools that allow users to flag concerning contact directly within a conversation. The company stated that the warnings are informed by machine learning models that assess account characteristics such as age discrepancies, messaging volume and prior user reports, and that the initiative is part of a broader effort to surface risk signals to young users before a harmful interaction escalates. Snap also reiterated its commitment to working with law enforcement and the National Center for Missing and Exploited Children on investigations involving child safety.
In-app warnings prompt a user to exercise caution or block a contact, but they rely on the teenager recognizing the risk and taking action, and they are necessarily retrospective — the message has already been sent and received. Detection systems that analyze message content and behavioral context in real time, and that automatically block or escalate contact matching high-risk patterns — such as requests for intimate images, offers of money or gifts in exchange for content, or sharing of abuse material — do not place the burden of judgment on the child. Guardii monitors direct messages across Snapchat, Instagram, Discord, Roblox and other platforms using purpose-built modules for grooming, sextortion and CSAM, and surfaces flagged contact to a parent, school or safeguarding professional, enabling intervention before a predatory conversation progresses.
