AI ThreatsTuesday 15 October 2024via Meta Newsroom

Instagram Expands Teen Account Protections to Combat Sextortion and Exploitation

Guardii Analysis

Meta announced on 15 October 2024 a significant expansion of protections for Instagram Teen Accounts, introducing new anti-sextortion features including AI-powered nudity detection in direct messages that automatically blurs images containing nudity sent to or from accounts held by users under 18, alongside enhanced scam-detection systems and restrictions preventing suspected sextortion accounts from seeing teen follower lists or interacting with teen content. The rollout follows a 400 percent increase in financial sextortion reports targeting minors globally between 2021 and 2023, with Meta stating the measures will apply to all teen accounts by early 2025.

When a platform deploys client-side content scanning at the moment an image is opened, it addresses one vector but leaves the conversational escalation that precedes and surrounds image exchange unmonitored. Guardii's anti-sextortion detection module operates upstream of that moment, identifying coercive demand patterns, threats to share, and requests for intimate material across the message thread in real time, flagging the conversation to a parent or safeguarding lead while the child still has agency to disengage and before any image changes hands, a model that complements in-app nudity blurring by intercepting the relational harm that image-only filters cannot see.

Related Articles