Meta announced in October 2024 that it is deploying facial recognition technology to detect and block fraudulent advertisements that use images of public figures without permission, and to assist users who have been locked out of their accounts through video selfie verification. The company reported early testing showed promising results in faster detection and removal of scam content, and the technology will also be used to help users regain access to compromised accounts, with particular focus on preventing account takeovers that are often precursors to sextortion and scam activity targeting minors.
While platform-level identity controls address impersonation at scale, they do not intercept contact after an account has been breached or when an offender uses a genuine-looking profile to initiate contact with a child. Detection systems that monitor the content and behavioral signature of incoming direct messages — including unsolicited contact from age-inappropriate accounts, requests for intimate images, or financial solicitation patterns consistent with sextortion — can flag or block hostile actors before a conversation escalates, regardless of whether the sender's profile passed initial verification. Guardii's real-time message monitoring across Instagram, Snapchat, Discord, Roblox and other platforms applies pattern-based detection for grooming, sextortion and CSAM distribution, operating at the point of contact rather than relying solely on upstream identity assurance.
