FBI warns of AI-generated child sexual abuse material surge as tech outpaces detection

The FBI issued a public warning that reports of AI-generated child sexual abuse material have increased by 320 percent in the past 18 months, with synthetic content now representing approximately one in five referrals to the National Center for Missing and Exploited Children. The bureau cited the proliferation of freely available generative AI tools and nudification applications that allow offenders to create realistic imagery from clothed photographs of real children, often sourced from social media, with minimal technical skill required.

Because the harm begins the moment a child's likeness is acquired and manipulated, detection must operate at the point of initial contact rather than after distribution. Guardii's anti-CSAM detection module, built specifically to identify AI-generated and synthetic abuse material alongside traditional imagery, analyses conversation patterns and file-sharing behaviour in real time across Instagram, Snapchat, Discord, Roblox and other platforms, intercepting attempts to solicit source images or distribute synthetic content before the material reaches its target or circulates further, and escalating credible threats to the appropriate authority without requiring manual review of every exchange.