FBI reports 160 percent increase in AI-generated child sexual abuse material cases
Guardii Analysis
The FBI disclosed a 160 percent increase in reports of AI-generated child sexual abuse material over the past year, with offenders using generative artificial intelligence tools to create synthetic images and to modify non-explicit photographs of real children into sexually explicit deepfakes that are then used for sextortion or distribution. The bureau's Internet Crime Complaint Center noted that the material is increasingly difficult for platforms and law enforcement to distinguish from photographic CSAM, complicating detection and victim identification efforts, and warned that offenders are deploying AI-generated content to coerce minors into producing additional explicit material by threatening to circulate the fabricated images.
AI-generated and deepfake CSAM introduces a detection problem distinct from photographic content because the material may not match known hash databases and the child depicted may not exist or may never have been photographed in a compromising context. Guardii's anti-CSAM detection module addresses this gap by analysing distribution patterns and conversational context rather than relying solely on image hashing, identifying attempts to share, solicit or coerce using synthetic material within direct messages on Instagram, Snapchat, Discord, Roblox and other platforms, flagging the exchange before it reaches a child or escalates to real-world harm, and enabling parents, schools and law enforcement to intervene when AI-generated content is being weaponised as part of a grooming or sextortion sequence, detecting the threat pattern regardless of whether the material itself is synthetic or photographic.
