New Research Shows AI-Generated CSAM Now Accounts for Significant Share of Reported Material
Guardii Analysis
The Internet Watch Foundation's 2024 annual report published in October revealed that AI-generated child sexual abuse material now represents a measurable and growing proportion of imagery reported to the organization, with analysts confirming that synthetic and manipulated imagery created using generative AI tools has become sufficiently realistic to require the same assessment and removal protocols as photographs of real abuse. The report noted offenders are using AI to create novel illegal content and to modify existing images, lowering barriers to production and distribution.
Generative AI shifts the threat from documentation of contact abuse to on-demand creation and weaponization. Guardii's CSAM detection module identifies sharing of illegal imagery including AI-generated and deepfake material as it is transmitted in direct messages across platforms, flagging the exchange in real time and enabling immediate escalation to law enforcement and platform safety teams. The system also detects the grooming and sextortion conversations in which offenders solicit images from children to use as source material for AI manipulation or threaten to create and distribute synthetic abuse imagery, intercepting both the production pipeline and the coercive deployment of AI-generated content before distribution amplifies harm.