New research reveals 60% increase in AI-generated CSAM reports
Guardii Analysis
The Internet Watch Foundation published its 2024 annual report on 14 November, documenting a 60 percent year-on-year increase in reports of AI-generated child sexual abuse material, with analysts confirming 1,000 discrete AI-generated images assessed as criminal under UK law. The report warned that generative AI tools are lowering the barrier to creating hyper-realistic CSAM, often using images of real children as source material, and that these images are circulating on mainstream platforms and forums alongside traditional material. The IWF called for urgent action from technology companies and lawmakers to address the emerging threat.
AI-generated abuse material presents a detection challenge distinct from photographic content: metadata is often absent, provenance uncertain, and volume escalating faster than manual review can scale. Backed by Startmate and deployed as a Meta Business Partner across Instagram, Snapchat, Discord and Roblox, Guardii's anti-CSAM detection module is engineered to recognise both traditional and AI-generated material by analysing the context and coercion patterns in which it appears, rather than relying solely on hash-matching against known databases. This approach surfaces the distribution or solicitation event in real time, enabling platforms and investigators to intervene while the conversation is live rather than cataloguing harm after the fact.
