UK government publishes draft guidance on AI-generated child sexual abuse material
Guardii Analysis
The UK Home Office released its 2024 Child Sexual Exploitation and Abuse Technology Threat Assessment on 30 October 2024, highlighting the accelerating use of generative AI tools to create realistic child sexual abuse material and the use of AI-powered chatbots to facilitate grooming and sextortion. The report documents a significant increase in AI-generated CSAM across online platforms, notes that offenders are using widely available AI image generators to produce abusive content from non-abusive source images, and warns that synthetic media is becoming difficult to distinguish from real abuse imagery, complicating detection and law enforcement efforts.
Generative AI tools enable offenders to produce and distribute CSAM at scale while evading traditional image-hash detection systems that rely on known material. Guardii's CSAM detection module, built to identify both photographic and AI-generated abuse imagery, operates in real time across messaging platforms including Instagram, Snapchat and Discord to flag synthetic and deepfake content at the point of sharing, reporting the presence and severity of the material without storing or transmitting the image itself, a mechanism that closes the detection gap created by generative tools and enables immediate escalation to law enforcement when AI-generated abuse material is identified in a private conversation.