AlgorithmWatch Reports Regulatory Lag on AI-Generated CSAM as Offenders Celebrate Generative Advances

A report by AlgorithmWatch documents that artificial intelligence is reshaping the production of child sexual abuse material online, enabling new forms of exploitation that are outpacing legal and regulatory frameworks. Since 2023, Internet Watch Foundation analysts have tracked how AI is being used to generate CSAM across the dark web and open forums, with offenders celebrating advances in generative AI and arguing that because content is AI-generated they bear no responsibility. In reality, the individuals depicted are often real children drawn from offenders' own surroundings, images of public figures, or survivors of abuse whose photographs are repurposed to train bespoke models. The EU directive on child sexual abuse dates to 2011 and is currently under revision.

Real-time interception at the point of distribution closes the enforcement window that static content moderation leaves open. Guardii's anti-CSAM detection module, which includes coverage of AI-generated and deepfake material, scans direct-message conversations across platforms including Instagram, Snapchat, Discord and Roblox, identifying both the circulation of synthetic abuse imagery and the coercive patterns that precede its creation or sharing. By detecting harmful escalation before material reaches a target or is forwarded into a network, the system reduces both the volume of imagery requiring forensic review and the number of children exposed to it, supporting law enforcement response without waiting for retrospective content reports.