Rapid rise in AI-generated child abuse content, warns watchdog
Guardii Analysis
The Internet Watch Foundation reported that AI-generated child sexual abuse material investigated in the first nine months of 2026 has already exceeded the total for the whole of 2025, marking a rapid acceleration in the creation and distribution of synthetic CSAM. In response to the proliferation of photorealistic AI-generated imagery, the National Crime Agency and IWF have issued guidance urging parents to keep photographs of children off social media or restrict them to close-friends groups only, acknowledging the risk that publicly shared images may be harvested and manipulated by generative AI tools to produce abuse material.
Targeted detection of AI-generated CSAM at the point of creation or distribution addresses the harm before a manipulated image reaches the child or family. Guardii's anti-CSAM detection module, which operates across Instagram, Snapchat, Discord and Roblox, flags or blocks abuse material including AI-generated and deepfake imagery in real time, surfacing the threat to parents, schools or law enforcement without requiring blanket surveillance of private content. By intercepting synthetic abuse imagery in direct-message channels before it is weaponised for sextortion or distribution, a platform-agnostic AI safety system closes the operational gap that arises when children's publicly shared photos are turned into tools of exploitation.