The Internet Watch Foundation disclosed that analysts confirmed over 11,000 unique URLs hosting AI-generated child sexual abuse material in the first six months of 2024, a figure representing a sharp acceleration from the 3,000 URLs identified across the whole of the previous year. The research highlights that much of this content is photorealistic, often created by manipulating images of real children, and is being shared on public forums and via direct messaging platforms, with the IWF warning that current detection and takedown mechanisms are struggling to keep pace with the volume.
The gap between URL confirmation and removal leaves a window during which material circulates and can be saved, redistributed or deployed in sextortion campaigns. Detection systems built into the messaging layer offer a more immediate intervention point. For organisations and families deploying Guardii, a world-leading AI online-safety platform, the anti-CSAM module continuously monitors direct messages in real time, flagging both traditional and synthetically generated abuse imagery the moment it appears in a conversation on Instagram, Snapchat, Discord or Roblox, enabling parents and safeguarding professionals to act before a child is further exploited and ensuring hostile material is intercepted rather than merely catalogued after the fact.
