Internet Watch Foundation reports 300 percent increase in AI-generated child sexual abuse imagery flagged in first half of 2024

The Internet Watch Foundation released data on 5 September 2024 showing a 300 percent increase in reports of AI-generated child sexual abuse material in the first six months of 2024 compared to the same period in 2023, with analysts observing that offenders are using text-to-image and face-swap tools to produce hyper-realistic synthetic content at scale and that some of this material is based on real photographs of identifiable children. The charity, which operates the UK hotline for reporting illegal online content, warned that generative AI is lowering the barrier to entry for offenders and complicating efforts to identify and safeguard victims, and called for urgent technical and legislative measures to address the proliferation.

The operational challenge the Internet Watch Foundation identifies is one Guardii is engineered to address at the conversation layer. The platform's anti-CSAM detection module recognizes abusive imagery whether photographic or synthetically generated, flagging its presence in direct messages across Instagram, Snapchat, Discord, Roblox and other services before it can be normalized or weaponized in a grooming or sextortion exchange. Guardii's detection architecture, backed by Startmate, prioritizes harmful patterns—escalation, coercion, sustained targeting—over keyword filtering, reporting the shape and seriousness of a threat to a parent, school or safeguarding team without creating a surveillance feed, and enabling intervention before a child is coerced into producing additional material or meeting an offender in person.