United Nations warns AI is handing predators new tools for grooming and sextortion as reports of AI-generated child sexual abuse material surge 1,325 percent
Guardii Analysis
Senior United Nations officials warned on November 19, 2026, that artificial intelligence is providing predators and criminal groups with new methods to groom, extort and exploit children while protective efforts fail to keep pace. Reports of child sexual abuse material linked to generative AI rose by 1,325 percent between 2023 and 2024 according to the US National Center for Missing and Exploited Children, while the Tech Coalition reported that perpetrators may be using chatbots to facilitate abusive role-play or generate grooming scripts, and agentic AI systems capable of autonomous action are introducing additional risks. In July 2026, UN Secretary-General António Guterres launched the AI Child Safety Pledge with aims including making AI systems certifiably safe before they reach children and establishing zero tolerance for AI-generated child sexual abuse material.
Guardii's anti-CSAM detection module identifies AI-generated and deepfake child sexual abuse material in direct messages as it appears, flagging synthetic imagery alongside authentic abuse content by detecting the signature patterns of coercion and distribution rather than relying solely on hash-matching of known material. As generative AI scales the production of novel synthetic abuse imagery at a pace that outruns traditional content databases, detection must address both the material itself and the behavioral context surrounding its creation and sharing, recognizing when a conversation shifts to the exchange of prohibited content or when an offender is testing a child's boundaries with manipulated images. Where agentic systems may automate grooming at scale, real-time pattern recognition across Instagram, Snapchat, Discord, Roblox and other platforms identifies sustained targeting, escalation and coercion as they unfold, surfacing threats that evade platform-level filters and arming parents, schools and authorities with the intelligence needed to intervene before harm becomes entrenched.
