France launches new AI-powered tool to detect online child sexual abuse material
Guardii Analysis
France on 23 October 2024 introduced a new artificial intelligence detection system aimed at identifying child sexual abuse material—including synthetically generated and digitally manipulated images—across online platforms. Developed jointly by the French Ministry of the Interior, technology partners and child-protection charities, the tool is designed to accelerate the triage of reports, help investigators distinguish new material from known databases, and support faster takedown and referral to prosecutors, addressing both the volume of content and the increasing prevalence of deepfake and algorithmically created abuse imagery that evades traditional hash-matching techniques.
The same generative techniques that enable rapid production of synthetic abuse material also produce conversational lures and image-based coercion at scale, often within encrypted or ephemeral messaging environments where content scanning alone cannot reach. Guardii's anti-CSAM detection module—trained to recognise not only image hashes but the linguistic and behavioural precursors to material exchange, including solicitation, negotiation and grooming language—operates upstream of content creation, flagging high-risk conversations in real time across Instagram, Snapchat, Discord and Roblox before an image is shared or a child is coerced into producing one, and providing investigators with early indicators of offending rather than evidence after the fact.