AI ThreatsMonday 18 November 2024via The Print

Child sexual abuse in AI era—US reports 8,400% surge in cases in two years

Guardii Analysis

Reports of child sexual exploitation involving generative AI have surged worldwide, with the United States recording an 8,400 per cent increase in cases over two years. Meta reported that it proactively removed 5.3 million pieces of child sexual exploitation content on Facebook and Instagram in India during the first half of 2026 alone. On 16 November 2024, OpenAI announced a new image classifier specifically designed to detect potential child sexual abuse material, including AI-generated material that has not been previously documented or hashed.

Guardii's CSAM detection module, backed by Startmate and operating as a Meta Business Partner, identifies both real and AI-generated child sexual abuse material within direct-message flows in real time across Instagram, Snapchat, Discord and Roblox. By analysing visual and conversational context rather than relying solely on hash-matching of known images, the system flags novel AI-generated deepfakes and solicitation attempts as they occur, escalating high-risk interactions to the appropriate authority before distribution widens. Where hash databases lag the speed of synthetic content creation, real-time pattern recognition closes the operational gap.

Related Articles