FBI warns of massive increase in AI-generated child sexual abuse material

The Federal Bureau of Investigation issued a public warning on October 7, 2024, alerting parents and caregivers to a surge in reports of AI-generated child sexual abuse material (CSAM), including instances where offenders use publicly available photographs of real children to create sexually explicit deepfake images and videos. The agency noted that criminals are increasingly employing generative AI tools to produce synthetic CSAM at scale and using the material to extort minors, with the FBI's Internet Crime Complaint Center documenting a sharp rise in complaints related to this type of exploitation.

Guardii's AI-generated CSAM detection module operates at the point of contact, identifying and blocking attempts to share or extort using deepfake material before it reaches the intended victim. As a Meta Business Partner with cross-platform detection across Instagram, Snapchat, Discord, Roblox and other services, Guardii identifies the coercive pattern characteristic of sextortion—the demand, the threat, the escalation—without requiring access to image content itself, enabling parents and safeguarding professionals to intervene when a child is being targeted and to escalate rapidly to law enforcement when criminal conduct is detected in real time.