The FBI issued a public warning in August 2024 regarding the increasing use of artificial intelligence tools to generate child sexual abuse material, including the manipulation of innocent photos of real children into explicit imagery. Law enforcement officials noted that offenders are using generative AI to create realistic synthetic content at scale, and that such material is being distributed on social media platforms and dark web forums. The Bureau emphasized that creation and distribution of AI-generated CSAM is a federal crime and urged parents to limit the online sharing of children's photographs.
Guardii's anti-CSAM detection module is engineered to identify both photographic and AI-generated child sexual abuse material in real time as it moves through messaging channels on Instagram, Snapchat, Discord, Roblox and other platforms. Where a blanket prohibition on image-sharing would curtail legitimate use and drive offenders to unmonitored spaces, targeted interception isolates the harmful transaction itself: the system flags or blocks synthetic abuse material at the moment of transmission, surfaces the attempt to a parent or safeguarding team, and enables immediate escalation to law enforcement. This approach addresses the operational threat the FBI has identified without imposing a compliance burden on every user or ceding visibility into the channels where abuse occurs.
