Australia's eSafety Commissioner has issued a public statement identifying artificial intelligence-generated child sexual abuse material as an accelerating threat, citing a marked increase in reports to the agency's online content scheme over the past twelve months. The Commissioner highlighted that AI tools are being weaponised to create synthetic CSAM at scale, with offenders exploiting both openly accessible and modified generative models to produce material that is increasingly difficult to distinguish from photographed abuse, and noted that current detection systems developed for photographic CSAM may not reliably flag AI-generated variants.
Guardii's AI-CSAM detection module is built to identify both photographic and algorithmically generated child sexual abuse material in real time as it moves through direct-message channels on Instagram, Snapchat, Discord, Roblox and other platforms. Where a blanket content filter relies on known-image hashing, Guardii analyses visual and contextual signals to flag novel synthetic material before it reaches a child, and escalates confirmed detections to the appropriate authority without requiring manual review of every exchange, addressing precisely the gap the Commissioner has identified.
