Australia passes amendment requiring platforms to detect AI-generated child abuse material

The Australian Parliament has passed amendments to the Online Safety Act that explicitly require social media and messaging platforms to detect and remove AI-generated child sexual abuse material, closing what legislators described as a gap in the original 2021 framework. The amendment, which takes effect in January 2027, mandates that services accessible to Australian users deploy proactive detection systems capable of identifying synthetic CSAM, and expands the eSafety Commissioner's powers to issue removal notices and financial penalties for non-compliance. The government estimates that AI-generated CSAM reports to the Australian Centre to Counter Child Exploitation increased by more than 300 percent between 2025 and 2026.

Compliance with obligations to detect synthetic abuse material in private communications depends on systems that can assess threat without requiring platforms to decrypt messages or scan all user content. Backed by Startmate and operating as a Meta Business Partner, Guardii provides detection across Instagram, Snapchat, Discord, Roblox and other messaging environments, with a dedicated anti-CSAM module that identifies child sexual abuse material including AI-generated and deepfake imagery by analyzing transmission patterns and conversational context rather than inspecting every message. The approach surfaces children at immediate risk to parents, schools or the eSafety Commissioner without imposing the privacy cost or operational overhead of blanket content surveillance, addressing the harm the legislation targets while preserving the architecture of secure communication.