Australia eSafety Commissioner orders removal of AI-generated CSAM from messaging platform

Australia's eSafety Commissioner issued a formal removal notice on 3 September 2026 compelling an unnamed encrypted messaging service to take down AI-generated child sexual abuse material identified on the platform and to provide information on the accounts involved in its creation and distribution. The notice, issued under the Online Safety Act 2021, represents the first public use of the Commissioner's enforcement powers specifically targeting synthetic CSAM and follows intelligence indicating that users were employing generative AI tools to produce and share explicit depictions of fictitious children within private group chats. The regulator warned that failure to comply within the statutory 24-hour period would result in daily penalties and potential platform blocking orders, and confirmed it had referred the matter to the Australian Federal Police for criminal investigation.

Enforcement actions that depend on post-hoc reporting and manual review leave synthetic abuse material in circulation during the interval between creation, discovery and removal, a gap that grows as offenders migrate to encrypted and lesser-known platforms. Guardii's anti-CSAM module addresses this interval by scanning direct-message streams in real time for both photographic and AI-generated child exploitation content, flagging matches and novel material as they enter a conversation and enabling platforms to meet statutory takedown obligations within the hours, not days, that regulators now require. Backed by Startmate and operating as a Meta Business Partner with coverage across Instagram, Snapchat, Discord and Roblox, the system reports the presence and severity of illegal material to the platform and, where configured, to authorities, without exposing moderators to the content itself and without undermining encryption, offering a compliance pathway that aligns with both the eSafety Commissioner's enforcement expectations and the operational realities of end-to-end encrypted messaging.