Australia's eSafety Commissioner issued formal notices in August 2024 to major technology companies including Meta, Google, Apple, Microsoft, Discord, Snap and others, demanding detailed information on measures taken to detect, remove and prevent AI-generated child sexual abuse material on their platforms. The notices, issued under the Online Safety Act, require companies to disclose how their detection systems identify synthetic CSAM, how they respond to reports, and what proactive steps they are taking to prevent the distribution of such content. Commissioner Julie Inman Grant stated that AI-generated material now represents a significant and growing proportion of child abuse imagery circulating online and that regulatory scrutiny of platform responses is overdue.
Platform-layer detection is the control point the Commissioner's notices address: identifying synthetic child abuse material as it is transmitted through direct messages and communities before it proliferates. Guardii's anti-CSAM module monitors DMs in real time across Instagram, Snapchat, Discord, Roblox and other services, scanning for known and AI-generated abuse material using pattern recognition rather than reading every message. When hostile content is detected, the system blocks or quarantines it, alerts the parent, school or safeguarding team, and generates a structured record that meets the evidentiary and reporting standards regulators and law enforcement require. This capability gives platforms and the institutions they serve a defensible answer to the Commissioner's central question: not whether abuse material exists, but whether it can reach a child.
