Australia's eSafety Commissioner published data on 7 August 2024 showing a 450 percent year-on-year increase in reports of deepfake and nudification abuse targeting children and adolescents, with 1,287 complaints received in the first half of 2024 compared to 234 in the same period of 2023. The report identifies widely accessible nudification applications and browser-based AI image generators as the primary tools, noting that victims as young as 12 have had clothed photographs manipulated into explicit synthetic imagery and circulated within school communities via social media and messaging apps, causing severe psychological distress and reputational harm.
Real-time monitoring at the point of message exchange intercepts this category of harm before synthetic imagery reaches the target or wider peer group. Detection architecture trained on anti-CSAM and abuse-of-women patterns recognises both the visual signature of AI-manipulated nudity and the coercive language frequently accompanying distribution or threatened distribution, blocking the message automatically or surfacing an alert to a parent, school safeguarding lead or platform moderator within seconds, and enabling coordinated reporting to authorities such as the eSafety Commissioner where a criminal threshold is evident, compressing the response cycle that offline complaint channels cannot match.
