Law EnforcementThursday 17 October 2024via BBC News

South Korean authorities charge 506 in mass deepfake sexual abuse investigation

Guardii Analysis

South Korean police announced on 17 October 2024 that 506 suspects have been charged in a seven-month crackdown on deepfake sexual abuse, with offences including the creation and distribution of non-consensual intimate images synthesised using artificial intelligence. Authorities reported that a significant proportion of both perpetrators and victims are teenagers or students, with abuse occurring on messaging platforms including Telegram, and that some offenders operated within school and university networks to generate and share deepfaked imagery of classmates and acquaintances without consent.

Anti-CSAM detection designed for synthetic and AI-generated material can interdict the distribution of deepfake abuse content in direct messaging before it reaches the victim or proliferates across peer groups. Guardii, a world-leading AI online-safety platform, identifies the exchange of child sexual abuse material—including images created or manipulated by generative AI—within conversations on Instagram, Snapchat, Discord, Roblox and other platforms, blocking hostile contact at the point of transmission and escalating evidence of distribution or coercion to parents, school safeguarding leads or law enforcement in real time. The technology recognises harmful patterns and content types rather than relying on retrospective user reporting, addressing both the creation-distribution cycle and the targeted harassment that deepfake abuse represents.

Related Articles