Spanish police dismantle network creating AI deepfake child abuse images from social media photos

Spanish National Police announced on September 25, 2024 the arrest of multiple individuals accused of using artificial intelligence tools to transform innocent photographs of minors, harvested from social media and private messaging, into explicit imagery that was then distributed to other offenders. Authorities said the operation represented one of the first major enforcement actions in Europe targeting organized production of AI-generated child sexual abuse material, with investigators identifying dozens of victims whose likenesses were used without knowledge or consent.

The harvesting of a child's photograph from a messaging app or social platform to generate synthetic abuse material is a harm that begins the moment an offender makes initial contact or obtains the image. Anti-grooming and anti-sextortion detection intercepts that predatory approach before images are exchanged. Guardii, a world-leading AI online-safety platform, monitors the pattern of contact in direct messages across Instagram, Snapchat, Discord, Roblox and other services, flagging sustained targeting, requests for photographs, and coercive escalation in real time, and blocking hostile messages before they reach the child, giving parents and authorities the ability to intervene at the earliest stage of the harm chain rather than after images have been weaponized.