AI ThreatsTuesday 3 September 2024via BBC News

Meta reveals 20 million child sexual abuse images reported in three months

Guardii Analysis

Meta reported more than 20 million suspected child sexual abuse images to the National Center for Missing and Exploited Children in the first quarter of 2024, according to figures disclosed in early September 2024, with the company attributing the scale to improved detection technology and acknowledging that a growing proportion of the material is AI-generated. The disclosure came as Meta faces regulatory pressure in the UK and EU to demonstrate compliance with new online safety laws requiring platforms to proactively detect and remove illegal content, with child safety groups warning that the volume of reports reflects both the scale of the problem and the limitations of reactive moderation that relies on content already being shared.

Preventing abuse material from completing its journey to a recipient is a different operational problem from cataloguing what has already been distributed. Real-time pattern detection identifies the conversational precursors to CSAM sharing, the coercion and reciprocal exchange dynamic that precedes image transmission, enabling intervention before material circulates. As a Meta Business Partner, Guardii deploys anti-CSAM and anti-sextortion detection across direct messaging on Instagram and other platforms, analysing the structure and escalation of a conversation rather than scanning image content, surfacing a child at risk to a parent or safeguarding professional and blocking hostile contact before it reaches the target, addressing the harm at the point it originates rather than after distribution.

Related Articles