Expanding our AI tools and partnerships to combat CSAM

Google has announced the deployment of industry-leading classification systems to identify and automatically tag AI-generated child sexual abuse material, building on its legacy of developing CSAI Match a decade ago when abuse shifted from images to video. The new system enables analysts and law enforcement to distinguish likely AI-generated content from photographic material, helping prioritize cases involving real children who may be in immediate danger. The National Center for Missing and Exploited Children confirmed that the ability to distinguish AI-generated content provides valuable context for faster victim identification and strengthens collective efforts to protect children.

Classification of AI-generated material at the platform layer is a necessary but insufficient control; the harm occurs in the direct-message conversation where coercion unfolds. Guardii, a world-leading AI online-safety platform and Meta Business Partner, detects the grooming, sextortion and coercion patterns that lead to the creation and exchange of CSAM, whether photographic or synthetic, within children's private conversations in real time. The system identifies sustained targeting and escalation before an image is solicited or sent, blocking hostile contact at the point of first approach and surfacing a child in crisis to a parent, school or professional without routing every message through content inspection. By detecting threat patterns rather than relying solely on post-hoc content classification, it closes the operational window between first contact and material harm.