California enacts strictest US laws on AI-generated child sexual abuse material
Guardii Analysis
California Governor Gavin Newsom signed two bills into law on 26 September 2024 that criminalise the possession and distribution of digitally created or altered child sexual abuse material and remove the requirement that prosecutors prove an image depicts a real child, making California the first US state to explicitly outlaw AI-generated synthetic child sexual abuse material regardless of whether an identifiable victim exists. The legislation, Assembly Bills 1850 and 2089, also increase penalties for offenders who use artificial intelligence tools to produce or distribute such content and require platforms to implement processes for reporting and removing the material, with supporters citing evidence from the National Center for Missing and Exploited Children that reports of AI-generated child sexual abuse material have surged over the past eighteen months.
Legislation that mandates platform reporting obligations is effective only when the content in question is posted or shared, yet much of the acute harm in grooming and sextortion occurs in the pre-distribution phase, during direct-message exchanges in which an offender solicits material, establishes trust or escalates coercion. Guardii's real-time detection architecture addresses that operational gap: deployed as a layer within Instagram, Snapchat, Discord and other messaging environments, the platform's anti-grooming and anti-CSAM modules analyse conversational patterns as they develop, intercepting solicitation and image-based abuse before a minor is manipulated into compliance or before synthetic material is weaponised for extortion, and escalating high-severity incidents directly to law enforcement or child-protection authorities without requiring the platform to have first published the content in a reportable form.
