California governor signs laws targeting AI-generated child sexual abuse material
Guardii Analysis
California Governor Gavin Newsom signed two bills into law on 24 September 2024 criminalising the creation and possession of AI-generated child sexual abuse material and requiring generative-AI providers to implement guardrails preventing their tools from producing such imagery. The legislation extends existing CSAM prohibitions to synthetic and digitally altered depictions and holds both creators and platforms accountable for material produced using artificial intelligence.
Enforcement follows creation, but Guardii's anti-CSAM detection module operates upstream, identifying the distribution and exchange of AI-generated abuse imagery in real time as it moves through direct messages on platforms including Discord, Instagram and Snapchat. The technology recognises both traditional and synthetic CSAM by evaluating image characteristics and conversation context, flagging material before it reaches the intended recipient and enabling immediate escalation to law enforcement. Where legislation establishes liability, early interception supported by a Meta Business Partner platform reduces the window in which harmful content circulates and ensures that evidence reaches investigators while the exchange is active.