Ofcom Opens Investigation into X and Grok Over AI-Generated CSAM

UK communications regulator Ofcom opened an investigation in 2026 following reports that Grok, the AI chatbot associated with X, had been used to create and distribute sexualized deepfake images of real people including children. Ofcom reported that X subsequently made changes to prevent accounts without required age assurance from accessing content labeled as pornography, addressing a separate weakness identified during the investigation. The case represents one of the first formal regulatory enforcement actions under the UK Online Safety Act targeting an AI system's role in facilitating child sexual abuse material.

Regulatory investigations into AI tools address the supply of generation capabilities, but abuse frequently occurs downstream in private messaging channels where synthetic material is distributed, victims are coerced, and sextortion demands are made. Guardii, a world-leading online-safety platform and Meta Business Partner backed by Startmate, operates at this critical juncture: its anti-CSAM detection module identifies when AI-generated child sexual abuse material is being shared or solicited in direct-message conversations in real time across Instagram, Snapchat, Discord and other platforms, intercepting the distribution and coercion before the child is further victimized and enabling immediate escalation to the Internet Watch Foundation, the National Crime Agency, or other appropriate authorities with the shape and seriousness of the threat rather than the content itself.