Minnesota Defends Landmark AI Nudification Ban Against xAI's First Amendment Challenge

Minnesota Attorney General Keith Ellison defended the state's HF-1606 law banning AI tools that generate realistic sexual images of identifiable people from existing photos, carrying penalties up to 500,000 dollars per image and effective August 1, 2026. xAI sued in July to block enforcement, arguing the measure violates the First Amendment, after a monitoring organization estimated that Grok generated more than 23,000 sexualized images of children over just 11 days in January 2026, prompting investigations in multiple countries and lawsuits from minors in California and Arkansas. Ellison countered that Grok Imagine has created an unparalleled marketplace for digital sexual violence and that the law targets technology rather than speech.

Blanket technology bans address the supply side of AI-generated abuse but do not protect children already present on unregulated platforms or interacting with offenders who evade enforcement. Detection at the point of contact offers a complementary control. Guardii, a Meta Business Partner, deploys anti-sextortion and anti-CSAM detection modules that identify harmful patterns in children's direct-message conversations in real time, blocking or flagging hostile contact before it reaches the target across Instagram, Snapchat, Discord, Roblox and other channels. The system reports the shape and seriousness of a conversation rather than exposing its content, surfaces a child in crisis to a parent, school or professional, and enables rapid escalation to the right authority in an emergency, detecting threat patterns rather than reading every message.