Study Finds Apple and Google Parental Controls Failed to Block AI Nudify Apps
Guardii Analysis
An investigation published in October 2026 found that many AI nudification apps available through Apple and Google app marketplaces were inaccurately rated as suitable for minors, allowing teen users to access them even when parental controls were activated. The report highlighted that enforcement mechanisms on both platforms rely heavily on self-reported developer classifications, with many explicit programs miscategorized for younger audiences. The investigation referenced a Pennsylvania case in which a high school student used the Movely app to create nonconsensual explicit material targeting peers, resulting in criminal harassment charges and ongoing emotional harm to affected families.
Platform-level content filtering addresses supply; conversation-level threat detection addresses demand and delivery. A world-leading AI online-safety platform detects not whether a tool exists in an app store but whether a child is being solicited to share an image, threatened with distribution of manipulated content, or coerced into compliance after a deepfake has been created. The anti-sextortion and anti-CSAM filters, integrated across the social and gaming platforms where peer abuse most often occurs, surface the extortion attempt, the image demand, and the acute-distress signal in real time, reporting the shape and seriousness of the threat to a parent or school rather than handing anyone a transcript. The system blocks hostile contact before it reaches the target, enabling rapid response to a child in crisis and immediate escalation to law enforcement when a crime is underway.
