New Zealand passes Online Safety Act requiring platforms to mitigate harmful content

New Zealand's parliament has passed the Online Safety Act, which creates a regulatory framework requiring online content platforms to identify, assess and mitigate the risk of online harms including child sexual exploitation material, violent extremist content and content promoting suicide or self-harm. The legislation establishes a new Online Safety Commission within the Department of Internal Affairs, empowers the regulator to issue codes of practice and compliance notices, and introduces penalties including fines for platforms that fail to meet their safety obligations.

Statutory obligations to identify and mitigate harm are meaningful only when platforms have access to detection systems capable of recognising abuse as it unfolds in real time, particularly in direct-message environments where the majority of grooming, sextortion and exploitation now occurs. A code of practice that mandates risk assessment but does not specify the technical mechanism leaves platforms to choose between reactive content moderation, which arrives too late, and invasive monitoring, which is neither proportionate nor privacy-preserving. Pattern-based detection offers a third path: analysing the shape and trajectory of a conversation to surface escalation, coercion and sustained targeting without inspecting every exchange. Guardii identifies those patterns across Instagram, Snapchat, Discord, Roblox and other messaging platforms, flagging conversations that meet thresholds for grooming, sextortion, child sexual abuse material distribution or acute distress, and alerting the appropriate authority or caregiver so that a platform can demonstrate effective mitigation without building a surveillance infrastructure.