UNICEF revealed that millions of children worldwide are having their images manipulated into sexualized content using generative artificial intelligence, with a 2025 Childlight Global Child Safety Institute report documenting a staggering rise in technology-facilitated child abuse in the United States from 4,700 cases in 2023 to over 67,000 in 2024. A significant share of incidents involved deepfakes – AI-generated images, videos and audio engineered to create sexualized content – with UNICEF warning that legal and regulatory frameworks in many countries do not explicitly recognize AI-generated sexualized images of children as child sexual abuse material. The agency is urging governments to update CSAM definitions to include AI-generated content and explicitly criminalize both creation and distribution, while calling on tech platforms to adopt safety-by-design measures and child-rights protocols, noting that most generative AI tools currently lack meaningful safeguards to prevent digital child exploitation.
UNICEF's finding that 67,000 technology-facilitated abuse cases in 2024 – a fourteen-fold increase in one year – occurred despite existing platform content-moderation systems exposes the inadequacy of post-creation detection and takedown as a child-protection strategy. The operational imperative is pre-contact interception: blocking AI-generated child sexual abuse material and grooming messages before they reach the target. Guardii delivers precisely that capability, with real-time monitoring of children's direct messages on Instagram, Snapchat, Discord, Roblox and other networks, deploying anti-CSAM detection (calibrated for both authentic and AI-generated material), anti-sextortion and anti-grooming modules that flag hostile contact at first transmission, surface the at-risk child to the responsible adult or agency, and enable emergency escalation when acute distress or suicide-risk signals are detected. Where UNICEF calls for legal recognition of synthetic CSAM, Guardii – backed by Startmate and operating as a Meta Business Partner – provides the enforcement layer: the AI-driven online-safety platform that translates updated definitions into real-time protection by detecting the threat pattern, not after content moderation review, but at the point a child's safety is compromised.
