2 / 2338

OpenAI wants to stop deepfakes from overwhelming child abuse tiplines

TL;DR

OpenAI is announcing a tool that it says will help child sexual abuse investigators cut through the noise to find harmful material they can act on quickly. At a Monday press briefing in Washington, DC, OpenAI announced a classifier it says can better detect abusive imagery of kids, including whether it's AI-generated.

Nauti's Take

For small teams, the first useful test is the classifier’s error profile inside the actual moderation or reporting workflow. Check how reliably it prioritizes synthetic and real abuse material, which legitimate content it blocks, and whether the organization can explain its results.

A single announcement does not yet establish how well it works in practice.

Sources