Skip to content
Hot eventDeveloping

OpenAI releases CSAM image classifier and ChatGPT warning screens

1 reports1 reporting sourcesUpdated 42 min ago

Start here

AI digest

OpenAI released an image classifier that detects child sexual abuse material (CSAM), including AI-generated images, and is giving select companies free API access to it, with access managed by program administrators. In early partner testing, OpenAI says the classifier flagged 48% fewer images while finding the same number of abusive images, and flagged images were twice as likely to be abusive. ChatGPT will also show a warning screen to users who attempt prompts that sexualize children, point them toward specialized support, and suspend the account for 24 hours. OpenAI said repeated offenses could lead to permanent account removal.

Generated from reports · updated 25 min ago

Report timeline

Follow the reports to see the event from different sides.

November 17
  1. TechCrunch · AI
    OpenAI releases CSAM image classifier and ChatGPT warning screens

    OpenAI released a new image classifier that detects CSAM, including AI-generated images, and is giving select companies free API access to it. In early partner testing the classifier flagged 48% fewer images while finding the same number of abusive images, and flagged images were twice as likely to be abusive. ChatGPT will also show warning screens to users attempting prompts that sexualize children, offer support resources, and suspend the account for 24 hours, with repeated offenses potentially leading to permanent removal.

Heat for this event

Not enough continuous observations yet to draw a trend.