OpenAI releases CSAM classifier and makes it freely available
Understand this story
OpenAI announced in Washington the launch of a child sexual abuse material (CSAM) classifier, saying it can better identify such images and determine whether they are AI-generated, and is making it freely available to vetted organizations. OpenAI said the classifier reduced flagged images by 48%, doubled the probability that flagged images contain abuse material, and called it the first widely available CSAM classifier with AI-generated markers. OpenAI also said it will provide developers with guidance on detecting such content and help train law enforcement to use AI-assisted investigations. On the ChatGPT side, users attempting to generate such content will see a new warning; a first violation will trigger a 24-hour access suspension, and accounts may be permanently closed.
AI overview based on source reports · Updated 1 days ago
Coverage timeline
Follow the coverage to explore different perspectives.
- The Verge · AIOpenAI wants to stop deepfakes from overwhelming child abuse tiplines
OpenAI announced a classifier it says better detects abusive imagery of children, including whether it is AI-generated, and is offering free access to vetted organizations along with developer guidance and law enforcement training. The company says the tool flags 48 percent fewer images while those it identifies are twice as likely to contain abusive material, and ChatGPT users who attempt to generate CSAM will face a 24-hour pause and a warning. The announcement comes as NCMEC's CyberTipline received 400,000 generative AI-related reports in 2025, up from 67,000 in 2024.
- TechCrunch · AIOpenAI releases a new image classifier and ChatGPT warnings to combat CSAM
OpenAI announced a new image classifier that detects CSAM, including AI-generated images, which it is giving select companies free API access to; it was developed with NCMEC and in early partner testing flags 48% fewer images while finding the same number of abusive images. ChatGPT will add warning screens, direct users toward specialized support, and suspend accounts for 24 hours as a warning for prompts seeking material that sexualizes children, with repeated offenses potentially leading to permanent removal. OpenAI is also publishing developer guidelines and providing law enforcement with AI-powered tools, investigative plugins, data analysis, training and a field guide.
Activity for this story
- Current comparable activity
- 4
- Peak comparable activity
- 10Nov 17 04:00
- Change in the past 24 hours
- -49%
Trends compare the same fully observed participants, which may cover fewer participants than current activity. Move the pointer or tap the chart to inspect hourly activity; use the left and right arrow keys with a keyboard.