Connect with us

Hi, what are you looking for?

Top Stories

Amazon Reports 1M AI-Related CSAM Cases, Sources Remain Unclear Amid Safety Concerns

Amazon reported over 1 million AI-related child sexual abuse material cases in 2025, sparking safety concerns amid unclear data sources and inadequate reporting.

The National Center for Missing and Exploited Children (NCMEC) reported receiving over 1 million instances of AI-related child sexual abuse material (CSAM) in 2025, with the majority of these reports traced back to Amazon. The e-commerce giant detected this inappropriate content in its training data, as noted in an investigation by Bloomberg. Amazon acknowledged that the CSAM was sourced from external data used to train its AI services but refrained from providing further details about the origins of this content.

In a statement to Engadget, Amazon explained that the reporting channel established in 2024 was designed with limitations due to the third-party nature of the scanned data. The company stated, “When we set up this reporting channel in 2024, we informed NCMEC that we would not have sufficient information to create actionable reports, because of the third-party nature of the scanned data.” This decision was made to avoid diluting the efficacy of their other reporting channels. As a result, Amazon’s reports lacked the actionable data that would allow NCMEC to pass information to law enforcement.

Fallon McNulty, executive director of NCMEC’s CyberTipline, described Amazon’s high volume of reports as an anomaly that raises significant questions regarding the sources of the data and the safeguards in place. “Having such a high volume come in throughout the year begs a lot of questions about where the data is coming from, and what safeguards have been put in place,” McNulty told Bloomberg. She pointed out that other companies provided actionable data, which could facilitate law enforcement intervention, a stark contrast to Amazon’s less useful reports.

Amazon reiterated its commitment to preventing CSAM through various business operations and claimed that its AI models had not generated any child exploitation material. In line with its Generative AI Principles to Prevent Child Abuse, the company stated, “We take a deliberately cautious approach to scanning foundation model training data, including data from the public web, to identify and remove known CSAM and protect our customers.” However, Amazon also acknowledged that its proactive measures do not yield the same level of detail in the NCMEC reports as consumer-facing tools.

To account for the high volume of reports, Amazon explained that it employs an intentionally over-inclusive threshold for scanning, which results in a significant number of false positives. The increase in AI-related CSAM reports has highlighted safety concerns surrounding minors, a topic that has gained increasing visibility within the artificial intelligence sector recently. NCMEC’s records revealed that the number of AI-related reports surged from 67,000 in 2024 to over 1 million in 2025, compared to merely 4,700 in 2023.

The implications of this surge are multifaceted, as AI chatbots have been implicated in troubling incidents involving minors. Companies like OpenAI and Character.AI are facing lawsuits after reports of teenagers using their platforms to plan suicides. Additionally, Meta is being sued for alleged shortcomings in protecting young users from inappropriate interactions with chatbots. As these incidents unfold, the responsibility of AI developers to safeguard against abusive content is under intense scrutiny.

Update, January 30, 2026, 11:05AM ET: This story has been updated to include several statements from Amazon.

See also
Staff
Written By

The AiPressa Staff team brings you comprehensive coverage of the artificial intelligence industry, including breaking news, research developments, business trends, and policy updates. Our mission is to keep you informed about the rapidly evolving world of AI technology.

You May Also Like

AI Technology

Nebius reports a 547% revenue surge to $227.7M in Q4 2025, plans a major 240MW data center in France, but faces a $173M adjusted...

AI Marketing

Microsoft and Amazon unveil content-licensing marketplaces for AI, empowering publishers with predictable revenue streams and transforming ecommerce strategies.

Top Stories

Montage Technology's IPO on the Hong Kong Stock Exchange raised $902 million, soaring 64% on its first day and reinforcing investor confidence in China's...

AI Business

Ant Group pivots to AI-driven healthcare, targeting the $69 billion market to tackle China's healthcare challenges amid regulatory shifts and rising chronic diseases.

Top Stories

OpenAI and Anthropic are set to secure over $20 billion in unprecedented funding, with major investors like Sequoia Capital and Altimeter Capital reshaping AI...

AI Finance

Meta unveils plans for a $10B data center in Indiana with over 1 gigawatt capacity, marking a major push in AI infrastructure amid rising...

Top Stories

Amazon secures FCC approval to launch 4,500 additional satellites, expanding Project Kuiper to 7,700 and intensifying competition with SpaceX's Starlink.

AI Technology

Amazon is advancing plans for a Publisher Content Marketplace to enhance AI training data access, responding to growing industry demand and publisher concerns.

© 2025 AIPressa · Part of Buzzora Media · All rights reserved. This website provides general news and educational content for informational purposes only. While we strive for accuracy, we do not guarantee the completeness or reliability of the information presented. The content should not be considered professional advice of any kind. Readers are encouraged to verify facts and consult appropriate experts when needed. We are not responsible for any loss or inconvenience resulting from the use of information on this site. Some images used on this website are generated with artificial intelligence and are illustrative in nature. They may not accurately represent the products, people, or events described in the articles.