Connect with us

Hi, what are you looking for?

Top Stories

Amazon Reports 1M AI-Related CSAM Cases, Sources Remain Unclear Amid Safety Concerns

Amazon reported over 1 million AI-related child sexual abuse material cases in 2025, sparking safety concerns amid unclear data sources and inadequate reporting.

The National Center for Missing and Exploited Children (NCMEC) reported receiving over 1 million instances of AI-related child sexual abuse material (CSAM) in 2025, with the majority of these reports traced back to Amazon. The e-commerce giant detected this inappropriate content in its training data, as noted in an investigation by Bloomberg. Amazon acknowledged that the CSAM was sourced from external data used to train its AI services but refrained from providing further details about the origins of this content.

In a statement to Engadget, Amazon explained that the reporting channel established in 2024 was designed with limitations due to the third-party nature of the scanned data. The company stated, “When we set up this reporting channel in 2024, we informed NCMEC that we would not have sufficient information to create actionable reports, because of the third-party nature of the scanned data.” This decision was made to avoid diluting the efficacy of their other reporting channels. As a result, Amazon’s reports lacked the actionable data that would allow NCMEC to pass information to law enforcement.

Fallon McNulty, executive director of NCMEC’s CyberTipline, described Amazon’s high volume of reports as an anomaly that raises significant questions regarding the sources of the data and the safeguards in place. “Having such a high volume come in throughout the year begs a lot of questions about where the data is coming from, and what safeguards have been put in place,” McNulty told Bloomberg. She pointed out that other companies provided actionable data, which could facilitate law enforcement intervention, a stark contrast to Amazon’s less useful reports.

Amazon reiterated its commitment to preventing CSAM through various business operations and claimed that its AI models had not generated any child exploitation material. In line with its Generative AI Principles to Prevent Child Abuse, the company stated, “We take a deliberately cautious approach to scanning foundation model training data, including data from the public web, to identify and remove known CSAM and protect our customers.” However, Amazon also acknowledged that its proactive measures do not yield the same level of detail in the NCMEC reports as consumer-facing tools.

To account for the high volume of reports, Amazon explained that it employs an intentionally over-inclusive threshold for scanning, which results in a significant number of false positives. The increase in AI-related CSAM reports has highlighted safety concerns surrounding minors, a topic that has gained increasing visibility within the artificial intelligence sector recently. NCMEC’s records revealed that the number of AI-related reports surged from 67,000 in 2024 to over 1 million in 2025, compared to merely 4,700 in 2023.

The implications of this surge are multifaceted, as AI chatbots have been implicated in troubling incidents involving minors. Companies like OpenAI and Character.AI are facing lawsuits after reports of teenagers using their platforms to plan suicides. Additionally, Meta is being sued for alleged shortcomings in protecting young users from inappropriate interactions with chatbots. As these incidents unfold, the responsibility of AI developers to safeguard against abusive content is under intense scrutiny.

Update, January 30, 2026, 11:05AM ET: This story has been updated to include several statements from Amazon.

See also
Staff
Written By

The AiPressa Staff team brings you comprehensive coverage of the artificial intelligence industry, including breaking news, research developments, business trends, and policy updates. Our mission is to keep you informed about the rapidly evolving world of AI technology.

You May Also Like

AI Generative

Nvidia's partnerships with Asian firms like LG and Nanya surge AI chip demand to 90% of production costs, reshaping the tech landscape in Asia.

AI Generative

Academy excludes AI-generated performances and scripts from Oscars, reshaping synthetic media valuations and investor confidence in AI tools that enhance human creativity.

Top Stories

Apple's Q2 earnings reveal a price hike for the Mac mini to $799, fueled by AI memory demand, as Google and Amazon also report...

AI Technology

Major tech giants, including Google and Amazon, are set to invest $3.7 trillion in AI infrastructure over five years, reshaping the workforce and economy.

AI Technology

Amazon and Anthropic expand their partnership with a $100B investment in AWS, enhancing AI infrastructure and accelerating generative AI adoption globally.

AI Finance

Blue Owl reports a 15% year-on-year asset management growth to $315 billion, targeting Big Tech's increased AI spending, now forecasted over $700 billion.

Top Stories

Amazon's stock slips 0.39% to $262.01 as CEO Doug Clinton warns of near-term earnings pressure amid significant AI investments, including $200B in capital spending.

AI Finance

Amazon and Google report record cloud growth, with AWS revenue at $37.6B and Google Cloud up 63% to $20B, while Meta and Microsoft face...

© 2025 AIPressa · Part of Buzzora Media · All rights reserved. This website provides general news and educational content for informational purposes only. While we strive for accuracy, we do not guarantee the completeness or reliability of the information presented. The content should not be considered professional advice of any kind. Readers are encouraged to verify facts and consult appropriate experts when needed. We are not responsible for any loss or inconvenience resulting from the use of information on this site. Some images used on this website are generated with artificial intelligence and are illustrative in nature. They may not accurately represent the products, people, or events described in the articles.