Connect with us

Hi, what are you looking for?

Top Stories

Amazon Reports 1M AI-Related CSAM Cases, Sources Remain Unclear Amid Safety Concerns

Amazon reported over 1 million AI-related child sexual abuse material cases in 2025, sparking safety concerns amid unclear data sources and inadequate reporting.

The National Center for Missing and Exploited Children (NCMEC) reported receiving over 1 million instances of AI-related child sexual abuse material (CSAM) in 2025, with the majority of these reports traced back to Amazon. The e-commerce giant detected this inappropriate content in its training data, as noted in an investigation by Bloomberg. Amazon acknowledged that the CSAM was sourced from external data used to train its AI services but refrained from providing further details about the origins of this content.

In a statement to Engadget, Amazon explained that the reporting channel established in 2024 was designed with limitations due to the third-party nature of the scanned data. The company stated, “When we set up this reporting channel in 2024, we informed NCMEC that we would not have sufficient information to create actionable reports, because of the third-party nature of the scanned data.” This decision was made to avoid diluting the efficacy of their other reporting channels. As a result, Amazon’s reports lacked the actionable data that would allow NCMEC to pass information to law enforcement.

Fallon McNulty, executive director of NCMEC’s CyberTipline, described Amazon’s high volume of reports as an anomaly that raises significant questions regarding the sources of the data and the safeguards in place. “Having such a high volume come in throughout the year begs a lot of questions about where the data is coming from, and what safeguards have been put in place,” McNulty told Bloomberg. She pointed out that other companies provided actionable data, which could facilitate law enforcement intervention, a stark contrast to Amazon’s less useful reports.

Amazon reiterated its commitment to preventing CSAM through various business operations and claimed that its AI models had not generated any child exploitation material. In line with its Generative AI Principles to Prevent Child Abuse, the company stated, “We take a deliberately cautious approach to scanning foundation model training data, including data from the public web, to identify and remove known CSAM and protect our customers.” However, Amazon also acknowledged that its proactive measures do not yield the same level of detail in the NCMEC reports as consumer-facing tools.

To account for the high volume of reports, Amazon explained that it employs an intentionally over-inclusive threshold for scanning, which results in a significant number of false positives. The increase in AI-related CSAM reports has highlighted safety concerns surrounding minors, a topic that has gained increasing visibility within the artificial intelligence sector recently. NCMEC’s records revealed that the number of AI-related reports surged from 67,000 in 2024 to over 1 million in 2025, compared to merely 4,700 in 2023.

The implications of this surge are multifaceted, as AI chatbots have been implicated in troubling incidents involving minors. Companies like OpenAI and Character.AI are facing lawsuits after reports of teenagers using their platforms to plan suicides. Additionally, Meta is being sued for alleged shortcomings in protecting young users from inappropriate interactions with chatbots. As these incidents unfold, the responsibility of AI developers to safeguard against abusive content is under intense scrutiny.

Update, January 30, 2026, 11:05AM ET: This story has been updated to include several statements from Amazon.

See also
Staff
Written By

The AiPressa Staff team brings you comprehensive coverage of the artificial intelligence industry, including breaking news, research developments, business trends, and policy updates. Our mission is to keep you informed about the rapidly evolving world of AI technology.

You May Also Like

Top Stories

Amazon cuts 30,000 jobs to redirect capital towards a $50 billion investment in OpenAI, aiming to enhance profitability in an AI-driven future

Top Stories

Amazon cuts 16,000 corporate jobs as AI transforms workforce dynamics, while Meta invests $135 billion in AI infrastructure to redefine market leadership

Top Stories

Amazon's strategic shift includes a potential $50 billion stake in OpenAI while closing multiple Fresh and Go stores and cutting 16,000 jobs.

Top Stories

Amazon cuts 16,000 jobs, representing 10% of its corporate workforce, while advancing a $50 billion investment deal with OpenAI to reshape its AI strategy.

Top Stories

Amazon is in talks to invest $50 billion in OpenAI, aiming to elevate its valuation to $830 billion amid fierce competition in the AI...

Top Stories

Seattle's Invest India Forum reveals $2B investment opportunities in AI, Ag-Tech, and Healthcare, uniting major players like Microsoft and Amazon for deeper U.S.-India ties

Top Stories

Amazon is in advanced talks to invest $50 billion in OpenAI, potentially reshaping the AI landscape and solidifying AWS's role as a key cloud...

Top Stories

Amazon cuts 16,000 jobs amid robust growth, signaling a strategic shift towards AI automation and streamlined operations in a post-pandemic workforce.

© 2025 AIPressa · Part of Buzzora Media · All rights reserved. This website provides general news and educational content for informational purposes only. While we strive for accuracy, we do not guarantee the completeness or reliability of the information presented. The content should not be considered professional advice of any kind. Readers are encouraged to verify facts and consult appropriate experts when needed. We are not responsible for any loss or inconvenience resulting from the use of information on this site. Some images used on this website are generated with artificial intelligence and are illustrative in nature. They may not accurately represent the products, people, or events described in the articles.