A recent survey conducted by Rubrik Zero Labs reveals critical security challenges associated with the rise of AI agents, as 86% of organizations anticipate these systems will exceed their security measures within the next year. The findings indicate that, despite the promise of efficiency, over 80% of respondents believe that AI agents necessitate greater manual oversight than they provide.
The survey also points to a troubling trend, with many organizations expecting AI-driven systems to become the primary source of cyberattacks in the upcoming year. Paradoxically, while reliance on AI grows, only 23% of those surveyed report having full visibility into the AI agents operating within their environments. This lack of oversight is exacerbated by a significant gap in identity governance, as organizations increasingly adopt autonomous systems that remain largely unmonitored and difficult to restore.
The proliferation of non-human identities linked to AI agents is accelerating, outpacing enterprises’ abilities to track or manage them, resulting in what the report labels a “shadow workforce.” Compounding this issue, a staggering 88% of respondents lack the capability to reverse actions taken by AI agents without risking system disruptions. This situation raises alarms about the capacity of organizations to meet recovery objectives amid escalating threats from these agent-driven systems.
Nearly half of the leaders surveyed expect AI systems to be the primary drivers of cyberattacks within the next year, underscoring a widespread concern about the implications of their increasing use. The report merges global survey data with technical insights into emerging attack vectors across AI systems, drawing attention to the risks posed by the rapid integration of AI technologies into business operations.
Kavitha Mariappan, Chief Transformation Officer at Rubrik, stressed the urgent need to confront these challenges head-on. “We have to move past the debate of whether AI is risky and address the harder reality: as decision-making shifts from human to machine, the critical challenge for every leader is maintaining operational safety in an increasingly autonomous landscape,” she said. Mariappan further emphasized that AI adoption is outpacing the ability to control it, noting that enterprises are struggling because they have deployed systems they cannot fully observe, govern, or restore.
In the context of these findings, Steven Ramirez, Chief Information Security & Technology Officer at Renown Health, highlighted the essential role of identity verification in managing AI systems. “Identity verification is the fundamental underpinning that will allow us to get the greatest automation benefits of AI without imposing human bottlenecks. Verification and visibility are prerequisites for sound, secure agentic implementation,” he remarked.
The survey underscores a pivotal moment in the evolution of AI technology, as organizations grapple with the dual challenges of leveraging its benefits while mitigating the risks associated with its uncontrolled growth. As AI continues to integrate into various aspects of business operations, the need for robust governance frameworks and oversight mechanisms becomes increasingly vital.
In light of these findings, industry leaders face a pressing imperative: they must enhance their oversight capabilities to better manage the complexities introduced by AI agents. As the landscape evolves, the importance of securing AI systems will only amplify, necessitating an ongoing dialogue about best practices and strategies to navigate this transformative yet precarious frontier.
See also
Anthropic’s Claims of AI-Driven Cyberattacks Raise Industry Skepticism
Anthropic Reports AI-Driven Cyberattack Linked to Chinese Espionage
Quantum Computing Threatens Current Cryptography, Experts Seek Solutions
Anthropic’s Claude AI exploited in significant cyber-espionage operation
AI Poisoning Attacks Surge 40%: Businesses Face Growing Cybersecurity Risks
