The Dual Nature of AI in Cybersecurity: Opportunities and Risks

Artificial intelligence (AI) is increasingly becoming a pivotal force in cybersecurity, influencing both defensive and offensive strategies. As organizations adopt AI-driven solutions, they face a dual-edged sword: while AI enhances security measures, it also presents new vulnerabilities and risks. Recent developments highlight the urgent need for robust governance and security frameworks to manage these complexities.

AI agents in business create new risks & urgent security needs

AAEON Technology has introduced a software security system designed for NVIDIA Jetson-powered embedded AI systems. This system employs a three-tiered architecture to secure AI models and sensitive data through encrypted APIs and secure operating system features. Key components include a trusted execution environment (TEE) named MAZU, which isolates machine learning algorithms from standard applications, and centralized web-based monitoring tools for edge devices. This innovation aims to bolster the security of AI systems against evolving cyber threats.

Software that uses artificial intelligence (AI) for trusted computing and cyber security offered by AAEONAI agents in business create new risks & urgent security needs

In Singapore, SPTel has launched AI-Security, a tool aimed at small and medium-sized enterprises (SMEs) to identify and assess cyber risks. This solution provides 24/7 monitoring of cybersecurity advisories and vulnerabilities, enabling SMEs to respond quickly to threats without the need for extensive cybersecurity manpower. The Cyber Security Agency of Singapore reports that over 80% of organizations experience at least one cybersecurity incident annually, underscoring the importance of such tools.

SPTel Launches AI-Security, an AI Tool to Enhance SMEs’ Cyber Defence CapabilitiesInsurance Business AmericaAre you really ready for AI? Exposing shadow tools in your organisation

Conversely, the rise of AI has also facilitated new forms of cyberattacks. Hackers are increasingly leveraging AI tools, such as HexStrike AI, to exploit vulnerabilities in systems like Citrix NetScaler. This AI-powered framework, initially designed for security testing, has been weaponized to conduct zero-day attacks, significantly reducing the time required for exploitation. The rapid adaptation of AI for malicious purposes highlights the urgent need for organizations to enhance their defenses.

HexStrike AI exploited for zero-day attacksAre you really ready for AI? Exposing shadow tools in your organisation

Additionally, the phenomenon of "Shadow AI"—the use of unapproved AI tools within organizations—poses significant risks. Research indicates that 80% of companies exhibit signs of this behavior, leading to potential data leaks as employees utilize unsecured tools for productivity. Organizations must implement clear AI governance policies and training to mitigate these risks.

Are you really ready for AI? Exposing shadow tools in your organisationShadow AI is Everywhere: XM Cyber Finds 80% of Companies Show Signs of Unapproved AI Activity

As AI systems become integral to business operations, the cybersecurity landscape is evolving. Radware's report on the "Internet of Agents" emphasizes the need for organizations to adjust their security models to account for the roles played by AI agents. These systems, capable of autonomous decision-making and action, create complex pathways into sensitive resources that are difficult to track and secure.

AI agents in business create new risks & urgent security needsCisco Elevates the SOC with Agentic AI

To address these challenges, organizations are advised to treat AI agents as privileged actors, subject to strict governance and access controls. This includes integrating red-teaming exercises into software development and investing in detection technologies tailored for autonomous AI systems.

AI agents in business create new risks & urgent security needs

The integration of AI into cybersecurity presents both opportunities and challenges. While AI can enhance threat detection and response, it also introduces new vulnerabilities that must be managed proactively. As organizations navigate this evolving landscape, the emphasis on robust security frameworks and governance will be crucial to harnessing the benefits of AI while mitigating its risks. The future of cybersecurity will depend on the ability to balance innovation with effective oversight.

AI agents in business create new risks & urgent security needs