Cloud Computing

How AI impacts site reliability engineering

The landscape of Site Reliability Engineering (SRE) is undergoing a profound transformation, marked by the dual forces of artificial intelligence. On one hand, advanced AI tools are emerging to empower SREs with unprecedented capabilities for managing system outages and intricate problems. On the other, the proliferation of AI-generated code is simultaneously introducing new complexities and challenges that SREs must navigate. This dynamic interplay is reshaping the critical role of SREs in ensuring the resilience, performance, and security of modern digital infrastructures.

Originally conceptualized by Google in 2003 as part of its SRE playbook, the discipline of Site Reliability Engineering has evolved significantly from its nascent stages. Initially adopted by forward-thinking startups that embraced observability for cloud-native applications and established dedicated SRE roles, the practice has now become a cornerstone of enterprise IT. As the methodologies and tools matured, larger organizations began integrating SREs as crucial bridges between development and IT operations teams. This integration aims to bolster the resilience of a wide array of applications, APIs, and complex data pipelines, underscoring the growing importance of SREs in safeguarding business-critical systems.

The SRE role itself is a demanding career path, attracting multidisciplinary engineers with a keen aptitude for investigation, robust data analytics skills, and the composure required to perform under intense pressure. Its criticality has amplified as technology becomes increasingly central to enterprise operations. Furthermore, the ascent of generative AI (GenAI) and the widespread deployment of AI agents across business functions are further cementing the SRE role as a growing and indispensable function in the contemporary tech ecosystem.

However, the increasing demand for system resiliency, coupled with escalating technological complexity, presents SREs with a formidable array of new challenges. A recent analysis, the 2026 State of Production Reliability and AI Adoption report, highlights the pervasive issue of alert fatigue. The report indicates that a significant 44% of respondents experienced outages directly linked to ignored or suppressed alerts within the past year. Compounding this, 35% of engineers reported occasionally dismissing alerts due to the sheer volume, and a staggering 57% of organizations revealed that over 70% of the alerts they receive are not actionable, leading to wasted resources and potential oversights.

This raises a critical question: Is AI a net positive for SREs, simplifying their work and enhancing the reliability of technology operations, or is it a double-edged sword, simultaneously driving complexity through the pervasive deployment of GenAI tools and AI agents across diverse business functions and automated decision-making processes?

AIops and Agentic Operations: Empowering SREs in Incident Management

Over the past decade, the SRE role has seen incremental improvements thanks to advancements in monitoring platforms, the widespread adoption of observability practices, and the development of sophisticated tools for centralizing operational data. The integration of AI in IT operations, often referred to as AIops, has also played a pivotal role. These advancements have undoubtedly eased some aspects of the SRE workload. Yet, during the high-stakes moments of resolving an outage or a critical performance issue, accurately pinpointing the originating system—as opposed to merely identifying downstream systems affected by it—remains a significant challenge.

According to the Komodore 2025 Enterprise Kubernetes Report, a substantial 79% of production incidents are traceable to recent system changes, including deployments and modifications to compute environments. This underscores the inherent risks associated with the rapid pace of software development. The remaining 21% of incidents, however, stem from factors beyond an organization’s direct control, such as network failures, changes initiated by third-party vendors, and disruptions caused by cloud provider infrastructure.

Itiel Shwartz, CTO at Komodor, emphasizes the critical juncture at which AI’s effectiveness is tested for SREs: "SREs using AI capabilities succeed or fail in the moment an incident unfolds, when engineers are deciding what to investigate next. If the system streamlines root cause detection, connects signals to recent changes, and explains its reasoning in a way engineers recognize, it earns trust. If it adds uncertainty or demands extra validation, it gets sidelined, regardless of how bespoke the model behind it may be. What’s less obvious is what it takes to make AI for SREs work in production, and how different that reality is from prototypes, demos, or early internal builds."

AIops itself is not a novel concept. The application of machine learning to correlate logs, metrics, and traces across disparate monitoring and alerting systems has been a practice for years. IT service management and SRE teams have leveraged AIops to reduce the Mean Time To Resolve (MTTR) incidents and to conduct efficient and accurate Root Cause Analysis (RCA). The emergence of "agentic ops" signifies the next frontier in GenAI operational capabilities, encompassing tools designed for monitoring AI agents, managing their access privileges, and detecting potential drifts in AI model accuracy.

Shani Shoham, Chief Revenue Officer at OpenObserve, highlights the immediate benefits of AI during critical incidents: "AI is useful during major incidents because it can pull together a lot of context into a few clear sentences, which is exactly what an SRE needs in the moment. The complexity of architecture and the different tooling make it easier for AI than for a human, but autonomous resolution is still a way off."

AI’s Impact on SRE Well-being and the Specter of Burnout

The relentless pressure to maintain system uptime, security, and optimal performance is a 24/7 responsibility that often takes a significant toll on SREs. The SRE Report 2025, published by Catchpoint, reveals that 36% of SREs frequently or consistently experience elevated stress levels during an incident, with 28% reporting that this stress lingers even after the incident has been resolved. In this context, AI capabilities hold the potential to be a transformative force, helping SREs mitigate burnout and reduce stress.

Noam Levy, Founding Engineer and Field CTO at Groundcover, explains how AI can enhance RCA: "AI can improve RCA by taking in a much larger incident context than any engineer can hold at 3 am, reasoning across traces, logs, metrics, deploys, config changes, alerts, ownership, and recent production behavior. Beyond attempting a full RCA, its immediate value is distilling the signals that actually matter, reconstructing a clear timeline of cause and effect, and helping engineers separate correlation from likely causality. Once a fix is deployed, agents can also verify remediation by comparing pre- and post-fix behavior, but this depends on broad access to rich, correlated production signals and a cost model that does not discourage adoption or experimentation."

Beyond accelerating incident resolution and diminishing stress, AI can also liberate SREs to dedicate more time to proactive initiatives. This shift can also create more accessible career pathways for junior developers transitioning into SRE roles. Quais Taraki, CTO at EDB Postgres AI, elaborates: "AI reduces toil by automating repetitive tasks while accelerating incident resolution through copilots that correlate signals across distributed systems, allowing SREs to focus more on resilience strategies like chaos engineering and failure analysis."

The long-term operational impacts of AI are particularly significant for organizations committed to deploying increasingly mission-critical technology and advanced AI capabilities. Two notable benefits include a reduction in the number of bridge calls required during incident response and a decrease in the number of engineers needed to convene in "war rooms" for coordinated root cause analyses.

Spiros Xanthos, Founder and CEO of Resolve AI, asserts: "When something goes wrong, AI that guides SREs can do the full analysis, get to the root cause, and perform the remediation. AI also helps avoid many escalations, and when escalations are needed, it targets the right people from the network, infrastructure, and the application teams. AI for SREs centralizes operational intelligence, exposes tribal knowledge, and can guide more junior developers."

The Double-Edged Sword: AI-Generated Code and Emerging SRE Challenges

While AI capabilities have generally been a boon for enhancing system reliability, the burgeoning use of AI code generators, "vibe coding," and spec-driven development is concurrently escalating the workload for SREs. A study by Braiviq indicates that 41% of global code is now AI-generated, and Gartner forecasts that 40% of new enterprise production software will be developed using vibe coding techniques by 2028.

This surge in coding velocity, however, is creating novel issues for SRE teams. According to CodeRabbit, AI pull requests exhibit a 1.4 times higher incidence of critical issues and a 1.7 times higher rate of major issues compared to human-generated code. Vinod Jayaraman, Co-founder and CTO at NeuBird AI, explains this paradox: "AI-assisted development has created an unprecedented velocity of code reaching production, expanding surface area, edge cases, and failure rates faster than traditional SRE practices can absorb. The speed of shipping has far outpaced the speed of understanding what breaks in production. To close this loop, SREs need enterprise agents that can capture precise diagnostic context, including correlated traces, service dependencies, and anomaly timelines, and structure it as actionable input for the engineers and AI coding tools responsible for the fix."

The increasing deployment of AI agents in production environments introduces a new layer of complexity. These agents are not merely lines of code; they possess multiple potential points of failure. They are built upon language models, connect to proprietary data sources for context, and integrate with Model Context Protocol servers to support intricate workflows. The continuous nature of changes, rather than distinct deployment events, makes the SRE’s task of identifying the root cause of performance or accuracy drifts exceptionally challenging.

Mohammed Aboul-Magd, Vice President of Product at SandboxAQ, points out a fundamental shift in failure modes: "Traditional SRE was built for systems that fail in reproducible ways, but agents fail differently and drift when a model provider pushes an update, and behavior shifts silently with no baseline for comparison. Most organizations can’t even answer the basics: how many agents are running, what they have access to, and whether they’re still doing what they were built to do."

Ronak Desai, Co-founder and CEO at Ciroos, further elaborates on the challenge of institutional knowledge transfer in the age of AI: "Every time a senior engineer leaves, they take years of learned failure patterns with them, and the next outage starts from square one. Using AI for compounding operational memory changes that, and every incident your system resolves, the AI learns it."

In response to these emerging challenges, SREs are being called upon to take a leadership role in establishing best practices for AI agent management. This includes defining standards for AI agent non-functional acceptance criteria, developing robust observability practices, and establishing clear release-readiness criteria. A critical step involves updating service-level objectives (SLOs) and defining error budgets specifically for AI agents operating in production environments.

Ryan Downing, Vice President and CIO of Enterprise Business Solutions at Principal Financial Group, emphasizes the synergy between traditional SRE principles and AI: "Standard SLOs and error budgets give teams the guardrails, and AI helps interpret the telemetry against those targets, reducing noise so engineers can get to the real issue faster and automate parts of remediation before customers are impacted."

The Expanding Business Impact of AI on SRE

Perhaps the most significant shift in Site Reliability Engineering is the evolution of its business scope. IT leaders are no longer solely focused on uptime, performance, and issue resolution; they are increasingly tasked with understanding the broader business implications of these factors. Business leaders, in turn, are looking to IT and SRE teams to identify, diagnose, and remediate a wider spectrum of issues. This now includes the complex challenges posed by rogue AI agents and the unpredictable impacts of rapidly deploying new agentic capabilities.

Blake Sherwood, Distinguished Technologist for AI and Platform Strategy at Smarsh, observes a fundamental paradigm shift: "AI agents are handing SREs categories of problems they’ve never had to solve before, specifically failures defined in business terms, not technical ones. Traditional reliability engineering is built around latency, errors, and crashes, but agents now fail due to skipped compliance steps or outcomes that looked fine technically but were wrong contextually. Most SRE teams aren’t wired for that yet."

The central question that looms is whether SREs, armed with AI-augmented tools, can successfully adapt to and manage the accelerated velocity, escalating complexity, and pressing business urgency associated with the deployment of new AI-driven business capabilities. The ongoing evolution of AI presents both an opportunity for unprecedented reliability and a formidable challenge to the established practices and expertise of site reliability engineers.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button