Why AI Agents Get Infrastructure Wrong - And How Context Helps




The most dangerous infrastructure mistake isn't always a made-up resource. It is a confident answer built from half the truth.

Ask an AI whether a service is exposed to the internet. It inspects the service, finds no security group directly attached, and answers "No."

Everything it looked at may be correct. It simply may not have traced the relevant network interfaces and security controls in that service's actual traffic path.

That is the infrastructure context problem: the truth is spread across resources, relationships, runtime signals, and sometimes missing data.

1. Partial Context

AI can only reason over what it can see. Give it one ECS service, one Kubernetes deployment, or one VM and it may accurately describe that resource while completely missing what surrounds it.

In an ECS configuration using task ENIs, for example, the relevant path may include:

Service -> Task / ENI -> Security Group -> Load Balancer -> Public Traffic

If the agent sees only the service node, it cannot reliably infer the complete exposure path. That is where infrastructure answers start sounding confident while being incomplete.

2. Relationship Graph

Infrastructure is not a collection of independent resources. It is a graph.

A database belongs to a network. A service runs on compute. Compute is governed by network and security controls. A load balancer routes traffic into a target. IAM roles grant access somewhere else.

Vörr maps those connections as relationships, so the AI can receive more than "Here is an ECS service." It can receive the service, where it runs, what routes to it, what secures it, and what it depends on.

A resource tells the AI what exists. Relationships tell it what that resource means.

3. Deep Lookups

Even with the right data connected, an agent can still stop one hop too early. Vörr's composite lookups handle common infrastructure-specific traversals underneath one meaningful question.

Question: What is this service exposed to?

Service -> Task / ENI -> Security Group -> Exposure

The model asks the question. Vörr handles the traversal. That reduces the number of infrastructure-specific decisions the model has to guess correctly.

4. Static Topology + Live Signals

Architecture tells the AI how the system is connected. It does not tell it what the system is doing right now.

Static contextRuntime context
ArchitectureMetrics
DependenciesLogs
Network / IAMTraces and errors
InfrastructureDeployments and alerts

Knowing that checkout depends on payments is useful. Knowing that latency rose six minutes after a payment-service deployment, alongside more errors and slower downstream traces, is much more useful.

Topology tells you where to look. Runtime signals tell you what changed.

5. Missing Data Is Not Zero

One of the easiest ways for an AI to get infrastructure wrong is to mistake missing data for zero.

No Lambda functions foundInterpretation
Scan completed -> 0 functionsTrustworthy zero
Permissions/throttling prevented completionUnknown
Resource type is outside current scan scopeUnknown

Vörr keeps scanned-and-empty, scan-incomplete, and out-of-scope states separate instead of collapsing all three into "No resources found."

The same rule applies to observability. No errors because a service is healthy is not the same as no errors because no error source is connected.

6. Provenance

An infrastructure answer is easier to trust when the path behind it is visible.

Direct

Security Group
found directly on resource

Traversed

Source: ECS Service
Traversal: ECS -> ENI -> Security Group
Result: internet-facing
Evidence: rule permits 0.0.0.0/0 on 443

The same principle applies to metrics, logs, traces, deployments, and code. The AI still performs the reasoning, but the facts it reasons from can be inspected instead of simply believed.

7. Code + Infrastructure

Infrastructure incidents rarely stay inside infrastructure.

Latency spike -> Service -> Deployment -> Commit -> Relevant code

Without that connection, an AI may know what failed without knowing what changed. Vörr connects production context with repository context so an investigation can move from runtime behaviour to the software behind it.

8. Context Before Reasoning

The goal is not to make an AI model incapable of hallucinating. That is not a realistic promise.

The goal is to remove situations where the model has to fill missing infrastructure context with assumptions.

Without enough context

Question
  |
Partial data
  |
AI fills gaps
  |
Confident answer

With Vörr

Question
  |
Infrastructure graph
+ Live signals
+ Coverage
+ Provenance
  |
AI reasoning

Infrastructure errors are often a context problem before they are a model problem. Better evidence leaves the AI much less to guess.


Explore Vörr

Give AI agents live, inspectable production context instead of asking them to infer the missing pieces.

Explore Vörr →

Related in this series: How Vörr Lets Claude and Codex Investigate Your Production Stack Through MCP.

Post a Comment

Previous Post Next Post