• 6D Diagnostic Analysis
Diagnostic · Cybersecurity · AI Infrastructure

Nobody Touched the Model: The Security Cost Hiding in the Harness

Look at the AI security incidents of 2025 and 2026 and one fact stands out: in almost none of them did anyone attack the model. EchoLeak (CVE-2025-32711) exfiltrated corporate data through Microsoft 365 Copilot's email-retrieval pipeline with zero clicks. PoisonedRAG showed that five malicious documents in a 2.6-million-document store could control a frontier model's output ~97% of the time. MCP servers were taken over through missing authentication (nginx-ui, CVSS 9.8) and command injection (LiteLLM, added to the federal CISA exploited-vulnerabilities catalog).[1][2][3] The model weights were never the target. The harness was — the retrieval, the tools, the memory, the connectors, the plumbing. IBM found shadow AI adds $670K to the average breach and that 63% of organizations have no AI governance at all.[4] The cost of the harness is not just performance. It is an attack surface nobody put on the balance sheet.

97%
Output control from 5 docs (PoisonedRAG)
zero-click
EchoLeak Copilot exfil (CVE-2025-32711)
9.8
nginx-ui MCP takeover (CVE-2026-33032)
$670K
Shadow-AI premium per breach (IBM 2025)
17x
AI-security spend vs. securing AI
6 of 6
Dimensions in the cascade

6D Foraging Methodology™

01

The Insight

There is a useful heuristic in AI engineering that the model is only a fraction of an agentic system — the harness around it (tools, retrieval, memory, connectors, orchestration) does most of the work. It is a rule of thumb, not a measured statistic, and it is not, despite the meme, a published Google figure.[6] But run it through a security lens and it stops being a heuristic. If the harness is where the work happens, the harness is where the attacks happen. And they do.

EchoLeak (CVE-2025-32711, disclosed June 2025) was the proof: a crafted email caused Microsoft 365 Copilot to exfiltrate data from its own context — chat history, OneDrive, SharePoint — with no user click, by exploiting the retrieval-and-rendering pipeline, not the model.[1] The researchers called it an LLM scope violation; the vector was the plumbing. Microsoft rated it 9.3 Critical (NVD rated it 7.5). PoisonedRAG, presented at USENIX Security 2025, showed the same principle in the knowledge base: inject five malicious documents into a 2.6-million-document store and control the model's answer ~97% of the time.[2] The weights were untouched. The retrieval layer did the damage.

By 2026 the pattern had a CVE trail. The nginx-ui MCP endpoint could be taken over in two requests through missing authentication (CVE-2026-33032, CVSS 9.8); LiteLLM's MCP command-injection flaw was added to the federal CISA Known Exploited Vulnerabilities catalog; a self-propagating worm hit 73 Microsoft GitHub repositories via AI-coding-tool config files.[3] OWASP has ranked prompt injection the number-one risk on its LLM Top 10 for two consecutive editions, and CrowdStrike's 2026 threat report put it plainly: prompts are the new malware, with attackers exploiting AI tools at more than 90 organizations.[5] Every one of these is an attack on the scaffolding, not the intelligence.

The honest limits. Most of these are CVEs and researcher demonstrations with responsible disclosure — the attack-the-plumbing thesis is proven in the lab and by vulnerability, but public evidence of a named Fortune-500 victim breached this way is still thin (and one widely-circulated claim of a $20 autonomous-agent hack of a major consultancy could not be verified and is excluded here). Prompt injection itself remains, in the words of OpenAI's own security chief, a frontier, unsolved problem.[5] The cost is real and rising — Gartner projects enterprises spend 17x more on AI-security tools than on securing AI itself — but this is a diagnosis of an attack surface, not a body count. The point is where the surface is: not the model, the harness.

97%
Output control from 5 malicious documents in a 2.6M-doc store (PoisonedRAG, USENIX 2025)

Five documents, no access to the model, ~97% control of its answers.[2] The attack did not need the weights, the training data, or the API keys. It needed the retrieval layer — the part of the harness nobody was defending.

02

The Timeline

Two years of AI breaches in which the model was never the target — only the plumbing around it.

Jun 2025

EchoLeak: zero-click, via the pipeline

CVE-2025-32711: a crafted email makes Microsoft 365 Copilot exfiltrate data from its own context — no click — by exploiting the retrieval-and-rendering pipeline, not the model. The first production zero-click LLM data-exfiltration. Microsoft rated it 9.3 Critical.[1]

The Proof
Aug 2025

PoisonedRAG: five documents, 97%

At USENIX Security 2025, researchers show that injecting five malicious documents into a 2.6-million-document knowledge base controls a frontier model's output ~97% of the time. OWASP adds vector-and-embedding weaknesses to its LLM Top 10. The knowledge base is the weapon.[2]

The Retrieval
Mar–Jun 2026

The MCP CVE wave

nginx-ui's MCP endpoint falls to missing auth (CVE-2026-33032, CVSS 9.8, exploited); LiteLLM's MCP command-injection flaw is added to the federal CISA exploited-vulnerabilities catalog; a self-replicating worm hits 73 Microsoft GitHub repos through AI-tool config files.[3]

The Tools
Feb 2026

The label arrives

CrowdStrike's 2026 Global Threat Report: prompts are the new malware, with adversaries exploiting AI tools at more than 90 organizations. Prompt injection holds the number-one spot on OWASP's LLM Top 10 for a second consecutive edition — and remains, per OpenAI's CISO, unsolved.[5]

Named
2026

The cost, unbudgeted

IBM: shadow AI adds $670K to the average breach; 63% of organizations have no AI governance. Gartner projects enterprises spend 17x more on AI-powered security tools than on securing AI itself — the harness is defended last and least.[4]

The Bill

Prompts are the new malware. — CrowdStrike, 2026 Global Threat Report, February 24, 2026

DimensionEvidence
Operational (D6) Origin · 88 The lever is the execution environment: the harness of retrieval, tools, memory and connectors around the model is the attack surface. EchoLeak exploited the email-retrieval pipeline; PoisonedRAG the knowledge base; the MCP CVEs the tool endpoints.[1][2][3] D6 is the origin because in every case the model behaved exactly as designed — the breach came from the operational scaffolding built to make it useful, which is the part that grows with every integration and is defended least.The Harness Surface
Regulatory (D4) L1 · 80 The standards bodies moved to the harness. OWASP ranked prompt injection number one on its LLM Top 10 for two editions and added vector-and-embedding weaknesses; CISA added MCP command-injection CVEs to its exploited-vulnerabilities catalog; IBM found 63% of firms have no AI governance.[3][4][5] D4 amplifies from D6 because the institutional response is the clearest signal that the surface is real: regulators and standards catalogs do not add categories for hypothetical attacks.The Standards Response
Revenue (D2) L1 · 76 The cost of the harness attack surface is real and unaccounted. IBM: shadow AI adds $670K per breach, global average breach $4.44M; Gartner: AI-security spend ~$51.3B in 2026, yet enterprises spend 17x more on AI-security tools than on securing AI itself.[4][7] D2 amplifies alongside D4 because the security of the harness was priced at approximately zero when the AI budget was drawn — the case's core claim is that this is a line item that exists whether or not it was ever budgeted.The Unbudgeted Cost
Customer (D1) L2 · 74 Enterprise exposure is the customer-facing consequence: every organization that connected a model to its data through a harness inherited that harness's attack surface. 13% of organizations reported breaches of their own AI apps, 97% of them lacking proper access controls.[4] D1 is where the surface becomes a trust problem — the buyer that adopted AI for productivity also adopted a new class of exposure, and the more the model is integrated into real systems, the larger the door it opens.
Quality (D5) L2 · 72 The standing quality defect is that prompt injection is unsolved. OpenAI's CISO calls it a frontier, unsolved problem; Simon Willison, who coined the term, notes there is no reliable mechanism to mark token privileges — instructions and data cannot be cleanly separated in a system built to blend them.[5] D5 is where the surface becomes structural rather than incidental: this is not a bug to be patched but a property of how the harness feeds the model, which is why it holds the OWASP number-one spot year over year.
Employee (D3) 62 D3 is the longest-lag dimension: the security workforce racing an attack surface that grows with every new integration. Gartner projects AI applications will drive 50% of cybersecurity incident-response effort by 2028, and 25% of GenAI apps will see 5+ incidents a year.[7] D3 is slow because defense follows exposure — the tools, playbooks and skills to secure agentic harnesses are being built after the harnesses shipped, which is the gap this case says the balance sheet never funded.Watch — The Race
03

6D Cascade Analysis

The cascade originates in D6 — Operational — because the lever is the execution environment: the harness of tools, retrieval, memory and connectors that surrounds the model is where the attack surface lives, not in the weights.[1][2][3] From D6 it amplifies into D4 (the regulatory/standards response — OWASP ranking prompt injection number one, CISA adding MCP CVEs to its catalog, IBM's governance findings) and D2 (the unbudgeted cost — the 17x AI-security spend imbalance, the $670K shadow-AI breach premium) together, then D1 (enterprise exposure and trust) and D5 (the standing quality problem: prompt injection is unsolved). D3 (the security workforce racing the surface) is the longest-lag dimension. Cross-references: [UC-083] is the prognostic that tracks this escalation; [UC-230] is the defensive-security counterpart; [UC-251] is the cluster this belongs to — the harness is the security line of the AI bill nobody costed. The honest hedge is stated: these are largely CVEs and demonstrations; the 90/10 figure is a heuristic, not a Google statistic; the McKinsey claim is unverified and excluded.

FETCH Score Breakdown

Chirp: 84
|DRIFT|: 36
Confidence: 0.83
FETCH = 84 × 36 × 0.83 = 2,510  →  EXECUTE — HIGH PRIORITY (threshold: 1,000)
Calibration: FETCH 2,510 sits in the cluster's mid-band: a well-documented pattern (multiple CVEs, a USENIX paper, OWASP and CrowdStrike rankings, IBM cost data) whose FETCH is held below the pure-market cases because its impact is proven at the vulnerability-and-demo level rather than by a named catastrophic breach. DRIFT 36 reflects strong methodology (the attack-the-plumbing pattern is verified across independent primary sources) against a performance question that is deliberately not overstated: real-world named-victim exploitation evidence is thin. Confidence 0.83, with two facts kept honest on the page — the 90/10 framing is a heuristic not a Google finding, and the unverified McKinsey hack is excluded rather than cited.
6 of 6
Dimensions Hit
Harness, not weights
Multiplier
2,510
FETCH Score
Origin D6 Operational
L1 D4 Regulatory+ D2 Revenue
L2 D1 Customer+ D5 Quality
L3 D3 Employee
CAL Source nobody-touched-the-model · diagnostic · D6 origin · the attack surface is the harness, not the weights nobody-touched-the-model.cal
-- UC-253: Nobody Touched the Model: 6D Diagnostic Cascade
-- The security cost hiding in the harness (cluster: UC-251/252/254/255; cyber: UC-083/230)
FORAGE nobody_touched_the_model
WHERE attack_surface_is_harness = true
  AND model_weights_untouched = true
  AND cost_unbudgeted = true
ACROSS D6, D4, D2, D1, D5, D3
DEPTH 3
SURFACE nobody_touched_the_model

DIVE INTO plumbing_attack_surface
WHEN retrieval_tools_memory_exploited = true
  AND prompt_injection_unsolved = true
TRACE harness_attack_cascade
EMIT nobody_touched_the_model_signal

DRIFT nobody_touched_the_model
METHODOLOGY 84
PERFORMANCE 48

FETCH nobody_touched_the_model
THRESHOLD 1000
ON EXECUTE CHIRP high 'EchoLeak exfiltrated data through Copilot's email pipeline, PoisonedRAG controlled outputs with 5 documents, MCP servers fell to missing auth - nobody attacked the model, they attacked the harness around it, and that attack surface is the cost nobody put on the AI balance sheet'

SURFACE analysis AS json
SENSE FORAGE: the 2025-26 AI breaches attacked the harness, not the model. EchoLeak (CVE-2025-32711, Jun 2025): zero-click Copilot exfil via email-retrieval pipeline (MSFT 9.3 / NVD 7.5). PoisonedRAG (USENIX 2025): 5 docs in a 2.6M store control output ~97%. MCP CVEs: nginx-ui 9.8, LiteLLM in CISA KEV; Miasma worm hit 73 MS repos. OWASP: prompt injection #1 (2 editions); CrowdStrike (Feb 24): prompts are the new malware, 90+ orgs. IBM: shadow AI adds $670K/breach, 63% no AI governance. Gartner: 17x more spent on AI-security tools than securing AI. Signal: the attack surface is the plumbing, and it is unbudgeted.
ANALYZE DRIFT 36 - methodology strong (the attack-the-plumbing pattern is verified across CVEs, a USENIX paper, OWASP/CrowdStrike, IBM) against performance not overstated (named-victim breach evidence is thin; most are demos/CVEs). D6 origin (the harness attack surface) cascades to D4 (standards/CISA/OWASP response) + D2 (the unbudgeted cost), then D1 (enterprise exposure) + D5 (prompt injection unsolved), with D3 (security workforce) the longest lag. Honest flags on the page: 90/10 is a heuristic not a Google stat; the McKinsey hack is unverified and excluded.
DECIDE FETCH 2,510 exceeds threshold 1,000. EXECUTE - HIGH PRIORITY, mid-band because the impact is proven at the vulnerability/demo level, not by a named catastrophe. WATCH: whether a confirmed Fortune-500 breach via coding-agent/MCP prompt injection lands (would move this from diagnostic-of-a-surface to diagnostic-of-an-event; tracked in UC-083), and whether AI-security spend closes the 17x imbalance. Confidence 0.83 with the honest exclusions kept visible.
04

Key Insights

The weights were never the target

EchoLeak went through the email pipeline; PoisonedRAG through the knowledge base; the MCP CVEs through missing auth on the tool layer.[1][2][3] Not one of the marquee AI breaches attacked the model itself. The intelligence was fine; the scaffolding was open. You cannot secure a system by securing only its smartest 10%.

The attack surface grows with every integration

Each tool, connector, retrieval source and memory store you bolt onto a model is a new door. The harness that makes the agent useful is the same harness that makes it exploitable — which is why prompt injection is, in OpenAI's own words, an unsolved frontier problem: you cannot fully separate instructions from data in a system built to blend them.[5]

It is the cost nobody put on the balance sheet

Shadow AI adds $670K per breach; 63% of firms have no AI governance; enterprises spend 17x more on AI-security tools than on securing AI itself.[4] The harness was costed for performance and latency. Its security was costed for approximately nothing — which is exactly why it is where the breaches land.

Proven at the surface, not yet by a body count

The honest boundary: these are CVEs and reproducible demonstrations, not a wall of named Fortune-500 victims — and a viral $20-agent-hacks-a-consultancy claim could not be verified and is left out. This is a diagnosis of where the attack surface is, argued from vulnerabilities and research, not inflated with a catastrophe that has not been confirmed.

Sources

Seven sources: the verified incidents (EchoLeak CVE, PoisonedRAG USENIX paper, the MCP CVE wave, the Miasma worm), the institutional rankings (OWASP, CrowdStrike, the unsolved-problem consensus), IBM's breach-cost data, and the harness-engineering framing — with the 90/10 heuristic and the excluded McKinsey claim flagged for honesty.

Tier 1 — Official & Structural Data
[1]
EchoLeak — CVE-2025-32711 (NVD; discovered by Aim Labs, disclosed June 11, 2025). First production zero-click indirect-prompt-injection data exfiltration: a crafted email makes Microsoft 365 Copilot leak in-context data (chat, OneDrive, SharePoint) with no user action, exploiting the retrieval-and-rendering pipeline. Microsoft rated it 9.3 Critical; NVD rated it 7.5. Microsoft reported no in-the-wild exploitation.nvd.nist.gov · CVE-2025-32711
[2]
PoisonedRAG — USENIX Security 2025. The first knowledge-corruption attack designed for retrieval-augmented generation: injecting as few as 5 malicious documents into a 2.6-million-text knowledge base controls a frontier LLM's output ~97% of the time. OWASP added LLM08 Vector and Embedding Weaknesses to its 2025 Top 10, confirming the attack class institutionally. Peer-reviewed, reproducible.usenix security · 2025
[3]
The MCP CVE wave (NVD + CISA KEV). CVE-2026-33032 (nginx-ui MCP endpoint, missing auth, CVSS 9.8, exploited); CVE-2026-42271 (LiteLLM MCP command injection) added to the federal CISA Known Exploited Vulnerabilities catalog June 8, 2026; the Miasma worm (June 5, 2026) hit 73 Microsoft GitHub repositories via AI-coding-tool config files. Earlier: CVE-2025-6514 (mcp-remote, 9.6), CVE-2025-49596 (MCP Inspector, 9.4).cisa.gov KEV · 2026
[4]
IBM — Cost of a Data Breach Report 2025 (July 30, 2025). Shadow AI added an average $670K to breach cost; 20% of breaches involved shadow AI; 13% of organizations reported breaches of their own AI models/apps, 97% of those lacking proper AI access controls; 63% had no AI governance policy. Global average breach cost $4.44M. The unbudgeted-cost evidence.ibm.com · Jul 2025
[5]
The rankings and the unsolved-problem consensus. OWASP Top 10 for LLM Applications 2025: LLM01 Prompt Injection ranked number one for a second consecutive edition; OWASP Agentic Top 10 (2026) leads with Agent Goal Hijack via injection. CrowdStrike 2026 Global Threat Report (Feb 24, 2026): prompts are the new malware; 90+ organizations exploited. OpenAI's CISO and Simon Willison (who coined prompt injection): a frontier, unsolved problem.owasp.org · 2025-26
[7]
Gartner AI-security forecasts (2026). 25% of enterprise GenAI applications projected to experience 5+ minor security incidents per year by 2028 (up from 9% in 2025); AI-cybersecurity spending ~$51.3B in 2026 (nearly double 2025); Gartner's analysis that enterprises spend roughly 17x more on AI-powered security tools than on securing AI itself. The spend-imbalance framing for the harness being defended last.gartner.com · Apr 2026
Tier 2 — Industry Analysis
[6]
Harness engineering — the honest framing. The idea that the model is a fraction of an agentic system and the harness (tools, retrieval, memory, orchestration) does most of the work is an established discipline, articulated by Birgitta Böckeler (Thoughtworks) on Martin Fowler's site. The specific 90/10 ratio is a popular heuristic without a primary source and is not, despite the meme, a published Google statistic. Used here as illustration, not measurement.martinfowler.com · 2026

You secured the model. The attack came through everything you bolted around it.

The weights were never the surface. Budget for the harness — the retrieval, the tools, the connectors — or ship the attack surface with the feature.