A reversible context-management layer for autonomous coding agents reclaims one-fifth of token costs: Blast Radius predicts how far a prompt will reach and buries dead context (byte-exact archival), reducing token use by roughly 17–26% while keeping evictions exhumable at bounded cost.

Main Finding

Blast Radius is a predictive, reversible memory-management layer for agentic coding loops that (1) predicts how far an incoming prompt will “reach” across two channels — temporal (context retention) and structural (code dependency churn) — and (2) uses that prediction to perform bounded-risk, byte-exact reversible evictions (NECROPHORESIS). In tests across seven OpenAI models, Blast Radius reduced token consumption by 17–26%, achieved the lowest overflow rate among tested policies, kept archival reversibility exact, and identified large amounts of recurring transient transcripts (378 of 450 buried bodies were recurring dead matter) with zero recalls.

Key Points

• Two-channel blast-radius concept
  • Context channel: estimates expected increment to retained working load B(pt, Ct) and converts it to an eviction budget Ht so the next turn fits the model window.
  • Code channel: computes churn-weighted k-hop impact reach Rk(S0) over a repository dependency DAG and emits a commit-pressure signal Πt when edits breach risk tiers, prompting checkpoints.
• Reversible eviction (NECROPHORESIS)
  • Bodies (message-granular units) are archived byte-exact to an on-device midden; a compact scent skeleton (σ tokens) stays in-context.
  • Exhumation restores the archived body in O(1) reads at bounded cost κ; archival is auditable and redacts secrets.
  • Reclamation per buried body = τ(b) − σ tokens per turn saved; worst-case downside = −κ (bounded).
• Sweep operator and optimization
  • Eviction is framed as a constrained min-cost knapsack cover: reclaim ≥ Ht tokens while minimizing expected regret (chance a buried body will be needed × exhumation cost).
  • Practical deployment uses greedy approximations and a conservative hard rule for resurrection probabilities.
• Recurring Dead Matter (RDM)
  • Routine tool transcripts are grouped into recurrence classes via a normalization Σ that strips volatile parts.
  • Older members of a class are treated as RDM and buried immediately; resurrection probability for a class is estimated with Laplace’s rule of succession: ˆqc = (ec+1)/(kc+2).
  • Policy: keep latest class instance, bury older ones; ledger counts self-correct the estimator.
• Formal foundations
  • Context and code channels unified in a Polish-space formulation providing measurability: retention likelihood, churn, reach are measurable functions; NECROPHORESIS and RDM are well-defined operators on this space.
• Implementation details (high-level)
  • AST parsing (tree-sitter) to get churn w(v) = added + removed lines per symbol/file.
  • Visual/radar encoding r(v) = min(rmax, a + c sqrt(w(v))) to map churn to salience.
  • Risk-tier thresholds deployed: (50, 200, 500, 1000) lines for MED→DEADLY tiers.
  • Midden axioms: reversibility (byte-exact), ledgered audit trail, redaction of secrets, bounded exhumation cost.
• Empirical outcomes
  • Token savings: 17–26% across seven OpenAI models.
  • Lowest overflow rate among policies tested.
  • Byte-exact reversibility verified.
  • Of 450 buried bodies, 378 classified as RDM, and zero exhumations (recalls) occurred for those.

Data & Methods

• Formal definitions and modeling
  • Session state Ct = set of bodies; each body b has token cost τ(b), info-value ι(b), arrival index.
  • Liveness: qt(b) = P[b is live | Ct]; death score dt(b) = 1 − qt(b).
  • Context blast radius B(pt, Ct) = E[Lnew t+1 − Lt | pt, Ct]; estimator ˆB(pt, Ct) uses prompt features (length, declared tool intent, referenced files).
  • Eviction budget Ht = max(0, Lt + ˆB(pt, Ct) − (1 − γ)W).
• Sweep operator ΦS
  • Replaces S ⊆ Ct with scent skeletons skel(b) of fixed cost σ, archives verbatim bodies to midden M.
  • Exhumation Φ−1 S restores archived bodies with cost κ and O(1) reads.
• Knapsack formulation
  • Objective: minimize expected regret Σ_{b∈S} qt(b) κ subject to Σ_{b∈S} (τ(b) − σ) ≥ Ht and S ⊆ Dt (HCRC-licensed candidate set).
  • Greedy approximation via efficiency e(b) = (τ(b) − σ)/(qt(b) κ + ε).
  • Deployed policy currently uses a degenerate case with qt(b) set as a constant in Dt (conservative/hard rule).
• RDM and recurrence estimation
  • Normalization Σ identifies recurrence classes; ledger tracks burials kc and exhumations ec.
  • Posterior mean resurrection probability via Laplace rule: ˆqc = (ec+1)/(kc+2).
  • Licensing condition ensures classes that repeatedly die and are never exhumed will be aggressively buried.
• Code-channel reach
  • Dependency DAG G = (V, E); seed set S0 are edited nodes.
  • k-hop reach Rk(S0) = {v : dG(S0, v) ≤ k}; churn w(v) used to weigh impact.
  • Commit-pressure Πt fires if any node crosses a designated RISK tier.
• Implementation stack summary
  • Parsing via tree-sitter; dependency DAG uses the project’s AST/symbol graph; middens are on-device with ledger entries.
• Empirical evaluation
  • Benchmarked across seven OpenAI models (unspecified exact variants in provided excerpt).
  • Metrics: token consumption reduction, overflow rate, reversibility checks, RDM counts and recalls.
  • Reported results: 17–26% token reduction, lowest overflow rate, byte-exact reversibility, 378/450 buried bodies were RDM with zero recalls.

Implications for AI Economics

• Direct cost-effectiveness for token-billed models
  • 17–26% per-session token reduction maps nearly linearly to dollar savings under per-token billing models used by commercial LLM APIs. For large-scale agentic deployments, these savings compound across repeated turns, reducing marginal cost per automation cycle.
  • Because reclaimed tokens are per-turn recurring savings (τ − σ) per buried body per future turn, the ROI for burial is linear in expected burial duration; reversible eviction bounds downside to κ.
• Risk-managed trade-off (bounded downside)
  • Reversibility (byte-exact archival and bounded exhumation cost κ) turns forgetting into a low-risk, insurable bet. This lowers the “cost of forgetting” compared to lossy summarization, making operators more willing to evict and realize savings.
  • Bounded downside also simplifies expected-cost calculations for operators and cloud providers (max cost per mistaken eviction is κ rather than an unpredictable loss in utility).
• Operational scaling and infrastructure effects
  • Less token re-submission reduces inference compute usage and attention costs, enabling longer sessions and higher throughput per compute unit on provider hardware.
  • Reduced pressure to increase nominal context window sizes (which are expensive to scale) — Blast Radius allows more sustainable use of fixed windows via scoped eviction.
  • However, middens incur storage and retrieval costs (on-device storage, ledger maintenance); economic evaluation must include these (but storage costs are typically much lower than repeated token inference).
• Product and market implications
  • For enterprise customers, the auditability and redaction properties (ledgered burials/exhumations and secret redaction) lower compliance/friction, potentially increasing willingness to adopt agentic coding at scale.
  • Cloud providers may have incentives to support reversible eviction primitives (or offer them as managed services) because they preserve uptime/throughput and reduce peak inference usage while keeping end-user retention needs satisfiable.
  • Conversely, sustained token reductions across many customers could influence provider revenue tied to per-token pricing; but providers may offset via higher throughput and more customers or add storage/feature charges for archival/midden services.
• Incentives and pricing design
  • New pricing components could emerge: per-exhumation fees (bounded κ), per-skeleton in-context charges (σ), and archival storage/ledger charges; these can be priced to preserve provider margins while passing savings to customers on net.
  • SLA design can incorporate guaranteed bounded exhumation latency/costs; this creates a clear contract between reversible eviction and availability of buried context.
• Behavioral and productivity effects
  • Cleaner, decluttered agentic sessions (via RDM burial) reduce operator cognitive load and the chance of false-positive impact signals (radar congestion), improving review efficiency and reducing human cost in code review loops.
  • Faster, cheaper agentic loops may raise demand for more automation (rebound), so net provider compute consumption may not fall proportionally; careful monitoring of usage elasticity is required.
• Measurable KPIs to evaluate adoption
  • Per-session savings (tokens and $), exhumation rates and costs, storage overhead per session, reduction in overflow/failed-turn rates, operator time saved on review/checkpointing, and recurrence-class statistics (kc/ec).
• Risks and limitations to economic deployment
  • Dependence on an upstream HCRC gating mechanism; if gate is mis-specified, burial candidates Dt may be unsafe.
  • Assumptions (on-device archival, redaction correctness, bounded κ) must hold in production; otherwise economic gains could be offset by privacy/regulatory costs or higher-than-expected exhumation latency/cost.
  • NP-hard knapsack nature means deployed heuristics must be validated to avoid systemic mis-evictions; current conservative defaults trade some savings for safety.
• Actionable economic next steps
  • Build a cost model: include per-token inference price, expected burial durations, exhumation frequency, midden storage cost, and ledger overhead to compute per-session ROI.
  • Pilot in production with exhumation telemetry to refine resurrection priors (ec/kc) and tune σ and κ pricing.
  • Consider offering reversible-eviction as a managed feature (tiered): enterprise customers could trade a small storage/ledger fee for guaranteed bounded exhumation and token savings.

Summary takeaway: Blast Radius provides a principled, reversible way to cut repeated-token costs in agentic coding systems with a bounded downside. For AI economics, it shifts the cost/benefit calculus of memory management from lossy compression (irrecoverable risk) to a low-risk archival strategy that yields measurable per-session and fleet-level savings, with implications for pricing, infrastructure design, and wider adoption of agentic automation.