Tie search results, edits and submissions to the same file version and agents perform better: exposing synchronized parsed and native views plus visible diffs raises OfficeQA accuracy by single-digit to mid‑double-digit points and improves APEX rubric scores by several points, showing workspace state is a material experimental variable for knowledge‑work agents.

Main Finding

StagedWorkspace defines and implements a workspace-state contract for knowledge-work agents that ties parsed search results, native files, and review diffs to explicit file versions (content hashes). In controlled ablations, exposing synchronized parsed + native views and visible, journaled diffs improves agent performance substantially: dual parsed/native access increases OFFICEQA Pass@1 by ~8.3–12.1 percentage points and raises APEX mean rubric scores by ~4.7–9.2 points relative to single-view alternatives. Visible review diffs also increase success rates on file-editing tasks. The workspace-state variable therefore materially affects measured agent productivity and should be treated as an experimental factor in benchmarks and deployments.

Key Points

• Workspace-state contract: every parsed record, native operation, review diff, and submission is explicitly tied to a workspace version via content hashes.
• Core workspace objects:
  • Wt — authoritative native workspace (current files).
  • Ct — parsed record cache keyed by (path, content-hash); records are labeled current or stale.
  • ∆t — reviewable diff computed between starting workspace W0 and current Wt.
• Synchronization and semantics:
  • After mutating tool batches, the harness hash-scans files, advances Wt, marks mismatched parsed records stale, and re-parses asynchronously.
  • Agents get a read-after-write contract: native operations see updated Wt; parsed reads either match Wt or are flagged stale.
  • A journal records staged changes and supports promotion/rollback and review prior to submission.
• Experimental arms (read-axis):
  • Dual: both Wt and Ct available (synchronized).
  • Artifact-only: only native files (Wt).
  • Parsed-only: only parsed cache (Ct), with stale labeling.
• Review-axis ablation: holding dual views fixed, compare whether tracked diffs (∆t) are visible before submission.
• Controlled results:
  • Dual access dominates single-view arms in all paired comparisons.
  • Example headline improvements: SW-AGENT with Gemini 3.1 Pro: OFFICEQA 63.9% vs. published 29.3% (same model, but note published runs used different harnesses); large gains also observed for GPT-5.4 variants on APEX.
• Experimental rigor:
  • Same parser, retriever, parser prompts, grader, file-tracker, and tool budgets across read-axis arms to isolate the workspace mechanism.
  • Uncertainty estimated via nonparametric bootstrap (10,000 resamples, seed 20260515) on benchmark units.

Data & Methods

• Benchmarks
  • OFFICEQA PRO: grounded numerical QA over the U.S. Treasury Bulletin collection (≈697 PDFs). 104 document-only questions + 29 web-evidence questions (133 total). Primary metric: exact-match Pass@1 on question set.
  • APEX-AGENTS: professional cross-application tasks (originally 480 rubric-graded tasks across 33 worlds; paper excluded 28 investment-banking tasks relying on external APIs). Primary metrics: task pass rate (all rubric criteria pass) and mean rubric score.
• System / agent loop
  • Implemented StagedWorkspace as SW-AGENT.
  • ReAct-style interleaved reasoning + tool calls, up to a 250-tool-call budget per episode.
  • After each mutate batch, sandbox is hash-scanned, Wt advanced, Ct stale flags updated, affected files re-parsed asynchronously.
  • Parsed records are indexed and used for retrieval/search; native files are opened, executed, or edited as needed.
  • Journaling records per-operation state to form ∆t for review.
• Ablation design
  • Read-axis: dual vs. artifact-only vs. parsed-only (same other components fixed).
  • Review-axis: dual views with diffs visible vs. diffs hidden.
  • Models evaluated in paired ablations include GPT-5.4 family, Gemini 3 Flash, Gemini 3.1 Pro (some published comparisons use single-attempt runs; ablations used matched budgets).
• Metrics & uncertainty
  • OFFICEQA: exact-match accuracy (Pass@1).
  • APEX: task pass rate and mean rubric score (rubric averaged across tasks).
  • Bootstrap CI: 10,000 resamples; paired contrasts resample matched items to preserve covariance.
• Implementation details
  • Parsed records keyed by (source path, content hash); stale records explicitly marked.
  • Diff surfaces vary by format (line diffs for text, cell-level for spreadsheets, slide-level for decks; fallbacks for unsupported binaries).
  • Journal supports promotion/rollback, replay, and audit.

Implications for AI Economics

• Measurement and evaluation
  • Workspace state is an experimental variable that significantly affects measured agent output. Benchmarks and leaderboards must standardize or report workspace semantics (parsed vs native access, versioning, diff visibility) to make results comparable and reproducible.
  • Evaluations should score not only final artifacts but also evidence provenance, staged edits, and state transitions (e.g., whether submitted outputs correspond to the evidence the agent used).
• Productivity and value estimation
  • Versioned, synchronized workspaces materially improve task success and rubric scores; this raises the effective productivity of knowledge-work agents relative to simpler interfaces. When valuing agent-assisted labor or estimating substitution effects, analysts should account for interface and state-management quality as a multiplier on model capability.
  • The gains imply that workflow and tooling (workspace design, caching, review affordances) can yield as much impact as improving underlying LLMs in real-world tasks; investing in orchestration can be economically high-leverage.
• Cost, latency, and engineering trade-offs
  • Hash-keyed parsed caches save unnecessary re-parsing, but re-parsing on edit and maintaining journaled diffs adds compute, storage, and latency overhead; cost-benefit analysis should include these operational expenses versus accuracy/productivity gains.
  • Firms deploying agents will need to balance storage for parsed indexes, compute for re-parsing, and user-perceived latency—these are quantifiable overheads that affect per-task marginal cost.
• Auditing, liability, and compliance
  • Explicit versioning and review diffs improve auditability and provenance for delivered work (important for billing, compliance, and liability). This may reduce downstream verification costs (human review time, error correction), affecting the net economic value of automation.
  • Markets and contracts (e.g., legal, consulting work) may demand versioned, reviewable workflows as part of quality guarantees; agents with such features could command higher prices or wider adoption in regulated sectors.
• Market and product design
  • Tool providers and platform designers should expose versioning and content-hash APIs; interoperable workspace contracts could become a competitive differentiator in agent toolchains.
  • Benchmark designers and buyers of agent capabilities should prefer evaluations that incorporate stateful, mixed-format project folders and staged-review mechanisms to better predict deployment performance.
• Open questions affecting economic modeling
  • How do the marginal returns of better workspace management scale with model improvements? (Complementarity vs substitution between LLM capability and orchestration.)
  • What are the long-run cost curves (compute, storage, human review) for production-grade staged workspaces across industries?
  • How do human–agent collaboration models change when review diffs are available (e.g., faster approvals, different staffing needs, liability allocation)?
  • Robustness and adversarial risk: does explicit versioning reduce or merely change the failure modes (e.g., stale-parsed evidence attacks vs. hash-collisions or manipulation)?

Takeaway: workspace design—explicit versioning, synchronized parsed/native views, and reviewable diffs—materially affects knowledge-work agent performance and has direct economic implications for measurement, deployment costs, auditability, and the realized productivity of agent-assisted labor. Benchmarks, procurement, and valuation frameworks should treat workspace-state as a first-class factor.