The Commonplace
Home Papers Evidence Explore Trends Syntheses Digests References Docs 🎲 Workforce Futures
← Papers
Direction, evidence grade, and study type are AI-generated labels (gpt-5-mini), not human-verified. Syntheses are LLM-written. "Tensions" are machine-detected candidates, not confirmed contradictions. A research-acceleration tool, not peer review. How this is built →

A practical decision framework cuts unnecessary agent deployments by 45% and resource costs by 37% by reserving full agentic autonomy for tasks with genuine dynamism; STRIDE achieved 92% accuracy across 30 real-world SRE, compliance and automation tasks in expert validation.

STRIDE: A Systematic Framework for Selecting AI Modalities -- Agentic AI, AI Assistants, or LLM Calls
Shubhi Asthana, Bing Zhang, Chad DeLuca, Ruchi Mahindru, Hima Patel · December 01, 2025
arxiv descriptive medium evidence 7/10 relevance Full text usable extracted full text Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

Arxiv

Latest observation:

  1. Shubhi Asthana unresolved corpus identity
  2. Bing Zhang unresolved corpus identity
  3. Chad DeLuca unresolved corpus identity
  4. Ruchi Mahindru unresolved corpus identity
  5. Hima Patel unresolved corpus identity

Semantic Scholar

Latest observation:

  1. Shubhi Asthana provider ID
  2. Bing Zhang provider ID
  3. Chad DeLuca provider ID
  4. R. Mahindru provider ID
  5. Hima Patel provider ID
STRIDE is a principled framework that distinguishes when to use direct LLM calls, guided assistants, or full agentic AI, achieving high modality-selection accuracy and reducing unnecessary agent deployments and resource costs in SRE and compliance pilots.

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

The rapid shift from stateless large language models (LLMs) to autonomous, goal-driven agents raises a central question: When is agentic AI truly necessary? While agents enable multi-step reasoning, persistent memory, and tool orchestration, deploying them indiscriminately leads to higher cost, complexity, and risk. We present STRIDE (Systematic Task Reasoning Intelligence Deployment Evaluator), a framework that provides principled recommendations for selecting between three modalities: (i) direct LLM calls, (ii) guided AI assistants, and (iii) fully autonomous agentic AI. STRIDE integrates structured task decomposition, dynamism attribution, and self-reflection requirement analysis to produce an Agentic Suitability Score, ensuring that full agentic autonomy is reserved for tasks with inherent dynamism or evolving context. Evaluated across 30 real-world tasks spanning SRE, compliance, and enterprise automation, STRIDE achieved 92% accuracy in modality selection, reduced unnecessary agent deployments by 45%, and cut resource costs by 37%. Expert validation over six months in SRE and compliance domains confirmed its practical utility, with domain specialists agreeing that STRIDE effectively distinguishes between tasks requiring simple LLM calls, guided assistants, or full agentic autonomy. This work reframes agent adoption as a necessity-driven design decision, ensuring autonomy is applied only when its benefits justify the costs.

Summary

Main Finding

STRIDE is a design‑time framework that systematically decides whether a task should be handled by a stateless LLM call, a guided AI assistant, or a fully autonomous agent. By decomposing tasks, scoring reasoning/tool/state/risk needs, attributing dynamism, and assessing self-reflection requirements, STRIDE computes an Agentic Suitability Score (ASS) and True Dynamism Score (TDS) to recommend the minimal necessary modality. In experiments on 30 real‑world tasks across SRE, compliance, and enterprise automation STRIDE achieved 92% modality-selection accuracy, reduced unnecessary agent deployments by 45%, and cut resource costs by 37%.

Key Points

  • Motivation: Agentic AI brings deep reasoning, memory, and tool orchestration but also higher cost, complexity, and governance risk. STRIDE aims to avoid over‑deploying agents by making modality selection principled and repeatable.
  • Modalities distinguished:
    • LLM_CALL: single-turn, stateless, low risk/cost.
    • AI_ASSISTANT: guided multi-step workflows with ephemeral context and human oversight.
    • AGENTIC_AI: autonomous decomposition, persistent state, multi-tool orchestration, adaptive decision‑making.
  • Core pipeline (five stages):
  • Task decomposition into a DAG of subtasks (temporal/data-flow/semantic role analysis).
  • Reasoning & tool scoring producing ASS per subtask: - ASS(si) = wr·R(s) + wt·T(s) + ws·S(s) + wρ·ρ(s) where R = reasoning depth (0/1/2), T = tool need (0/1/2), S = state need (0/1/2), ρ = risk. - Weights (wr, wt, ws, wρ) are domain‑calibrated via grid search and RL/refinement.
  • Dynamism attribution to separate model-, tool-, and workflow‑induced variability. - True Dynamism Score (TDS): TDS(si) = α·W(s) + β·V(s) − γ·M(s) (W = workflow variability, V = tool volatility, M = model instability).
  • Self‑reflection requirement (SR): triggers when TDS exceeds threshold and conditional branching, nondeterministic tools, or mid‑execution validation are present. SR enables reflection/replanning/error recovery hooks.
  • Aggregation into task profile and classification against a knowledge base to output modality with persona‑aware justification.
  • Empirical results:
    • Dataset: 30 real tasks (SRE, compliance, enterprise automation).
    • Baselines: Naive Agent (always agent), Heuristic Threshold (simple rule on reasoning & tools).
    • STRIDE: 92% accuracy vs 68% for heuristic baseline and 33% for naive agent; reduced agent over‑deployment 45%; resource savings 37%.
  • Representative examples:
    • Currency lookup → LLM_CALL (low TDS).
    • Meeting summarization → AI_ASSISTANT (medium reasoning, ephemeral state).
    • Travel planning → AGENTIC_AI (multi‑hop, persistent state, multiple APIs).
  • Responsible AI angle: STRIDE reduces attack surface, governance exposure, and operational instability by reserving autonomy for tasks where it yields value.

Data & Methods

  • Task corpus: 30 curated real‑world tasks emphasizing depth (SRE incident analysis, compliance verification flows, enterprise automation, travel planning, etc.). Authors do not claim large-scale coverage; focus is on real, representative cases.
  • Annotation/labels: Expert‑validated modality labels used for training/validation and for calibrating weights and thresholds.
  • Evaluation metrics:
    • Modality selection accuracy (% tasks matched to expert label).
    • Over‑engineering reduction (% fewer unnecessary agent deployments versus always‑agent baseline).
    • Resource savings (% compute/API reduction versus always‑agent baseline).
  • Method specifics:
    • Task decomposition implemented via a fine‑tuned LLM using verb/noun extraction, temporal analysis, data‑flow tracking, and semantic role labeling to produce a DAG of subtasks.
    • ASS computed per subtask with domain‑tunable weights; aggregated to task level.
    • TDS separates model/tool/workflow variability to avoid misattributing stochastic LLM outputs as requiring autonomy.
    • Self‑reflection (SR) encoded as boolean rule: SR(s) = 1 if TDS(s) ≥ θ and (conditional branches ∨ nondeterministic tools ∨ mid‑execution validation).
    • Final modality chosen by classifier f(x_T; K) over aggregated features and a historical knowledge base; justifications tailored by persona.
  • Baselines and comparisons:
    • Naive Agent: always choose AGENTIC_AI.
    • Heuristic Threshold: choose agent only when reasoning≥2 and tools≥2.
  • Limitations noted by authors:
    • Small task set (30 tasks) — emphasis on depth not broad coverage.
    • Weights, thresholds, and LLM‑based decomposition require domain calibration; classifier depends on a KB built from historical patterns and expert feedback.
    • Potential failure modes: misattributed dynamism, errors in subtask DAG extraction, and sensitivity to weight tuning.

Implications for AI Economics

  • Cost-efficiency and ROI:
    • Quantified savings (37% resource reduction in experiments) imply significant operational cost benefits from selective agent deployment.
    • STRIDE provides a decision-making instrument to estimate marginal benefit of agentic features vs. their cost, enabling granular ROI calculations (e.g., expected compute/API cost per modality × estimated improvement in success rate).
  • Resource allocation and procurement:
    • Firms can prioritize investment in agentic capabilities where ASS/TDS indicate sustained value (high workflow dynamism, persistent state needs, frequent mid‑execution replanning).
    • STRIDE‑style scoring supports capacity planning and negotiating pricing with cloud/LLM providers by forecasting modality mix and usage profiles.
  • Risk and governance economics:
    • Reducing unnecessary agents lowers governance overhead (audit, access control, tool sandboxing) and expected regulatory/compliance costs from misuses or data leakage.
    • The framework internalizes externalities: high ρ(s) (risk) penalizes agent selection, aligning deployment decisions with compliance cost constraints.
  • Policy and standards:
    • STRIDE suggests a standardized, explainable scoring approach that regulators or internal audit teams could adopt to justify autonomy choices—helpful for compliance reporting and audit trails.
  • Design of pricing models and product strategy:
    • Vendors can offer modality‑tiered pricing (stateless calls, assistant sessions, agent sessions) and use STRIDE metrics to estimate customer modality mix and lifetime value.
  • Empirical/behavioral economics research directions:
    • Study adoption incentives: quantify when teams over‑adopt agents due to novelty bias vs. when STRIDE‑like signals correct that bias.
    • Use STRIDE to run A/B tests measuring productivity gains vs. cost for tasks near modality decision boundaries.
  • Practical recommendations for economists and decision‑makers:
    • Incorporate ASS and TDS into cost‑benefit templates when planning automation projects.
    • Run sensitivity analyses on weights (wr, wt, ws, wρ) and dynamism threshold θ to see how modality mix and costs shift under alternative valuations of risk, latency, and persistence benefits.
    • Track post‑deployment KPIs: replan frequency, error recovery invocations, tool volatility incidents, and total compute/API spend to refine STRIDE weights and validate ex‑ante estimates.

Limitations & caveats for economic application: - Calibration needs: STRIDE’s effectiveness depends on domain‑specific tuning and a representative historical KB. - Generalizability: results from 30 tasks are promising but not definitive across all industries or workload mixes. - Hidden costs: building STRIDE itself (LLM fine‑tuning, KB, classifier) has upfront cost that must be amortized.

Overall, STRIDE offers a practical, explainable way to align modality choice with economic tradeoffs—enabling cost savings, clearer governance, and more efficient allocation of agentic AI where it truly delivers incremental value.

Assessment

Paper Typedescriptive Evidence Strengthmedium — The paper reports concrete evaluation metrics (92% modality-selection accuracy, 45% fewer unnecessary agent deployments, 37% cost reduction) and a six-month expert validation in SRE and compliance, which supports practical relevance; however, the sample is small (30 tasks), selection procedures are unclear, there is no randomized or counterfactual design, and outcome measurement may be context-specific or subject to reporting bias, limiting causal claims and external validity. Methods Rigormedium — The framework appears systematic (task decomposition, dynamism attribution, self-reflection analysis) and is validated against real-world tasks and expert judgment, but the paper likely relies on heuristic scoring, lacks formal statistical testing or experimental controls, provides limited detail on inter-rater reliability or selection criteria for tasks/experts, and does not demonstrate robustness across diverse organizations or agent platforms. SampleEvaluation on 30 real-world tasks spanning site reliability engineering (SRE), compliance, and enterprise automation; six-month expert validation involving domain specialists in SRE and compliance (number of experts, organizational contexts, and exact task selection criteria not reported). Themesadoption org_design GeneralizabilitySmall, non-random task sample (30 tasks) limits statistical generalizability, Domains limited to SRE, compliance, and enterprise automation — other industries (e.g., customer support, creative work, healthcare) not evaluated, Unknown selection bias: tasks may be chosen where authors or partners expected success, Unclear how STRIDE performs across different LLMs, agent platforms, or organizational scales, Cost and resource savings may depend on local infrastructure and pricing assumptions

Claims (10)

ClaimDirectionOutcomeConfidence & EvidenceDetails
We present STRIDE (Systematic Task Reasoning Intelligence Deployment Evaluator), a framework that provides principled recommendations for selecting between three modalities: (i) direct LLM calls, (ii) guided AI assistants, and (iii) fully autonomous agentic AI. Other positive presence and scope of STRIDE framework (method proposal)
Reading fidelity high
Study strength high
not reported
0.3
STRIDE integrates structured task decomposition, dynamism attribution, and self-reflection requirement analysis to produce an Agentic Suitability Score. Other positive design components of STRIDE and generation of an Agentic Suitability Score
Reading fidelity high
Study strength high
not reported
0.3
STRIDE ensures that full agentic autonomy is reserved for tasks with inherent dynamism or evolving context. Task Allocation positive allocation of agentic autonomy based on task dynamism/evolving context
Reading fidelity high
Study strength medium
not reported
0.18
Evaluated across 30 real-world tasks spanning SRE, compliance, and enterprise automation. Other null_result evaluation sample composition and size
Reading fidelity high
Study strength medium
n=30
0.18
STRIDE achieved 92% accuracy in modality selection. Decision Quality positive modality selection accuracy
Reading fidelity high
Study strength medium
n=30
92% accuracy
0.18
STRIDE reduced unnecessary agent deployments by 45%. Task Allocation positive rate/number of unnecessary agent deployments
Reading fidelity high
Study strength medium
n=30
reduced unnecessary agent deployments by 45%
0.18
STRIDE cut resource costs by 37%. Organizational Efficiency positive resource costs
Reading fidelity high
Study strength medium
n=30
cut resource costs by 37%
0.18
Expert validation over six months in SRE and compliance domains confirmed its practical utility. Decision Quality positive practical utility as judged by domain experts during a six-month validation
Reading fidelity high
Study strength medium
not reported
0.18
Domain specialists agreed that STRIDE effectively distinguishes between tasks requiring simple LLM calls, guided assistants, or full agentic autonomy. Decision Quality positive agreement by domain specialists on modality distinctions
Reading fidelity high
Study strength medium
not reported
0.18
Deploying agents indiscriminately leads to higher cost, complexity, and risk. Organizational Efficiency negative cost, system complexity, and risk associated with indiscriminate agent deployment
Reading fidelity high
Study strength medium
n=30
0.18

Notes