Cost-aware LLM agents that escalate reasoning only when cheap edits stall cut optimization spend and reach deeper hardware-quality gains than fixed-effort approaches, while elaborate cross-design memory engineering adds little at equal cost.

Main Finding

Ares introduces per-call, dollar-normalized cost accounting and an adaptive per-call reasoning-effort policy for LLM-agent RTL optimization. At equal normalized spend, the adaptive-effort strategy yields substantially better PPA (lower FoM) than any fixed-effort policy and outperforms state-of-the-art optimizers while using far fewer tokens. In contrast, carefully engineered cross-design long-term memory provides little dependable benefit over a plain concatenation of the same experience when compared at equal cost.

Key Points

• Cost accounting
  • Each LLM call is priced by its actual token components (input, cache read/write, output) using published per-token prices; run cost is the sum of these dollar costs.
  • Runs report FoM together with cumulative cost; cost is shown in "high-calls" units (dollars spent divided by design mean cost of one high-effort call) to keep comparisons robust to price changes.
• Figure of Merit (FoM)
  • FoM = (area / area0) · (power / power0) · (delay / delay0); FoM( v0 ) = 1; lower is better.
• Memory engineering
  • Tested three memory modes (no long-term memory, baseline concatenation of past accepted edits, engineered rule-superset with structuring/deduplication/anti-patterns) built from identical raw experience.
  • Both memory-carrying variants beat no-memory, but the engineered construction brought no dependable advantage over simple concatenation at equal spend.
• Adaptive reasoning effort
  • Effort exposed as three levels: low / medium / high (varying hidden-chain-of-thought depth and token cost).
  • Ares starts at medium and escalates to high only when progress stalls, driven by a patience counter C:
    • stalled iteration: C → C + 1
    • failed iteration: C → C + w (w = 2.8)
    • accepted improvement: C → C · max(0, 1 − ΔFoM / κ) (κ = 0.05)
    • escalate when C ≥ p (p = 3), then reset
  • Parameters fitted once on 21 training designs.
• Empirical advantages
  • On three held-out test designs, the adaptive policy reduced FoM by 23–27% where the best fixed-effort reached 16–23%, at equal normalized cost.
  • Ares reached a deeper FoM than Dr. RTL at 8.7× lower cost.
  • On a "controller" design, Ares achieved FoM = 0.694 vs REvolution 0.943 and Dr. RTL 0.923 while spending 12% of Dr. RTL’s tokens for the same iteration count.
  • Closed up to 83% of the gap from an LLM-drafted multiply-accumulate unit to a highly hand-optimized version; reduced run-to-run variance by 58%.
• Practical takeaway: where and when an LLM agent spends its reasoning budget (dynamic allocation) matters more per dollar than elaborate cross-design memory construction.

Data & Methods

• Dataset and partitioning
  • 24 open-source RTL modules (several hundreds to thousands of lines): 21 used for training, 3 held-out for testing (tv80, uart, controller).
  • Training runs produced the long-term memory entries and were used to fit the adaptive policy parameters.
• Optimization loop
  • Each iteration: LLM proposes an RTL edit (with chosen effort level), candidate undergoes functional verification (long random testbench + sequential equivalence checking), synthesis (Synopsys DC), netlist verification, and PPA measurement (area from DC, power from PrimeTime, delay from DC).
  • Candidate adopted if it lowers FoM; otherwise discarded. Iteration outcome updates the patience counter; runs continue until cumulative cost reaches a budget.
• Cost model (per-call)
  • Call cost = Σ (p_component · token_count_component) over input, cache read, cache write, output tokens, using published OpenRouter prices.
  • Cumulative run cost reported and normalized by mean cost of one high-effort call for that design (unit: high-calls).
• Memory variants
  • Memoryless: no cross-design memory.
  • Baseline concatenation: list of simple descriptions of successful optimizations from training runs, concatenated.
  • Engineered memory: same raw entries but structured (context/action/result), includes anti-optimizations, duplicates deduplicated and ranked, and names anonymized to match structural patterns.
• Adaptive policy fitting
  • Fitted once via grid-search on medium-effort training runs, optimizing to escalate where medium produced no accepted improvement within next three iterations while keeping false escalations low.

Implications for AI Economics

• Metrics and transparency
  • Per-call, dollar-normalized accounting should become standard for comparing agentic systems that rely on paid LLM calls. It enables fair, reproducible cost-quality trade-off comparisons across models, effort settings, and optimizers.
• Resource allocation > representation engineering (in this domain)
  • Investing engineering effort into per-call adaptivity (when to spend more tokens/compute) can yield larger FoM-per-dollar improvements than complex long-term memory engineering. For practitioners with limited token budgets, prioritizing adaptive orchestration is likely more cost-effective.
• Generalization to other agentic tasks
  • Any sequential optimization or search task where difficulty varies across iterations (e.g., hyperparameter tuning, program repair, iterative planning) can benefit from adaptive per-call compute allocation and per-call cost reporting.
• Operational recommendations
  • Fit simple, cheap-to-evaluate escalation policies on representative training problems rather than heavy investment in curated cross-instance memories.
  • Report cost-normalized performance (quality per dollar) when publishing or comparing agentic systems; normalize to a stable reference (e.g., cost of one high-effort call for the task) to reduce sensitivity to price fluctuations.
• Limitations and caveats
  • Results rely on accurate PPA measurement using a commercial EDA flow and on the quality of functional tests; poor verification or unreliable measurements could distort the policy’s trigger signals.
  • Memory engineering still beats no memory; the paper shows diminishing returns of sophisticated formatting given the same base experience, not that memory is useless.
  • The fitted patience parameters were trained on similar designs; transferring to substantially different problem domains may require re-fitting.

Summary recommendation: For agentic optimization tasks with pay-per-token models, adopt per-call dollar accounting and prioritize adaptive per-call compute allocation policies (fit on representative problems) before investing in complex cross-instance memory engineering.