An LLM-guided evolutionary search drastically speeds and improves CPU microarchitecture exploration: MicroEvo's Pareto-aware MCTS and knowledge accumulation achieve up to 36% better Pareto quality and over tenfold search efficiency versus a leading evolutionary baseline on simulator benchmarks.

Main Finding

MicroEvo is a knowledge-guided framework that couples off‑the‑shelf large language models (LLMs) with Monte Carlo Tree Search (MCTS) to perform sample‑efficient multi‑objective microarchitecture design space exploration (DSE). By replacing blind sampling with LLM‑driven evolutionary operators, a Pareto‑aware tree policy (Pareto‑UCT), active knowledge accumulation (AKA), and a state‑aware directive (SAD), MicroEvo substantially improves Pareto‑front quality and search efficiency under tight evaluation budgets (reported up to +36.2% hypervolume versus NSGA‑II and 10.6× higher search efficiency), and scales to industrial‑scale core design problems.

Key Points

• Motivation
  • Microarchitecture DSE is combinatorially huge (example: 22 parameters → ~3.95×10^13 configs) and PPA (performance, power, area) evaluations are costly, so each simulation is precious.
  • Conventional stochastic search (EAs, BO) wastes many expensive evaluations; purely LLM‑based samplers have strong priors but tend to prematurely converge without effective iterative feedback.
• Architecture of MicroEvo
  • Search backbone: MCTS that treats each node as a microarchitectural configuration; expansion is done by LLM‑driven evolutionary operators rather than random mutation.
  • Pareto‑UCT: A multi‑objective selection criterion combining hypervolume improvement (HVI) contribution, crowding distance (diversity), and a decaying exploration bonus to balance exploration/exploitation in multi‑objective space.
  • LLM functions:
    • Initialization: LLM produces diverse root configs targeted to different tradeoffs (e.g., max perf, balanced, low power).
    • Expansion operators:
      • Knowledge Tuner: local refinements informed by accumulated global insights and parent‑child performance gaps.
      • Pattern Explorer: higher‑level refactorings to find useful parameter coordination patterns (goes beyond single‑parameter tweaks).
  • Active Knowledge Accumulation (AKA): extracts and stores reusable optimization insights from explored designs (Pareto analysis + pairwise parent‑child analysis) in a utility‑weighted memory to bias future suggestions.
  • State‑Aware Directive (SAD): monitors search progress and switches LLM operator behavior among exploit / balanced / explore modes to avoid stagnation.
• Empirical findings highlighted in the paper
  • LLM‑generated samples capture stronger parameter correlations than random baselines (Spearman correlation analysis).
  • Combining LLMs with evolutionary iteration (MCTS + AKA + SAD) preserves LLM sampling quality and maintains long‑term improvement (unlike one‑shot LLM sampling that plateaus).
  • Reported gains: up to 36.2% hypervolume improvement over NSGA‑II; up to 10.6× better search efficiency in experiments; remains effective under low‑budget settings and scales to an industrial core.
• Practical safeguards
  • Generated parameter values outside the valid space are mapped to the nearest valid value to mitigate hallucinations.
  • The framework relies on real evaluations (simulator/toolchain) for rewards; the LLM guides sampling but does not replace ground‑truth PPA evaluation.

Data & Methods

• Problem formulation
  • Multi‑objective optimization of microarchitecture configurations over PPA objectives: CPI (performance), power, and area (three objectives).
  • Design space example: 22 parameters with discrete choices; estimated exhaustive search infeasible (e.g., ~75 million years at 1 min per sim).
• Search algorithm
  • MCTS loop: selection (Pareto‑UCT), expansion (LLM operators), simulation (actual PPA evaluation via toolchain), backpropagation (propagate HVI/Q and visit counts).
  • Pareto‑UCT score for child vi:
    • Q_HVI(vi): hypervolume improvement contribution of that child.
    • e·D(vi): crowding distance term to prefer sparsely sampled Pareto regions.
    • λ·sqrt(ln N(v_parent) / N(vi)): decaying exploration bonus (λ decays with progress).
  • HVI and crowding distance computed on combined set of current nondominated set + candidate children.
• LLM integration
  • LLMs are used to (a) produce initial diverse seeds across tradeoffs, and (b) generate mutations/crossovers with guidance from AKA and SAD.
  • Operators translate accumulated knowledge and current state into structured prompts that ask LLM to propose parameter changes that respect dependencies (e.g., scale ROB while adjusting load/store queue sizes).
  • Hallucination control: clamp out‑of‑range outputs to valid domain values.
• Active Knowledge Accumulation (AKA)
  • Extracts optimization patterns by Pareto analysis (which parameter combinations appear in nondominated designs) and pairwise parent→child analysis (which changes produced useful HVI).
  • Stores insights with utility weights and retrieves them to bias future LLM prompts.
• Evaluation
  • Metrics: hypervolume (HV) and hypervolume improvement (HVI) as main multi‑objective quality indicators; also analyzed CPI, power, area tradeoffs and sample efficiency (improvement per evaluation).
  • Baselines: standard evolutionary multi‑objective optimizer (NSGA‑II) and other LLM or EA variants (paper references comparisons showing LLM alone can initialize well but then plateau; EAs are steady but slower initially).
  • Visual and statistical analyses: t‑SNE visualization of design space sampling, Spearman correlations to show learned parameter coupling.
• Experimental claims (as reported)
  • Up to 36.2% hypervolume improvement vs NSGA‑II under the same evaluation budget.
  • Up to 10.6× search efficiency gain (faster approach to high HV).
  • Robustness in low‑budget settings and scalability to a complex industrial core (details and code available in repository).

Implications for AI Economics

• Cost and time reduction in chip design
  • By improving sample efficiency and Pareto coverage, MicroEvo can reduce the number of costly cycle‑accurate simulations required, lowering direct compute costs and shortening design cycles—material economic value for chip companies and design houses.
• Reallocation of skilled labor
  • The approach augments designers with LLM‑guided automation for candidate generation and insight accumulation, potentially shifting human effort from brute‑force search and low‑level tuning to higher‑level verification, architecture rationale, and integration work.
  • May increase productivity per architect and change staffing needs (fewer repetitive sampling tasks, higher emphasis on ML/LLM prompt engineering and verification).
• Competitive dynamics and innovation speed
  • Firms that adopt knowledge‑guided LLM sampling can iterate designs faster, leading to quicker time‑to‑market for workload‑specialized chips—this could accelerate competition and raise barriers for incumbents with less ML capability or access to LLMs.
• Resource tradeoffs: simulation compute vs LLM inference
  • MicroEvo reduces simulator runs but relies on LLM inference and infrastructure + engineering to integrate LLMs with DSE pipelines. Economic tradeoffs include LLM inference costs, model access (API fees or on‑premise models), and engineering integration overhead.
• Model & IP considerations
  • Using general LLMs trained on broad corpora introduces questions about provenance and IP: which design insights are proprietary versus learned from public corpora? Firms may prefer fine‑tuned/private models, which raises costs.
• Risk and robustness affecting economic value
  • Hallucination and over‑reliance on LLM priors can introduce subtle errors; the necessity of ground‑truth evaluation remains. Economic benefit depends on robustness of the pipeline and regulatory/verification requirements for safety‑critical designs.
• Broader market effects
  • If generalized, knowledge‑guided LLM sampling can lower marginal costs of producing specialized hardware, potentially increasing supply of specialized accelerators and affecting pricing and demand in downstream markets (cloud, edge devices, AI hardware).
• Policy and labor market implications
  • Acceleration of automation in hardware design is another vector where AI changes skilled labor demand—policy discussions around retraining, certification, and liability for automated design choices may follow.

If you want, I can: - Extract specific algorithm pseudo‑code (Pareto‑UCT, AKA retrieval) from the paper and present it succinctly. - Summarize the experimental setup in more detail (datasets, exact baselines, model names/versions, budgets) if you provide the remaining sections or allow me to inspect the repository.