Detailed life-history prompts make LLM-based resident simulations noticeably more faithful, and curriculum-LoRA cuts personalization cost by about 10x while matching top-tier fidelity, bringing practical in-silico policy testing within reach for cash-strapped local governments.

Main Finding

Conditioning LLMs on rich, interview-derived life-history narratives materially improves fidelity for individual-level resident simulation in community governance, but pure prompting creates an unfavorable accuracy–cost trade-off. Curriculum-LoRA—a parameter-efficient personalization method that combines LoRA fine-tuning with online random sampling of reference QA and a curriculum that gradually increases reference context—matches or exceeds top prompting fidelity while reducing per-call inference cost by roughly an order of magnitude, and Pareto-dominates tested configurations when jointly considering accuracy and monetary cost.

Key Points

• Dataset scale and novelty

  • 92 long-term residents interviewed ~2 hours each; ~1.2 million characters of first-person life-history narrative (mean ≈13k characters per resident).
  • Structured 50-item policy-attitude instrument covering 9 governance domains (e.g., elevator funding, parking, civic engagement).
  • For benchmarking, 60 residents with information-rich responses produced 2,291 valid (resident, question, answer) triples.

• Benchmarking results

  • Evaluated 18 mainstream LLMs (open-source families and proprietary frontier models) × 4 prompting strategies (No Prompt, Only Life-history, Only Few-shot, Life-history & Few-shot) and swept few-shot sizes (0–10).
  • Conditioning on life-history raised accuracy on average by ~5.6 percentage points without few-shot and ~3.1 pp with few-shot; best prompting plateaus near ~50% exact-match accuracy.
  • In-context few-shot delivers diminishing returns: largest jump 0→2 shots; marginal gains shrink beyond that.
  • Layer-wise probing (on an open-weight model) identifies an “attitudinal inference window” where life-history content is transformed into preference features (onset ~layer 13, peak ~layer 46).
  • Pure prompting with long life-histories is substantially more expensive per call due to long prompts (token-driven cost).

• Curriculum-LoRA algorithm

  • Built on a 7B-parameter base model; uses LoRA-style parameter-efficient adapters plus:
    • Online random sampling of reference QA from the same resident to exploit cross-question consistency.
    • A curriculum that gradually increases the number of reference questions during training so the model first learns basic persona→answer mapping, then richer cross-question context.
  • Results: matches strongest prompting baseline fidelity (51.6% vs GLM-5’s 49.7%) while reducing per-call inference cost dramatically (CNY 0.41 vs CNY 6.54 for GLM-5; larger gaps vs GPT models).
  • Generalizes to unseen residents and unseen governance domains in tests reported.

• System integration

  • The calibrated model is deployed in a closed-loop policy-attitude simulation pipeline enabling policy-probe design, resident-attitude simulation, result analysis, and iterative refinement—bringing in-silico pre-evaluation of community policies within reach for resource-constrained local administrations.

Data & Methods

• Data collection

  • Stratified sampling for demographic balance (age, gender, education); semi-structured interviews ~2 hours each with trained fieldworkers; transcription, de-identification, cleaning.
  • Life-history profiles divided into four blocks: P1 (personal/growth), P2 (education/work/migration), P3 (family/care), P4 (community interaction/values).
  • Policy-attitude responses captured via a 50-item instrument across 9 domains; items include factual and normative questions.

• Benchmark construction

  • From 92 participants, selected 60 with complete, unambiguous responses for quantitative benchmarking (2,291 valid triples).
  • Held-out evaluation questions per resident; reference QA exposed to model as in-context conditioning; evaluation by exact-match scoring.
  • Exhaustive subset sweeps over life-history blocks (16 subsets).

• Models and prompting

  • 18 LLMs: open-source (e.g., Qwen, GLM, Kimi) and proprietary frontier models (GPT family, Gemini, Grok).
  • Prompting strategies: No Prompt; Only Life-history (long persona text); Only Few-shot (reference QA examples); Life-history & Few-shot.
  • Shot counts swept 0–10.

• Algorithmic innovation

  • Curriculum-LoRA: parameter-efficient personalization leveraging LoRA adapters, online random sampling across a resident’s reference QA, and a curriculum schedule for increasing context size during fine-tuning.
  • Evaluation metrics: exact-match accuracy for held-out questions; monetary per-call cost computed under token/inference pricing (reported in CNY).

• Mechanistic probing

  • Layer-wise representation probing via linear classifiers across transformer layers to locate where attitudinal signals emerge from life-history input.

Implications for AI Economics

• Accuracy–cost trade-offs shape adoption

  • The study quantifies a practical trade-off: long life-history prompts improve fidelity but drive up per-call costs (token fees, latency). Parameter-efficient personalization (curriculum-LoRA) can shift this frontier, making individualized simulation economically feasible for low-budget public actors.
  • Implication: pricing structures (per-token vs model-subscription) and availability of small, fine-tunable base models will materially affect which organizations can adopt individualized LLM simulations.

• Market demand and model design

  • Demonstrates demand for smaller, tunable models and parameter-efficient personalization tools rather than only frontier models. Vendors may find market opportunities in providing:
    • affordable fine-tunable backbones, LoRA/adapter toolchains, or managed personalization-as-a-service targeted at governments and NGOs.
    • pricing tiers that reflect value of personalization (not just raw capability).

• Public-sector cost savings and welfare

  • In-silico policy pretesting reduces the need for expensive large-scale surveys and repeated field experiments—potentially lowering the marginal cost of policy iteration and increasing responsiveness in local governance. This can improve allocative efficiency of public services and reduce policy implementation failures.
  • But welfare gains depend on fidelity and external validity; overconfidence in simulated residents risks misallocation if models propagate biases.

• Externalities and distributional concerns

  • If large models remain costly, wealthier municipalities or private actors could gain disproportionate ability to pre-evaluate and optimize policies, potentially widening governance quality gaps.
  • Open-source, low-cost personalization could democratize access; policy/regulatory choices (subsidies, public-model provisioning) will affect distributional outcomes.

• Value of data and privacy economics

  • High-value life-history data are costly to collect and sensitive. The paper highlights that richer individual data improves fidelity—this raises trade-offs between data collection costs, privacy risks, and downstream utility. Economies of scale in collecting such data for many residents versus targeted sampling should be considered.
  • Incentive design for truthful and consented data collection, and governance of model outputs (transparency, accountability), have economic implications for adoption.

• Research and policy priorities

  • Need to assess external validity and general equilibrium effects: how well these calibrated simulations predict behavior in different communities or under large-scale policy changes.
  • Consider regulation on use of synthetic residents for policy decisions (auditability, recourse) and standards for public-sector procurement of model personalization services.

Caveats and limitations - Benchmark limited geographically and socially to one urban community and to Chinese-language interviews/context; external validity across cultures and governance systems is untested. - Evaluation uses exact-match scoring on structured QA—this may understate partial correctness or nuanced alignment. - Ethical, privacy, and consent constraints around life-history data are substantial; deployment requires careful governance. - Cost figures are specific to the paper’s pricing assumptions and local currency; relative savings are more informative than absolute numbers.

Suggested follow-ups for AI economics researchers - Cost–benefit analyses comparing in-silico policy pretesting (with curriculum-LoRA) to conventional survey/field-experiment pipelines across different municipality sizes. - Study of market impacts: pricing models for personalized LLM services and how subsidies/public-provisioning affect adoption and equity. - External-validity tests across diverse communities and languages; welfare analyses accounting for model bias and decision risks. - Work on governance frameworks and procurement models that balance utility, privacy, and accountability for public-sector adoption of personalized LLMs.