Complex symbolic scaffolding can make long-horizon LLM collaboration worse — models become self-referential and lose semantic contact ('Index Sickness'). A pragmatic fix that separates baseline logs physically and restores natural-language purpose cut AI instruction volume by roughly 75% and prevented recurrence in subsequent sessions.

Main Finding

In a month‑long, action‑research software refactoring project (Bang‑v3; 391 consecutive AI–human collaborative sessions), heavy reliance on formal symbolic indexing, defensive rules, and ever‑larger context windows produced a failure mode the authors call “Index Sickness.” Rather than improving reliability, increasing symbolic constraints caused the LLM to retreat into internally coherent but physically disconnected symbolic reasoning ("Phantom Legislation"). Replacing heavy symbolic indexing with a consumer‑side activation strategy—explicit natural‑language statements of purpose plus a “Baseline‑Log Physical Separation” mechanism—reduced instruction volume (~75%) and prevented recurrence of Index Sickness across the subsequent ~150 sessions. The authors formalize this as the Pang Principle (Semantic Vitality Law): natural language carrying explicit purpose conveys far greater usable information to LLMs than dense symbolic representations.

Key Points

• Index Sickness: As symbolic index complexity rises, LLMs allocate attention to symbol-layer reasoning, producing outputs that are internally consistent symbolically but disconnected from real code/assets. Manifestations include Phantom Legislation, multi‑hop parsing overload, propagation of symbolic errors, and literal stickiness (deprecated symbols continuing to influence new sessions).
• Pang Principle: Natural language + explicit stated purpose is a more effective consumer‑side activation strategy than supplying dense symbolic indices or massive injected retrieval content. Natural language directly activates the LLM’s semantic priors and task‑relevant knowledge.
• Supply‑side vs Consumer‑side: Common engineering practice (symbolic identifiers, RAG, larger context windows) is supply‑side—improving inputs. The paper argues for a complementary consumer‑side approach that controls the LLM’s activation with purposeful natural language, narrowing interpretive space without formal symbol overload.
• Baseline‑Log Physical Separation: A lightweight cross‑session state management mechanism (physically separating persistent baseline data from volatile session logs) that prevents historical noise from contaminating current-session semantic space. In the project it lowered instruction volume by ~75% and stopped Index Sickness for ~150 follow‑up sessions.
• Mechanisms hypothesized: Transformer attention allocates weight by co‑occurrence; symbols require look‑ups that increase cognitive (attention) overhead; historical references dilute semantic intensity (Semantic Dilution Law), so more context can worsen, not fix, long‑horizon collaboration.
• Quantitative/empirical support referenced: internal session records (partial open source), and external corroboration from prior studies on context distractors, lost‑in‑the‑middle, and retrieval distractors (cited Chroma, Raju et al., Liu et al.).

Data & Methods

• Methodology: Action Research (researcher = practitioner). Iterative diagnose → propose → implement → evaluate within an actual software project.
• Case: “Bang‑v3” — WeChat mini‑program + H5 refactoring project over ~1 month, 391 consecutive collaborative sessions with one Owner and two AI roles (Chief‑of‑Staff, Developer).
• Scope of work: ~80,000 lines of code across 506 files refactored; collaboration specification framework (CSF) produced ≈900 files, ~150,000 lines; ~150 raw session records preserved.
• Empirical artifacts: session logs, file change records, CSF specifications; partial open‑source release at https://github.com/huidev2025/CSF and project documentation.
• Key quantitative signals reported from the case: instructions ballooned in one phase to 308 lines; critical failures (e.g., Session 215 Phantom Legislation, D‑108 and D‑139 incidents); after adopting Baseline‑Log separation, AI instruction volume dropped by roughly 75%, and no Index Sickness recurred across ~150 subsequent sessions.
• Limitations acknowledged: single‑project action research (not randomized controlled trial), AI contributed text generation (paper text produced by AI collaborator under Owner supervision), results need replication across domains and models.

Implications for AI Economics

• Reevaluate investment priorities: Firms and tool vendors should not assume continual returns from investing primarily in supply‑side artifacts (larger context windows, heavier RAG, complex symbolic index systems). Marginal value of extra context/symbols can be negative in long‑horizon collaboration due to Index Sickness.
• Cost of complexity and maintenance: Symbolic indexing systems and defensive rule stacks create ongoing cognitive and maintenance costs (repair sessions, integration failures). Those costs should be factored into total cost of ownership for AI‑assisted workflows.
• Productivity and ROI: Consumer‑side interventions (clear natural‑language purpose signals, semantic space control, simple state separation) can deliver high ROI — fewer tokens/instructions, reduced error corrections, and more stable long‑horizon collaboration. Token costs and model‑usage economics improve if instruction volume and error‑driven rework decline.
• Product design and market differentiation: Collaboration platforms, code assistants, and RAG providers can differentiate by supporting explicit-purpose scaffolding, semantic space controls, and Baseline‑Log style state separation—features that reduce long‑horizon failure risk rather than only increasing context capacity.
• Labor and task allocation: The findings suggest that human managers/owners who supply clear purpose statements can unlock more reliable AI productivity, shifting the nature of human labor from authoring symbolic indices to curating purpose and reviewing physical artifacts—affecting job design and training investments.
• Procurement and model selection: Buyers should prefer models and integrations that facilitate consumer‑side activation (easy purpose injection, session state management) and should scrutinize claims that larger context windows alone solve long‑horizon collaboration problems.
• Externalities for the AI tool market: Widespread adoption of heavy symbolic indices can raise systemic risk of brittle workflows and coordination failures across organizations; standards and best practices encouraging semantic vitality controls could reduce these negative externalities.
• Measurement and evaluation: Economists and organizations should develop metrics for “Index Sickness risk” (e.g., divergence between symbolic consistency and physical artifact verification, volume of corrective sessions, instruction token volume trends) to evaluate long‑term costs and benefits of tooling choices.
• Research and policy priorities: Funding and research should explore consumer‑side mechanisms, state‑management designs, and model architectures that are robust to historical context noise. Policymakers interested in automation impacts should consider that efficiency gains depend on collaboration protocols, not just model scale.

Limitations and caveats for economic interpretation - Single‑case action research: the magnitude of measured gains (e.g., 75% instruction reduction) is promising but context‑specific; replication across industries, tasks, and model families is needed before generalizing price‑oriented policy or procurement decisions. - Model heterogeneity: different LLM architectures and training regimes may exhibit different susceptibility to Index Sickness; economic decisions should account for model‑specific behavior. - Behavioral and organizational factors: success depends on discipline in applying consumer‑side protocols (clear purpose statements, state separation). Adoption costs (training, process change) must be weighed against projected gains.

Actionable suggestions for economists, managers, and platform providers - Track instruction token volume, corrective session frequency, and divergence between documented symbols and physical artifacts as leading indicators of Index Sickness. - Pilot consumer‑side interventions (explicit purpose prompts, baseline/log separation) in long‑horizon AI workflows before investing heavily in context expansion or complex symbolic indices. - Rebalance R&D and procurement budgets to include lightweight state management and interface affordances that make purpose declaration and physical verification easy. - Encourage replication studies and cross‑model experiments to quantify tradeoffs between supply‑side and consumer‑side investments across settings.

Summary: The paper cautions that more formalization and larger context windows can backfire in long‑horizon LLM collaboration. Economically, shifting some investment from supply‑side scale/indices toward consumer‑side semantic control (natural language + explicit purpose, simple state separation) promises cost‑effective gains in reliability and lower ongoing maintenance costs — but broader validation is required.