A play-money market tied to an open chat can theoretically induce experts to reveal private evidence and trade as if the hypothesis were already resolved, producing fully interpretable aggregated insights and a potential funding mechanism for collaborative science; real-world effectiveness will hinge on incentive implementation, resistance to manipulation, and behavioral robustness.

Main Finding

A self-resolving play-money prediction market entangled with a public chat can create an equilibrium in which heterogeneous experts directly reveal and pool their private information about a complex scientific hypothesis. Trading behaves as if the market outcome were resolved by the true hypothesis, yet final payouts do not require knowing the ground truth (they are determined by a Bernoulli draw with probability = market price). This yields interpretable, verifiable aggregation of diverse evidence and a practical incentive scheme to fund large-scale collaborative science.

Key Points

• Problem targeted

  • Standard tools (Bayesian truth serum, peer prediction, conventional prediction markets) can fail when experts hold arbitrarily diverse, rich private information and information structures are not commonly known. Indirect aggregation (prices or repeated belief elicitation) can converge to unintelligible or inefficient outcomes.
  • In complex scientific hypotheses, the analyst needs not only a probability but the actual pooled information (arguments, experiments, verifiable steps) — i.e., interpretability is essential.

• Mechanism proposed

  • Create a play-money prediction market with four public rules:
  • Each participant receives the same limited amount of play money.
  • Market closes after a prescribed period of trading inactivity.
  • Winners are paid by a binary random generator whose success probability equals the final market price (self-resolving).
  • A public chat is available for sharing information.
  • Public invitation to participants: “Trade as if the market would resolve according to the truth of H, and share your private information on H in interpretable/verifiable form via chat.”

• Why it works (intuitively & theoretically)

  • The self-resolving payout disentangles reward from any ex-post verification of ground truth: agents' optimal strategy (in an equilibrium) is to reveal information that increases price toward the true conditional probability because their expected play-money wealth maps to expected monetary payoffs through the randomized resolution.
  • Direct public communication (chat) allows experts to post proofs, experiment results, LLM outputs, etc., so the pooled information becomes fully interpretable instead of a single consensus number.
  • The mechanism leverages a simple robust property of markets: if agents commonly believe a particular public probability, the market price will reflect that belief (property eff0). By making relevant information public through chat, the market operates under this favorable condition.
  • The paper formalizes this in an epistemic game-theoretic model (types/hierarchies of beliefs, non-atomic priors in illustrative examples) and shows existence of equilibria with the desired behavior.

• Advantages over alternatives

  • No need for a known ground truth to resolve the market.
  • No requirement for complex Bayesian calculations by participants.
  • Produces explicit, verifiable aggregation (interpretability).
  • Can incentivize broad participation with small ex-ante play-money stakes and real-world payoffs proportional to play-money outcomes.

• Caveats and assumptions discussed

  • Some model assumptions (e.g., common invitation, equal initial play money, inactivity-triggered close) are mechanism design choices; equilibrium existence rests on these institutional features.
  • The paper analyzes a stylized illustrative example (non-atomic prior, one-directional private signals in a subcase) to show failure modes of indirect aggregation and motivate the mechanism; general results are formalized in epistemic game-theoretic terms.
  • Practical risks (e.g., false or unverifiable claims in chat, strategic misinformation) are recognized implicitly; the mechanism relies on verifiability and community validation of posted evidence.

Data & Methods

• Nature of the work
  • The paper is primarily theoretical and normative: it develops and analyzes a mechanism in the formal language of epistemic game theory and prediction market theory.
• Tools and elements used
  • Formal models of information structures: partitions/types, hierarchies of beliefs, non-atomic priors in examples.
  • Equilibrium analysis: constructs and characterizes equilibria in which participants share private information and trade accordingly.
  • Conceptual linkage to empirical literature:
    • Cites experimental evidence that play-money markets can be well-calibrated and that markets plus public revelation of information work well (e.g., experiments on gene activation ordering).
    • References prior work on self-resolving markets and peer-prediction/Bayesian truth serum.
• Empirical support
  • The paper leans on prior experimental studies showing markets perform well when information is public and that play-money markets can mirror real-money calibration; it does not present new field experiments but argues the mechanism is implementable and robust.

Implications for AI Economics

• New coordination/incentive primitives for research
  • The mechanism provides a way to finance and coordinate large-scale collaborative investigations (including ones using LLMs and other AI tools) without needing ex post ground-truth verification. This can lower frictions in funding exploratory or foundational research.
• Aligns with the role of LLMs in research workflows
  • Since private information can include LLM outputs, the mechanism can incorporate model-generated evidence, question-engineering artifacts, and comparative model diagnostics, while still demanding interpretability/verifiability from contributors.
• Markets for interpretability and explanation
  • Rewards are tied to demonstrated contributions (through play-money outcomes and public evidence) rather than opaque posterior numbers, which could create market incentives favoring interpretable explanations and reproducible artifacts — valuable in AI governance and evaluation.
• Use cases in AI evaluation where ground truth is absent
  • Helps assess complex claims about model capabilities, safety properties, or emergent behaviors when definitive ground truth is unavailable or costly to obtain: pooled experimental logs, chains of reasoning, and replication steps become the object of aggregation.
• Policy and funding design
  • Funders (public or private) could run such self-resolving markets to allocate grants or bounties: small real payouts proportional to play-money performance can direct sizable collective attention and produce verifiable deliverables.
• Potential market-design and implementation challenges
  • Verification burden: quality control and moderation of posted evidence will be crucial to prevent misinformation and to ensure posted claims are actually verifiable.
  • Strategic behavior: sybil attacks, collusion, or coordinated manipulation of chat+market could arise and would need defensive design (identity checks, reputation, stakes, auditability).
  • Calibration of incentives: the mapping from play-money outcomes to real payoffs must be designed to avoid perverse incentives (e.g., reward for producing plausible but false evidence).
• Research agenda suggestions
  • Experimental trials: lab/field experiments to test whether chat+self-resolving play markets reliably induce truthful, verifiable disclosure across heterogeneous participants.
  • Robustness to non-Bayesian behavior: test mechanism performance when participants deviate from Bayesian updating (bounded rationality), including LLM-assisted agents.
  • Abuse-resistance mechanisms: integrate verification procedures, reputation systems, or cryptographic proofs of experiment reproducibility.
  • Applications: pilot deployments for AI model evaluation, reproducibility challenges, and decentralized funding for collaborative scientific tasks.

Summary takeaway: The paper offers a practically implementable market-chat mechanism that shifts prediction-market aggregation from opaque posterior numbers to explicit, verifiable pooling of evidence—removing the need for ground-truth resolution and enabling new market-based incentives for collaborative scientific (and AI-related) investigation.