Autonomous AI finds hidden links across prediction-market contracts and turns them into profitable signals: agent-identified relationships were correct about 60–70% of the time and yielded roughly 20% average returns in week-long backtests on Polymarket. The result suggests LLM-based agents can uncover latent semantic structure in markets, though live performance, costs and scalability remain untested.

Main Finding

An agentic AI pipeline that combines LLM-based semantic clustering with within-cluster relationship discovery can identify pairs of prediction-market contracts that resolve to the same or opposite outcomes with roughly 60–70% accuracy; converting those discovered links into a simple leader–follower trading rule yields economically meaningful edges (average return ≈ 20% over week-long horizons in the authors’ backtests). The key design is combining semantic structure (to limit candidate pairs) with outcome-based empirical validation (to filter to reliable links).

Key Points

• Problem addressed: prediction-market fragmentation (near-duplicates, implicit links, hidden contradictions) raises search costs, disperses liquidity, and hides hedging/arbitrage opportunities.
• Proposed solution: an end-to-end agentic pipeline (Agentics + MCP tools) that
  • clusters markets topically using embeddings and LLMs,
  • labels clusters into a closed taxonomy (e.g., politics, macro, crypto),
  • proposes within-cluster market pairs with a labeled relation: “same-outcome” (correlated) or “different-outcome” (anti-correlated), plus a confidence score and rationale.
• Relationship types targeted: interpretable, actionable binary relations — same outcome vs different outcome.
• Performance: agent-identified relationships achieve roughly 60–70% accuracy (precision-like measure for high-confidence pairs). Using the discovered relations in a conservative leader–follower trade rule yields average ROI ≈ 20% over week-long horizons in the historical Polymarket dataset.
• Economic test: trades enter market j immediately after a linked leader market i resolves; entry filtered by price extremeness and terminal price decisiveness to avoid pathological cases.
• Contributions claimed:
• Agentic pipeline for organizing/linking prediction markets.
• An evaluation protocol using resolved markets (cluster-level and pooled accuracy).
• An assessment of economic relevance via a transparent leader–follower execution rule.

Data & Methods

• Data source: Polymarket resolved markets (collected via Dune Analytics) — markets resolved April–July 2025; focus on high-volume resolved markets.
• Sample selection:
  • Binary YES/NO markets only.
  • Markets with active trading window ≥ 7 days.
  • Month-based slicing by question text (e.g., “in April”) to create temporally comparable cohorts and test generalization.
  • Final sample: N = 778 markets (split by month: April 217, May 256, June 190, July 43). Summary stats: mean duration ≈ 41 days; volume varying by month (see paper Table 1).
• Agentic architecture:
  • Agentics framework: typed schemas (ATypes) and LLM transductions.
  • MCP tools:
    • Clustering MCP: embed market text, form K clusters with K ≈ floor(N/10).
    • Cluster Labeling MCP: assign one label from a small taxonomy via schema-constrained LLM generation.
    • Relationship Discovery MCP: for each cluster, propose MarketRelation objects (question i, question j, is_same_outcome boolean, confidence ∈ [0,1], rationale).
• Relationship discovery constraints: LLM instructed to propose only pairs whose outcomes are “very likely to be related” and to specify direction and confidence.
• Evaluation protocol:
  • Ground truth for a pair (i, j): outcome_i == outcome_j (1 if equal, 0 if not).
  • Consider only pairs with confidence score ≥ 0.5.
  • Metrics: per-cluster average accuracy (mean of cluster accuracies for clusters with ≥1 eligible pair) and pooled overall accuracy (fraction correct across all eligible pairs).
• Trading/backtest:
  • Leader–follower single-leg rule: wait until market i resolves, then enter market j on first observed tick after that time.
  • Side selection: if relation = same-outcome, buy the side matching i’s realized outcome; if different-outcome, buy the opposite side.
  • Entry filters:
    • Extremeness filter: skip if chosen leg price ∈ (0, 0.1] ∪ [0.9, 1).
    • Final-price quality filter: require market j’s final price to be within 0.1 of 0 or 1 (decisive resolution).
  • PnL model: unit-stake binary payoff; winning trade PnL = 1 − entry price; losing trade PnL = −entry price.
  • Reported result: average return ≈ 20% over week-long horizons (authors also report trade counts and ROI aggregates).
• Caveats and limitations noted by authors:
  • Dataset limited to Polymarket and to relatively high-volume, longer-horizon binary markets — selection bias.
  • Statistical correlation alone is noisy for one-shot resolved contracts; clustering + semantic signals were used to reduce candidate space.
  • LLM-based judgments can hallucinate or be brittle; confidence scores may be imperfect.
  • Backtest uses conservative leader–follower rule to avoid look-ahead bias, but practical execution frictions, market impact, and latency are not fully modeled.

Implications for AI Economics

• Automated discovery of semantic relationships can reduce search and information-friction costs on prediction-market platforms, potentially concentrating liquidity and improving price discovery by linking fragmented listings.
• Agentic AI acting as a discovery layer (or active market participant) can surface hedges and arbitrage opportunities not obvious via naive embedding similarity or short price histories — raising both efficiency and strategic-arbitrage implications.
• Economic returns from discovered relations suggest that semantic-LLM-based signals contain exploitable structure; however, such edges may decay if widely adopted (endogenous equilibrium effects).
• Policy / mechanism-design implications:
  • Platforms could integrate semantic clustering and relation metadata (structured tags, inferred links) to improve UX and market quality, but must manage manipulation risk (agents or submitters could craft contract text to induce misleading relations).
  • Market design should consider the potential for agentic strategies to create feedback loops; e.g., many agents trading same discovered links could amplify volatility or wash out rents.
• Evaluation and robustness:
  • The proposed evaluation protocol (use of resolved markets, leader–follower rule, cluster- and pooled-level metrics) offers a reproducible benchmark for future AI models and for measuring the economic value of semantic discovery methods.
  • Future work needed on generalization across platforms, multi-outcome/NegRisk markets, longer horizons, adversarial settings, and modeling execution costs and market impact.
• Broader risks: LLM errors, overconfidence, and adversarial text-crafted markets create new forms of informational externalities; regulators and platform operators should monitor agentic activity and consider disclosure, rate-limiting, or provenance tagging for automated agents.

If you want, I can: (a) extract the exact experimental numbers (counts, ROI, per-month accuracies) from the paper’s tables/appendix into a compact table; or (b) produce a shorter executive summary focused only on economic takeaways. Which would you prefer?