The Commonplace
Home Three-study pilot Papers Evidence Explore Trends Syntheses Digests References Docs 🎲 Workforce Futures
← Papers
Direction, evidence grade, and study type are AI-generated labels (gpt-5-mini), not human-verified. Syntheses are LLM-written. "Tensions" are machine-detected candidates, not confirmed contradictions. A research-acceleration tool, not peer review. How this is built →

A new information theory swaps bit fidelity for action effectiveness: the authors define 'pragmatic' entropy, mutual information and a behavioural capacity that bounds how much net utility an agent can extract under resource constraints, unifying communication, control and decision-making in a single mathematical framework.

A Mathematical Theory of Pragmatic Information
Kai Niu, Ping Zhang · September 10, 2026
arxiv theoretical n/a evidence 7/10 relevance Full text usable extracted full text Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

Arxiv

Latest observation:

  1. Kai Niu unresolved corpus identity
  2. Ping Zhang unresolved corpus identity
This paper develops a unified mathematical theory of pragmatic information—centering on an isoteleia mapping that groups semantic states by their optimal actions—defines pragmatic entropy, mutual information, capacity and rate-distortion, introduces value and cost of information, and proves corresponding coding theorems and optimization dualities that bound the net utility extractable by resource-constrained agents.

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

We propose a pragmatic information theory unifying communication, control, and decision-making. Its core is the isoteleia mapping, formalizing equifinality: distinct semantic paths leading to the same optimal action are pragmatically equivalent. This induces a three-tier hierarchy of syntactic, semantic, and pragmatic information, each abstraction discarding task-irrelevant distinctions. We develop pragmatic entropy, up/down mutual information, channel capacity, and rate-distortion, and prove three coding theorems generalizing Shannon's classical results. We introduce pragmatic value (VoI) and cost (CoI) of information as decision-theoretic duals to rate-distortion and capacity, respectively, and formulate a Lagrangian dual framework for cross-layer optimization. The pragmatic efficiency bound $\mathcal{E}_p(λ)=\sup_R[Φ_p(R)-λ\,\mathrm{CoI}_p(R)]$ quantifies the maximum net utility any resource-constrained intelligent system can extract, thereby establishing a fundamental behavioral capacity limit---generalizing Shannon's symbol-level capacity to goal-directed action. Extensions to continuous messages yield closed-form Gaussian expressions, while dynamic settings are addressed via a Bellman equation for sequential decision-making. This framework provides a rigorous foundation for task-oriented communication, networked control, autonomous systems, and embodied AI, shifting focus from symbol fidelity to the effectiveness of information in guiding actions, and offers a unified mathematical language for next-generation intelligent systems.

Summary

Main Finding

The paper proposes a formal mathematical theory of pragmatic information that extends and unifies classical (syntactic) information theory, semantic information theory, control theory, and decision theory. Its core is the isoteleia mapping—formalizing equifinality (different semantic representations that lead to the same optimal action)—which yields a three-tier hierarchy (syntactic → semantic → pragmatic). The authors define pragmatic counterparts to entropy, mutual information, capacity, and rate-distortion, prove pragmatic versions of Shannon’s coding theorems, and introduce decision-theoretic duals: pragmatic value of information (VoI) and pragmatic cost of information (CoI). A Lagrangian dual framework yields a pragmatic efficiency bound Ep(λ) = sup_R [Φp(R) − λ CoIp(R)], interpreted as a behavioral capacity: a fundamental limit on the net utility that a resource-constrained intelligent agent can extract from its environment.

Key Points

  • Conceptual core
    • Isoteleia mapping: groups semantic classes that produce the same optimal terminal action (equifinality).
    • Reification mapping: composition that connects pragmatic intents to syntactic signals.
    • Three-tier hierarchy: syntactic (symbols/fidelity) ≤ semantic (meaning) ≤ pragmatic (action effectiveness); pragmatic abstractions discard distinctions irrelevant to decision outcomes.
  • Pragmatic information measures
    • Pragmatic entropy Hp(W).
    • Up/down pragmatic mutual information Ip(X;Y).
    • Pragmatic channel capacity Cp and pragmatic rate-distortion Rp(D).
    • Hierarchical inequalities showing potential performance gains: Hp ≤ Hs ≤ H, Cp ≥ Cs ≥ C, Rp(D) ≤ Rs(D) ≤ R(D).
  • Coding theorems
    • Pragmatic versions of three fundamental Shannon theorems: lossless source coding, channel coding (pragmatic capacity), and rate-distortion (pragmatic rate-distortion).
  • Decision-theoretic duals and Lagrangian framework
    • Pragmatic Value of Information (VoI): utility gain from task-relevant information; dual to rate-distortion.
    • Pragmatic Cost of Information (CoI): minimal resource expenditure to achieve a given pragmatic rate; dual to channel capacity.
    • Global pragmatic Lagrangian Lglobal(R; λ) = Φp(R) − λ CoIp(R); optimality where marginal value equals marginal cost. λ serves as a shadow price converting physical resources (power, bandwidth, latency) into utility units.
    • Pragmatic efficiency functional Ep(λ) = sup_R [Φp(R) − λ CoIp(R)] — a behavioral capacity for goal-directed systems.
  • Extensions and dynamics
    • Continuous-domain formulation via isoteleic volumes; closed-form expressions for Gaussian sources/channels.
    • Dynamic (sequential) settings addressed via a Bellman-equation–style formulation linking to reinforcement learning / dynamic programming.
  • Applications emphasized
    • Task-oriented communication, semantic/pragmatic communication systems, networked control, embodied AI, LLMs/AI agents, autonomous driving, robotics, human learning.

Data & Methods

  • Nature of work: theoretical and mathematical; no empirical datasets.
  • Methods and formal tools used:
    • Formal mappings (isoteleia, synonymous, reification) to define equivalence classes at semantic and pragmatic layers.
    • Information-theoretic derivations to define pragmatic entropy, mutual information, capacity, rate-distortion.
    • Proofs extending Shannon coding theorems to pragmatic settings (lossless source coding, channel coding, rate-distortion).
    • Lagrangian duality to connect value (VoI) and cost (CoI) and derive the pragmatic efficiency bound and shadow price λ.
    • Measure-theoretic extension to continuous domains via isoteleic volumes; closed-form Gaussian results obtained.
    • Dynamic programming / Bellman-equation approach to model sequential decision-making and time-varying resource constraints.
  • Validation: formal proofs and derived closed-form special cases (Gaussian). The paper frames implications and examples (LLMs, robotics) but does not present empirical implementation results.

Implications for AI Economics

  • Pricing and valuation of information
    • VoI gives a principled, task-centered metric to value outputs of AI systems (e.g., LLM responses) in terms of expected utility improvement rather than accuracy or likelihood alone.
    • CoI provides a framework to quantify the resource cost (bandwidth, latency, energy, compute) required to deliver a given level of pragmatic information; this supports cost-based pricing of API calls, model access tiers, or communication services.
    • The shadow price λ is a natural economic price signal mapping physical resource consumption to utility units; it can guide dynamic pricing, congestion fees, and market-clearing mechanisms.
  • Platform design and monetization
    • Platforms can use Ep(λ) to evaluate the maximum net utility extractable per resource budget—informing subscription tiers, per-call pricing, or bundled service design that optimizes user utility per dollar.
    • Auction or allocation mechanisms for scarce communication/computation resources (e.g., edge compute, V2X bandwidth) should be designed to allocate capacity where marginal pragmatic value exceeds the marginal pragmatic cost (VoI ≥ λ·CoI).
  • Investment and cost-benefit analysis
    • Behavioral capacity Ep(λ) provides a normative upper bound to assess ROI on investments in infrastructure (bandwidth, specialized hardware) or model improvements: does increasing resources increase net pragmatic utility?
    • The framework helps quantify trade-offs between investing in better sensors/models (increasing VoI) versus investing in communication/computation infrastructure (reducing CoI).
  • Mechanism and policy design
    • Regulators and standards bodies can adopt pragmatic-efficiency metrics (Ep(λ), VoI/CoI) to evaluate claims of “intelligent” or “task-oriented” services, ensuring incentives align toward real-world utility rather than signal fidelity.
    • Policies for transparency could require providers to report pragmatic-cost and value estimates for services that affect safety-critical decisions (e.g., autonomous vehicle stacks, medical decision support).
  • Market modeling and welfare analysis
    • The VoI/CoI duality enables microeconomic models of information markets where buyers value pragmatic outcomes; welfare-maximizing allocations and price schedules can be derived by maximizing aggregate Ep(λ).
    • Platform competition: providers that deliver higher pragmatic efficiency (higher Φp(R) per CoIp(R)) can dominate markets even if their syntactic fidelity or throughput is lower.
  • Operational research and empirical work to enable economics applications
    • Estimation: economists and data scientists can empirically estimate VoI by randomized experiments measuring outcome improvements from model outputs; estimate CoI by measuring marginal resource costs (energy, latency, bandwidth, compute).
    • Dynamic pricing: implement λ as a real-time scarcity signal (e.g., surge pricing for compute or bandwidth) to align supply with marginal pragmatic value.
    • Mechanism evaluation: test auction designs that allocate limited communication/computation to tasks maximizing net pragmatic value.
  • Research directions
    • Empirical validation: apply the framework to real AI services (LLMs, perception-to-action pipelines) to measure pragmatic entropy, VoI, CoI, and Ep(λ).
    • Market design: design and test markets and contracts that buy/sell pragmatic information (e.g., APIs sold by VoI or priced by CoI-adjusted rates).
    • Welfare and distributional effects: analyze how pragmatic pricing affects different user groups (who may have different utilities and resource budgets), and design regulation to avoid adverse outcomes.

Overall, the paper supplies a rigorous theoretical foundation that can be operationalized in AI economics to price, allocate, and regulate information-intensive services using task-oriented, utility-based metrics instead of throughput or fidelity alone.

Assessment

Paper Typetheoretical Evidence Strengthn/a — Theoretical contributions are internally evidenced by mathematical definitions and claimed theorems rather than empirical data; this yields strong internal consistency if proofs are correct but no external validation. Methods Rigorhigh — Uses standard information-theoretic constructs extended to a higher-level (pragmatic) abstraction and claims formal coding theorems and duality results; rigor depends on the exact assumptions and proofs (not fully shown in the excerpt), but the approach follows established mathematical methodologies. SampleNo empirical sample; the paper uses abstract mathematical models and probability distributions to define the perception-communication-decision-execution (PCDE) framework, introduces mappings (isoteleia, synonymous, reification), derives information-theoretic quantities, proves coding theorems, and provides continuous-domain (Gaussian) examples and a dynamic Bellman-type extension. Themeshuman_ai_collab innovation GeneralizabilityThe framework is highly abstract and depends on modeling choices (utility functions, action spaces, priors, mappings) that may be hard to specify in real-world AI systems., Assumes well-defined decision-theoretic objectives and known distributions; applicability is limited where utilities or transition dynamics are unknown or nonstationary., Human behavior, bounded rationality, social interactions, and strategic multi-agent effects are not explicitly modeled, limiting applicability to economic settings with those features., Computational tractability and algorithmic realization for large-scale systems (e.g., LLMs, high-dimensional sensory inputs) are not addressed in the provided text., Empirical validation or calibration to practical AI systems (LLMs, robotics, networked control) appears absent, so practical performance gains are uncertain.

Claims (10)

ClaimDirectionOutcomeConfidence & EvidenceDetails
The paper proposes an isoteleia mapping that formalizes equifinality: distinct semantic paths leading to the same optimal action are pragmatically equivalent. Decision Quality positive Equivalence of information representations with respect to optimal action
Reading fidelity high
Study strength medium
not reported
0.12
The proposed framework establishes a three-tier hierarchy of syntactic, semantic, and pragmatic information in which higher levels discard task-irrelevant distinctions. Task Allocation positive Task-relevant abstraction of information
Reading fidelity high
Study strength medium
not reported
0.12
The paper defines pragmatic entropy, up/down pragmatic mutual information, pragmatic channel capacity, and pragmatic rate-distortion functions. Decision Quality positive Quantification of task-relevant information
Reading fidelity high
Study strength medium
not reported
0.12
The paper claims the pragmatic measures satisfy the hierarchies Hp(W) ≤ Hs(W̃) ≤ H(W), Cp ≥ Cs ≥ C, and Rp(D) ≤ Rs(D) ≤ R(D). Organizational Efficiency positive Information entropy, channel capacity, and rate required for a given distortion level
Reading fidelity high
Study strength medium
Hp(W) ≤ Hs(W̃) ≤ H(W); Cp ≥ Cs ≥ C; Rp(D) ≤ Rs(D) ≤ R(D)
0.12
The paper introduces pragmatic value of information as the utility gain from task-relevant information and pragmatic cost of information as the minimum resource expenditure required to convey information at a specified pragmatic rate. Decision Quality positive Utility gain and resource expenditure associated with information
Reading fidelity high
Study strength medium
not reported
0.12
The global pragmatic Lagrangian is defined as net utility minus the cost of information, and its optimality condition balances marginal value against marginal cost. Organizational Efficiency positive Net utility from information under resource constraints
Reading fidelity high
Study strength medium
Lglobal(R; λ) = Φp(R) − λ CoIp(R); λ CoI′p(R*) = Φ′p(R*)
0.12
The pragmatic efficiency functional Ep(λ) = supR[Φp(R) − λ CoIp(R)] is proposed as a fundamental behavioral limit for resource-constrained intelligent systems. Decision Quality positive Maximum net utility extractable from information under resource constraints
Reading fidelity high
Study strength medium
Ep(λ) = supR[Φp(R) − λ CoIp(R)]
0.12
The paper claims three pragmatic coding theorems: lossless source coding at pragmatic entropy, reliable channel coding at pragmatic capacity, and lossy compression at the pragmatic rate-distortion function. Organizational Efficiency positive Minimum compression rate and maximum reliable transmission rate for pragmatic information
Reading fidelity high
Study strength medium
Minimum lossless rate = Hp(W); maximum reliable rate = Cp; minimum lossy rate = Rp(D)
0.12
The framework is claimed to subsume semantic information theory and classical information theory as special cases when the isoteleia mapping, and then the synonymous mapping, are trivial. Other positive Compatibility and generality of the information-theoretic framework
Reading fidelity high
Study strength medium
not reported
0.12
The paper extends pragmatic information measures to continuous messages and claims closed-form expressions for Gaussian channels and sources, while addressing dynamic settings through a Bellman equation. Decision Quality positive Analytical tractability of pragmatic communication and sequential decision models
Reading fidelity high
Study strength low
not reported
0.06

Notes