Personal 'twin agents' that speak and act for absent workers blur the line between person and machine, creating new attribution and trust problems; existing safeguards against automation overreliance fail because there is no clear boundary for accountability.
Agentic AI has taken on the role of assistant, collaborator, and decision-support tool. We argue the next role on that list is more personal: you. These are digital twins of each individual -- twin agents -- representing their knowledge, perspective, and communicative style to colleagues when they are unavailable. Drawing on early design work in an ongoing project in which agents represent knowledge workers in a professional setting, we identify a trust calibration problem specific to this approach. When a human colleague doubts a twin agent's output, they face three failure modes (a schema gap, an epistemic gap, and a model artifact) with no reliable attribution path between them. Cognitive forcing functions and related frameworks address overreliance effectively in contexts where there is a clear boundary between the AI and the human decision-maker. However, twin agents dissolve that boundary, raising a class of trust calibration challenge these frameworks were not designed to handle. We introduce the concept, distinguish it from digital twins, and outline the research questions this new class of agent demands.
Summary
Main Finding
The paper introduces "twin agents" — agentic AIs that represent a specific real person's communicative, epistemic, and stylistic profile to colleagues in professional settings — and argues that they create a novel trust-calibration problem. When a colleague doubts a twin agent's output, they cannot reliably attribute the source of error to (1) an incomplete/incorrect person-model (schema gap), (2) the colleague's own lack of knowledge about the person (epistemic gap), or (3) a model failure (e.g., hallucination). This threefold attribution ambiguity breaks assumptions behind existing overreliance-mitigation frameworks (which assume a legible boundary between human and AI) and makes the agent’s “error boundary” structurally unlearnable from the colleague’s perspective.
Key Points
- Definition: A twin agent is a social AI constructed to represent (not impersonate) a specific individual’s expertise, perspective, and communicative style in professional contexts; it acts as an active social actor when the person is absent.
- Distinct from digital twins: Digital twins aim for maximum physical-system fidelity and are passive; twin agents intentionally avoid impersonation, are socially active, and operate within real interpersonal relationships.
- The Attribution Problem: Observed agent outputs that provoke doubt are ambiguous among three explanations:
- Schema gap — the agent's model of the person is wrong/incomplete.
- Epistemic gap — the recipient lacks knowledge of the real person’s view.
- Model artifact — the AI produced an LLM failure (hallucination, sycophancy, drift). All three yield the same observable behavior and cannot be disentangled externally.
- Consequence for trust calibration: Because colleagues lack independent ground-truth access to the represented person’s actual views in many cases, they cannot learn accurate mental models of the agent’s error patterns; standard interventions (e.g., cognitive forcing functions) assume a human/AI boundary and may fail or backfire in relational contexts.
- Research directions proposed:
- Finer-grained interface transparency that distinguishes between reconstructed inference and direct relay.
- Epistemic provenance linking agent outputs to specific artifacts or authored material by the modeled person.
- Relationally aware interventions that lower social costs of expressing doubt and make agent limits visible in interpersonal terms.
- Ethical/legal considerations: consent, identity and representation rights, distortion risk, accountability and team dynamics are critical companion problems.
Data & Methods
- This is a conceptual / design-focused paper rather than an empirical study.
- Methods include:
- Literature synthesis across human–AI interaction, generative agents, user-modeling (citing Park et al., Shaikh et al., Cheng et al., Hu et al., etc.).
- Reflective sociotechnical analysis (per Ehsan & Riedl) and design reasoning carried out while prototyping a simulated workspace where agents represent knowledge workers.
- Iterative design/engineering conversations and thought experiments that surfaced the threefold attribution ambiguity; no user studies or field deployments reported yet.
- The paper leverages prior empirical results from related work (e.g., person-specific simulation feasibility, passive user modeling) to argue that twin agents are plausible and imminent, motivating the theoretical analysis.
Implications for AI Economics
- Value of Expertise & Availability
- Twin agents could monetize and arbitrage an individual's tacit expertise by making it asynchronously available across time and teams, increasing effective labor supply without physical presence.
- This may raise the marginal productivity of individual specialists and shift where value is captured (e.g., platform owners, employers, or the modeled persons).
- Transaction Costs & Coordination
- Potential efficiency gains in coordination and decision speed (reduced wait time for expertise) are offset by higher coordination/verification costs caused by attribution ambiguity and trust frictions.
- Organizations may internalize new monitoring or provenance systems (audit trails) to reduce uncertainty, increasing operational costs but enabling higher adoption.
- Information Asymmetry & Signaling
- Twin agents create new asymmetric information problems: recipients cannot easily verify whether an utterance reflects the person or the model. This raises signaling and screening needs (e.g., provenance badges, third-party attestations) and may spawn markets for verification services.
- Liability, Contracts & Insurance
- Ambiguous attribution complicates legal liability and contractual design: who is responsible for agent-generated advice that harms outcomes — the modeled person, the employer, or the model vendor?
- This uncertainty can increase bargaining frictions, raise costs of sourcing advice, and create demand for liability contracts or insurance products covering representation errors.
- Labor Markets & Incentives
- Agent-based proxies could change bargaining power: workers whose epistemic profile is accurately captured may gain outsized reach, while those poorly modeled could see reputational harm.
- Strategic behavior: modeled persons might curate or monetize their twin agents, leading to incentive problems (e.g., gaming models, selectively authoring provenanceable content).
- Potential displacement or task-shifting: asynchronous availability of expertise may substitute for some real-time labor, altering staffing models and wage structures for knowledge work.
- Investment & Platform Economics
- Firms may invest in person-specific modeling infrastructure (data collection, provenance, interface design) as a competitive asset, creating lock-in (network effects around curated professional simulacra).
- Markets for “simulation-as-a-service” and for datasets to build twin agents could emerge, with pricing reflecting trustworthiness, provenance guarantees, and legal compliance.
- Externalities & Organizational Culture
- Miscalibrated trust and team-level breakdowns can produce negative externalities (eroded interpersonal trust, reduced collaboration ease) that reduce organizational productivity but are hard to measure.
- Conversely, well-designed provenance and relational interventions could amplify knowledge diffusion and reduce coordination slack, generating positive externalities.
- Research questions for AI economics
- How to quantify the productivity gains from asynchronous person-representation versus costs from trust/friction and monitoring?
- What contract and liability designs efficiently allocate risk among model vendors, employers, and modeled persons?
- How do twin agents affect labor supply elasticity and wage formation for high-skill workers whose expertise can be codified?
- What market structures (verification services, provenance markets, insurance) arise to manage attribution ambiguity, and how do they price trust?
- How do organizational policies (e.g., required provenance disclosure) affect adoption dynamics and welfare?
Overall, twin agents create a mix of efficiency opportunities (better availability and scale of expertise) and new economic frictions (attribution ambiguity, liability, trust externalities). Economists and policymakers should factor these trade-offs when modeling firm adoption decisions, labor market impacts, and the design of governance and market mechanisms (verification, contracting, insurance) around person-specific AI representations.
Assessment
Claims (7)
| Claim | Direction | Confidence | Outcome | Details |
|---|---|---|---|---|
| Agentic AI has taken on the role of assistant, collaborator, and decision-support tool. Adoption Rate | positive | high | adoption_of_agentic_roles |
0.03
|
| The next role on that list is more personal: you — digital twins of each individual (twin agents) representing their knowledge, perspective, and communicative style to colleagues when they are unavailable. Skill Acquisition | positive | high | representation_of_individual_knowledge_perspective_style |
0.01
|
| Drawing on early design work in an ongoing project, we identify a trust calibration problem specific to this approach. Decision Quality | negative | high | trust_calibration |
0.03
|
| When a human colleague doubts a twin agent's output, they face three failure modes (a schema gap, an epistemic gap, and a model artifact) with no reliable attribution path between them. Decision Quality | negative | high | failure_mode_attribution |
0.06
|
| Cognitive forcing functions and related frameworks address overreliance effectively in contexts where there is a clear boundary between the AI and the human decision-maker. Decision Quality | positive | high | overreliance_reduction |
0.06
|
| Twin agents dissolve that boundary, raising a class of trust calibration challenge these frameworks were not designed to handle. Decision Quality | negative | high | framework_applicability_for_trust_calibration |
0.06
|
| We introduce the concept [of twin agents], distinguish it from digital twins, and outline the research questions this new class of agent demands. Research Productivity | positive | high | conceptual_contribution_and_research_agenda |
0.1
|