Robots that plan courteously and anticipate how current actions raise future costs for others cut cumulative task costs in simulated persistent environments; a factored anticipatory planner yields double-digit improvements over myopic baselines and meaningful gains over selfish anticipatory planning while keeping per-robot training modular.

Main Finding

Robots operating in persistent shared environments create negative downstream side effects when they plan myopically or only for their own future tasks. The paper introduces courteous anticipatory planning: a model-based planner that samples candidate plans for the current task and selects the one minimizing immediate cost plus the aggregated expected future cost for all robots (estimated via independent per-robot learned models). This factored approach (1) avoids combinatorial joint rollouts, (2) supports modular deployment (add a robot by training only its estimator), and (3) yields meaningful reductions in total sequence cost in simulation (≈10–17% vs myopic; ≈4–13% vs selfish anticipatory planning depending on the environment).

Key Points

• Problem setting
  • Persistent shared environment with multiple robots R.
  • Tasks arrive sequentially, one at a time; the terminal state after each task persists.
  • Classical planners that minimize immediate cost cause side effects that raise future costs for others.
• Definitions and baselines
  • Myopic baseline: standard cost-minimizing planner per task.
  • Selfish anticipatory planning: single-robot anticipatory objective (minimize current cost + expected future cost for the acting robot).
  • Courteous anticipatory planning (this paper): minimize current cost + sum_r V_r^AP(s_g) (expected next-task cost for each robot r starting from the candidate terminal state s_g).
• Core algorithm
  • Sample a set of diverse candidate plans for the current task using focused sampling (proxy placement/state predicates).
  • For each candidate terminal state, evaluate immediate plan cost + aggregate of per-robot anticipatory-cost estimates.
  • Select the plan minimizing this combined objective.
• Per-robot anticipatory estimators
  • Trained independently per robot to predict expected cost for that robot’s next task from a given state.
  • Use a scene-graph representation fed to a GNN (4 GINConv layers; mean+sum pooling → linear layer).
  • Training data generated offline by rollouts over held-out environments.
• Empirical results (simulated)
  • Home environment (2 robots with similar capabilities but distinct responsibilities): Courteous A.P. reduced total cost by 10.43% vs myopic and 4.03% vs selfish A.P.
  • Restaurant environment (3 robots with distinct capabilities): Courteous A.P. reduced total cost by 17.41% vs myopic and 13.24% vs selfish A.P.
  • Evaluations used many long task sequences (e.g., averaged over 100 sequences of 20 tasks).
• Practical properties
  • Computationally tractable at deployment because estimators are queried instead of performing joint future rollouts.
  • Modular: adding/removing robots requires training only their own estimator.

Data & Methods

• Representation and planning
  • Tasks, actions, states encoded in PDDL; planners based on FastDownward with ff-astar.
  • Candidate plan generation via focused sampling: augment tasks with proxy placement/state predicates to produce structurally diverse, downstream-relevant plans.
• Cost model
  • Movement cost proportional to travel distance; other actions incur unit cost.
• Anticipatory-cost estimation
  • Scene graph: nodes = entities (semantic & geometric attributes), edges = spatial/logical relations.
  • GNN architecture: 4 GINConv layers + batch norm + leaky ReLU; graph pooling (mean and sum) → linear layer → scalar cost estimate.
  • Training data produced offline by solving sampled future tasks and measuring plan costs to approximate expected next-task cost per robot.
• Evaluation
  • Two domains: home (2 robots; ALFRED-style rearrangement tasks in PROCTHOR layouts) and restaurant (3 robots with distinct capabilities and task types).
  • Baselines: myopic FastDownward and selfish anticipatory planning (same estimator but only for acting robot).
  • Metrics: total cost over long task sequences; per-task cost averaged across many random sequences (e.g., 100 × 20-task sequences).

Implications for AI Economics

• Externalities and social welfare
  • The paper formalizes a negative externality common to multi-agent robotic deployments: individually optimal decisions can impose costs on others via persistent shared states. Courteous anticipatory planning is an engineering mechanism to internalize these externalities, increasing aggregate welfare (lowered total execution cost).
• Value of foresight
  • Even limited, learned one-step lookahead across agents yields measurable efficiency gains. This quantifies the economic value of investing in predictive/anticipatory models when operating fleets in shared environments.
• Modular vs joint solutions: marginal costs of scaling
  • The factored per-agent estimator architecture implies low marginal cost for scaling fleets: adding a new agent requires training a single estimator rather than retraining a joint model. From a deployment economics perspective, this reduces incremental training/engineering costs and facilitates heterogeneous fleets.
• Market and platform design implications
  • Platform operators (e.g., warehouses, robot-as-a-service providers) should consider embedding or offering anticipatory coordination tools to reduce cross-agent frictions. Such features could be monetized (premium coordination services), or required as part of service-level agreements to guarantee aggregate efficiency.
• Mechanism design & incentives
  • If agents are owned by different principals, selfish behavior will persist unless incentives align. The paper’s objective is akin to centralized internalization of externalities; in decentralized settings, policy tools (side-payments, congestion pricing, contracts) or decentralized protocols to share anticipatory cost signals would be needed to implement courteous behavior.
• Labor substitution and productivity
  • Efficiency gains (10–17% cost reductions in simulation) map to faster throughput, lower energy/time per job, and potentially lower operational cost. For firms replacing human labor with robot fleets, anticipatory coordination increases productivity per robot and can change cost–benefit calculations of automation investments.
• Regulatory and safety considerations
  • Regulators or standards bodies might require multi-robot deployments to account for shared-space externalities (safety, accessibility). Approaches like courteous anticipation provide a concrete, verifiable way to demonstrate reduced negative side effects.
• Limitations impacting economic interpretation
  • The work uses simulated symbolic environments and simplifies cost models (movement+unit actions). Real-world returns could differ; estimator accuracy and environment generalization are critical. The paper’s formulation focuses on single-step expected next-task cost (not long multi-step joint distributions), so some externalities may remain uninternalized.
• Suggested economic experimentation and extensions
  • Compare centralized vs decentralized incentive mechanisms for inducing courteous behavior (e.g., payments for leaving low-cost terminal states).
  • Estimate real-world ROI by mapping simulated cost reductions to time/energy/labor savings in target domains (warehouses, hospitality, home services).
  • Study strategic settings with heterogeneous ownership and private incentives, to design contracts or markets that produce socially efficient equilibrium.

Overall, the paper demonstrates a pragmatic and modular approach to reduce multi-agent negative externalities in persistent environments. For economists and platform designers, it highlights both (1) measurable value from anticipatory coordination and (2) a scalable architectural pattern (per-agent learned estimators) that lowers the marginal cost of deploying heterogeneous, courteous fleets.