The Commonplace
Home Dashboard Papers Evidence Digests 🎲
← Papers

Generative AI promises productivity and innovation in information systems but adoption is hindered by hallucinations, bias and an absence of governance; IS research should move from documenting impacts to actively shaping human–AI co-evolution and adaptive regulatory and organizational practices.

The Landscape of Generative AI in Information Systems: A Synthesis of Secondary Reviews and Research Agendas
Aleksander Jarzębowicz, Adam Przybyłek, Jacinto Estima, Yen Ying Ng, Jakub Swacha, Beata Zielosko, Lech Madeyski, Noel Carroll, Kai-Kristian Kemell, Bartosz Marcinkowski, Alberto Rodrigues da Silva, Viktoria Stray, Netta Iivari, Anh Nguyen-Duc, Jorge Melegati, Boris Delibašić, Emilio Insfran · March 12, 2026
arxiv review_meta n/a evidence 7/10 relevance Source PDF
A systematic synthesis of 28 IS secondary studies finds that Generative AI holds significant promise for productivity and innovation but its adoption is constrained by technical unreliability, ethical/societal risks, and a pervasive governance vacuum, calling for socio-technical research agendas focused on hybrid human–AI systems and adaptive governance.

As organizations grapple with the rapid adoption of Generative AI (GenAI), this study synthesizes the state of knowledge through a systematic literature review of secondary studies and research agendas. Analyzing 28 papers published since 2023, we find that while GenAI offers transformative potential for productivity and innovation, its adoption is constrained by multiple interrelated challenges, including technical unreliability (hallucinations, performance drift), societal-ethical risks (bias, misuse, skill erosion), and a systemic governance vacuum (privacy, accountability, intellectual property). Interpreted through a socio-technical lens, these findings reveal a persistent misalignment between GenAI's fast-evolving technical subsystem and the slower-adapting social subsystem, positioning IS research as critical for achieving joint optimization. To bridge this gap, we discuss a research agenda that reorients IS scholarship from analyzing impacts toward actively shaping the co-evolution of technical capabilities with organizational procedures, societal values, and regulatory institutions--emphasizing hybrid human--AI ensembles, situated validation, design principles for probabilistic systems, and adaptive governance.

Summary

Main Finding

Generative AI (GenAI) offers substantial transformative potential for productivity and innovation, but its diffusion and economic benefits are materially constrained by interrelated technical, social-ethical, and governance challenges. A persistent misalignment exists between rapidly evolving technical capabilities and slower-changing social institutions, creating adoption frictions and externalities that make purposeful socio-technical co-evolution — guided by information systems (IS) research and adaptive governance — essential to realize GenAI’s economic promise.

Key Points

  • Transformative potential
    • GenAI can increase productivity, enable new products/services, and augment creativity and decision-making across firms and sectors.
  • Technical constraints
    • Core limitations include hallucinations (incorrect but plausible outputs), performance drift across contexts, brittleness, and unpredictable failure modes.
  • Societal and ethical risks
    • Risks include bias and discrimination, misuse (fraud, deception), erosion of human skills through overreliance, and unequal access that may widen disparities.
  • Governance vacuum
    • Weak or lagging frameworks around privacy, accountability, intellectual property, liability, and standards create legal and strategic uncertainty for adopters.
  • Socio-technical misalignment
    • The technical subsystem (rapid model innovation, probabilistic outputs) is outpacing the social subsystem (procedures, norms, institutions), producing coordination failures and adoption frictions.
  • Role of IS research
    • IS should move from descriptive impact studies toward shaping co-evolution: design of hybrid human–AI ensembles, situated validation practices, design principles for probabilistic systems, and adaptive governance mechanisms.
  • Research agenda highlights
    • Emphasize hybrid human–AI work systems, context-sensitive validation and monitoring, design for uncertainty, and institutional innovations for adaptive regulation and accountability.

Data & Methods

  • Approach: Systematic literature review and synthesis focused on secondary studies and existing research agendas.
  • Corpus: 28 papers published since 2023.
  • Analytical lens: Socio-technical framework to interpret findings and identify cross-cutting themes across technical, social-ethical, and governance domains.
  • Synthesis methods: Thematic aggregation of reported risks, adoption barriers, and proposed research directions; interpretation emphasizing joint optimization of technical and social systems.
  • Limitations (inferred from scope)
    • Restricted to secondary studies and research agendas (no primary empirical microdata); limited timeframe (papers since 2023) may bias toward early, rapidly evolving viewpoints; possible publication and selection biases in the reviewed corpus.

Implications for AI Economics

  • Productivity and TFP measurement
    • Estimating GenAI’s contribution to productivity and total factor productivity requires models that account for probabilistic outputs, quality adjustments, and complementarities with human labor. Standard productivity metrics may misstate effects without task-level measurement and verification.
  • Adoption frictions and investment dynamics
    • Technical unreliability and governance uncertainty raise the effective cost and risk of adoption, creating option value to delay investment. This can slow diffusion and dampen aggregate gains even when technologies are welfare-improving in expectation.
  • Labor markets and skill-biased change
    • GenAI affects task allocation: complementarities with cognitive and supervisory skills may raise returns to certain human skills while displacing routine tasks. Risk of skill erosion and reallocation costs suggests transitional unemployment and distributional impacts.
  • Contracting, pricing, and market design
    • Probabilistic outputs complicate contracting (performance-based pay, warranties), pricing of AI services, and the design of verification/certification markets. New contracts and certification regimes (e.g., liability/insurance products) will be important to internalize risk.
  • Intellectual property and innovation incentives
    • Unclear IP regimes for model outputs and training data create disputes over value capture and may distort incentives for data sharing, model innovation, and downstream entrepreneurship. Policy choices will shape market structure and concentration dynamics.
  • Market power and concentration risks
    • High fixed costs, data advantages, and network effects can lead to winner-take-all dynamics. Governance and antitrust policy choices will materially affect competitive structure and the distribution of economic gains.
  • Externalities and public goods
    • Negative externalities (misinformation, privacy harms, systemic risk) and positive externalities (public-good improvements) argue for public policy interventions (standards, liability rules, subsidies for validation/benchmarks).
  • Research directions for AI economics
    • Develop structural models of adoption that incorporate technical unreliability, governance uncertainty, and human oversight costs.
    • Micro-econometric measurement of task-level productivity and labor reallocation in firms using GenAI, including methods for quality-adjusted output when outputs are probabilistic.
    • Contract theory applied to probabilistic AI outputs: optimal contracts, liability regimes, and insurance market design.
    • Models of innovation incentives under different IP and data-governance regimes to assess effects on competition and welfare.
    • General-equilibrium and distributional models capturing long-run effects on wages, inequality, and capital–labor shares under alternative policy scenarios.
    • Empirical work on certification, verification markets, and regulatory interventions (e.g., mandated testing, disclosure rules) to evaluate effects on adoption, safety, and welfare.
  • Policy implications
    • Proactive, adaptive governance (standards, accountability frameworks, liability regimes) can reduce adoption uncertainty and externalities, accelerating safe diffusion and improving social welfare.
    • Policies that support worker retraining, certification for human–AI supervisory roles, and incentives for robust validation infrastructure can improve complementarities and reduce transitional costs.
    • Antitrust, IP, and data-governance choices will shape the distribution of gains; economic analysis should inform policy balancing dynamic innovation incentives with competitive markets and equity.

Overall, the review suggests that realizing GenAI’s economic potential depends as much on institutional design, governance, and workforce strategies as on model improvements. For AI economists, this points to research combining firm- and task-level measurement, contract and mechanism design for probabilistic systems, and evaluation of regulatory regimes that align private incentives with social welfare.

Assessment

Paper Typereview_meta Evidence Strengthn/a — This is a systematic review of secondary studies and research agendas rather than primary causal research, so it does not provide original causal identification or direct causal estimates; it synthesizes heterogeneous, early-stage and mostly conceptual/observational literature. Methods Rigormedium — Authors report a systematic literature review of 28 secondary studies since 2023, combining bibliometric analysis with thematic synthesis and discussing threats to validity; however, the sample is small, limited to secondary/agenda papers (excluding primary empirical studies), covers a very short and rapidly evolving time window, and is prone to publication, selection, and disciplinary biases. Sample28 secondary studies and research agenda/roadmap papers on Generative AI (GenAI) in the Information Systems (IS) domain, published since 2023, including literature reviews, scoping/mapping studies, and position papers; analysis used bibliometric methods and thematic synthesis across these integrative contributions. Themesadoption governance human_ai_collab productivity innovation GeneralizabilityRestricted to secondary reviews and agenda-setting papers (excludes primary empirical studies and raw data), Limited timeframe (papers published since 2023) in a fast-moving field — findings may become outdated quickly, Focused on Information Systems scholarship; conclusions may not generalize to other disciplines or industry-specific contexts, Possible language and publication bias (likely dominated by English-language and prominent outlets), Heterogeneous sources (mix of conceptual, scoping, and mapping studies) limit comparability and external validity

Claims (10)

ClaimDirectionConfidenceOutcomeDetails
This study analyzes 28 papers (secondary studies and research agendas) published since 2023. Other null_result high number of secondary studies and research agendas analyzed
n=28
0.04
Generative AI (GenAI) offers transformative potential for productivity and innovation. Firm Productivity positive medium productivity and innovation potential attributed to GenAI
0.02
Adoption of GenAI is constrained by multiple interrelated challenges. Adoption Rate negative high level/extent of GenAI adoption (barriers to adoption)
0.04
Technical unreliability—manifesting as hallucinations and performance drift—is a major constraint on GenAI adoption. Adoption Rate negative high technical reliability of GenAI systems (frequency/severity of hallucinations and performance drift)
0.04
Societal and ethical risks—such as bias, misuse, and skill erosion—constrain GenAI adoption. Adoption Rate negative high societal-ethical risk level associated with GenAI (bias incidence, misuse potential, skill erosion)
0.04
There exists a systemic governance vacuum around GenAI, including gaps in privacy, accountability, and intellectual property protections. Governance And Regulation negative high adequacy of governance mechanisms for privacy, accountability, and intellectual property regarding GenAI
0.04
Interpreting the literature through a socio-technical lens reveals a persistent misalignment between GenAI's fast-evolving technical subsystem and the slower-adapting social subsystem. Governance And Regulation negative medium degree of alignment between technical capabilities of GenAI and social/organizational adaptation
0.02
Information Systems (IS) research is critical for achieving joint optimization of technical capabilities and social systems in the context of GenAI. Research Productivity positive speculative effectiveness of IS research interventions in achieving joint technical-social optimization (proposed/anticipated outcome)
0.0
To bridge the misalignment, the paper proposes reorienting IS scholarship from analyzing impacts toward actively shaping the co-evolution of technical capabilities with organizational procedures, societal values, and regulatory institutions. Other positive high focus/strategic orientation of IS research (shift from impact analysis to active co-evolution shaping)
0.04
The recommended IS research emphases include hybrid human–AI ensembles, situated validation, design principles for probabilistic systems, and adaptive governance. Other positive high priority research topics for IS scholarship addressing GenAI (hybrid ensembles, situated validation, probabilistic design principles, adaptive governance)
0.04

Notes