The Commonplace
Home Three-study pilot Papers Evidence Explore Trends Syntheses Digests References Docs 🎲 Workforce Futures
← Papers
Direction, evidence grade, and study type are AI-generated labels (gpt-5-mini), not human-verified. Syntheses are LLM-written. "Tensions" are machine-detected candidates, not confirmed contradictions. A research-acceleration tool, not peer review. How this is built →

A mixed-methods roadmap lifts bibliometric standards: combining expert elicitation from 53 senior editors with a systematic review of 195 studies yields practical, reproducible guidance to make literature mappings clearer and more useful — including for fast-moving fields such as AI economics.

Advancing bibliometric analysis: Evidence-based guidelines with insights from senior journal editors
Hyunsu Kim, Kevin Kam Fung So, Ceridwyn King, Hongyan Hu · September 09, 2026 · International Journal of Hospitality Management
openalex review_meta medium evidence 7/10 relevance Summary only summary available; pdf_status=paywall DOI Source PDF

Structured author observations

Linked only from stored provider relations; the raw author line above is never matched by name.

OpenAlex

Latest observation:

  1. Hyunsu Kim provider ID
  2. Kevin Kam Fung So provider ID
  3. Ceridwyn King provider ID
  4. Hongyan Hu provider ID
A sequential mixed-methods approach—combining thematic input from 53 senior editors with a systematic review of 195 bibliometric studies—produces an actionable roadmap that improves the clarity, rigor, and reproducibility of bibliometric reviews.

Citation observations

Cumulative provider counts captured on specific dates; providers are never combined.

Bibliometric analysis is a powerful means of evaluating research. This article employs a sequential mixed-methods approach to enrich the understanding of bibliometric analysis and presents a structured guide to maximize the technique’s benefits. A thematically synthesized narrative commentary on bibliometric review papers, based on input from 53 senior editorial members of leading hospitality and tourism journals, constitutes the study’s foundation. Cutting-edge literature comprising 195 bibliometric investigations is also considered. Our evidence-based guidance provides scholars with a roadmap for conducting state-of-the-art bibliometric analyses. These suggestions are intended to improve the method’s quality and accessibility, affirming its utility. Ultimately, this paper seeks to enhance bibliometric studies’ clarity, rigor, and efficacy by presenting forward-looking, real-world insights. Its step-by-step guide will facilitate decision-making and advance the field’s theoretical and managerial understanding.

Summary

Main Finding

The paper demonstrates that a sequential mixed-methods approach—combining thematic, expert-driven narrative synthesis with a systematic review of existing bibliometric studies—can produce evidence-based, practical guidance that raises the clarity, rigor, accessibility, and real-world usefulness of bibliometric analyses. It delivers a step-by-step roadmap to help scholars conduct state-of-the-art bibliometric reviews.

Key Points

  • Methodological contribution: Advocates a sequential mixed-methods design that pairs expert elicitation with a systematic appraisal of bibliometric literature.
  • Empirical basis: Findings are grounded in input from 53 senior editorial members of leading hospitality and tourism journals and a review of 195 bibliometric studies.
  • Output: A structured, actionable guide aimed at improving decisions about bibliometric choices (e.g., scope, techniques, visualization, interpretation).
  • Goals: Improve transparency, reproducibility, and theoretical and managerial relevance of bibliometric studies.
  • Intended audience: Scholars conducting bibliometric reviews and editors/decision-makers who rely on such syntheses.
  • Value-add: Synthesizes cutting-edge practice into accessible recommendations to standardize and elevate bibliometric work.

Data & Methods

  • Design: Sequential mixed-methods approach combining qualitative expert input and quantitative/literature synthesis.
  • Expert elicitation: Thematic, synthesized narrative commentary based on contributions from 53 senior editorial board members (leading journals in hospitality and tourism).
  • Literature review: Systematic consideration of 195 recent bibliometric investigations to identify prevailing practices, strengths, and weaknesses.
  • Integration: Cross-validation of themes from expert commentary against patterns observed in the bibliometric literature to produce evidence-based guidance.

Implications for AI Economics

  • Better mapping of the field: Applying the paper’s roadmap enables more rigorous, transparent bibliometric mappings of AI economics (e.g., tracking research clusters like algorithmic fairness, automation impacts, market microstructure with AI).
  • Method selection and reporting: AI economics bibliometricians should adopt explicit, documented decision rules (database choice, search strings, inclusion/exclusion, disambiguation, normalization) to enhance reproducibility and comparability across studies.
  • Expert validation: Complement algorithmic analyses (co-citation, co-word, bibliographic coupling) with domain expert review to ensure topical labels and interpretations are meaningful for fast-evolving AI economics topics.
  • Mitigating biases: Use the guide’s recommendations to recognize and mitigate common bibliometric biases relevant to AI economics—database coverage gaps, language and regional skews, and rapid publication cycles in AI-related outlets.
  • Policy and practice relevance: Higher-quality bibliometric syntheses can better inform policy makers and industry stakeholders about research trends, evidence gaps, and priority areas (e.g., labor displacement, regulation, productivity effects).
  • Reproducibility and data sharing: Encourage pre-registration (where appropriate), sharing of search strategies, datasets, code, and visualization outputs so AI economics bibliometric studies are verifiable and updateable as the literature evolves.
  • Tooling and triangulation: Combine multiple bibliometric techniques and (where possible) altmetric indicators to capture both scholarly structure and societal engagement of AI economics research.
  • Future research agenda: Use standardized, transparent bibliometric practices to build cumulative meta-knowledge in AI economics—facilitating comparative studies across subfields, temporal trend analyses, and mapping of interdisciplinary linkages (e.g., econ + ML + ethics).

Practical next steps for AI economics researchers: adopt the paper’s step-by-step checklist when designing bibliometric studies; document every methodological choice; validate thematic labels with domain experts; and publish supplementary materials (search strings, raw bibliographic files, code) to enable replication and longitudinal updates.

Assessment

Paper Typereview_meta Evidence Strengthmedium — The paper supports its methodological claims with two complementary empirical inputs — thematic expert elicitation from 53 senior editors and a systematic review of 195 bibliometric studies — which provide reasonable internal validation for recommendations but do not establish causal claims or external validation of the roadmap's effectiveness across fields. Methods Rigormedium — Design combines a systematic literature synthesis with structured expert input, which is appropriate for methodological guidance; however, potential biases exist (selection of experts, field restriction to hospitality/tourism, unclear pre-registration or coding protocols, and no independent empirical test of the proposed roadmap), limiting rigor. SampleTwo data sources: (1) qualitative thematic input from 53 senior editorial board members of leading hospitality and tourism journals; (2) a systematic review/analysis of 195 recent bibliometric studies (details on time window, databases, and inclusion criteria not provided in the summary). Themesinnovation governance GeneralizabilityStudy and expert sample limited to hospitality and tourism journals — practices and norms may differ in AI economics and other disciplines, Expert sample skews to senior editors, introducing potential selection and confirmation biases and under-representing junior scholars or practitioners, Bibliometric studies sampled may reflect field-specific publication, database, and language patterns that do not generalize to fast-moving AI/ML literature, Recommendations are not validated empirically (e.g., by showing improved reproducibility or interpretation in independent AI economics bibliometric studies)

Claims (7)

ClaimDirectionOutcomeConfidence & EvidenceDetails
A sequential mixed-methods approach combining thematic expert-driven narrative synthesis with a systematic review of bibliometric studies can generate evidence-based and practical guidance for conducting bibliometric analyses. Research Productivity positive Clarity, rigor, accessibility, and practical usefulness of bibliometric analyses
Reading fidelity high
Study strength medium
n=248
0.24
The study draws on input from 53 senior editorial members of leading hospitality and tourism journals. Research Productivity positive Expert assessment of bibliometric research practices
Reading fidelity high
Study strength medium
n=53
0.24
The study systematically reviews 195 recent bibliometric investigations to identify prevailing practices, strengths, and weaknesses. Research Productivity mixed Prevailing methodological practices, strengths, and weaknesses in bibliometric studies
Reading fidelity high
Study strength medium
n=195
0.24
Cross-validating themes from expert commentary against patterns in the bibliometric literature produces evidence-based guidance for bibliometric research. Research Productivity positive Validity and practical usefulness of methodological guidance
Reading fidelity high
Study strength medium
n=248
0.24
The paper provides a structured, actionable, step-by-step roadmap for making bibliometric decisions about scope, techniques, visualization, and interpretation. Organizational Efficiency positive Accessibility and consistency of methodological decision-making in bibliometric reviews
Reading fidelity high
Study strength medium
n=248
0.24
The paper aims to improve transparency, reproducibility, and theoretical and managerial relevance in bibliometric studies. Research Productivity positive Transparency, reproducibility, theoretical relevance, and managerial relevance of bibliometric studies
Reading fidelity high
Study strength low
n=248
0.12
The roadmap recommends documenting methodological choices, validating thematic labels with domain experts, and sharing search strategies, bibliographic data, code, and visualization outputs to support replication and longitudinal updating. Research Productivity positive Reproducibility and updateability of bibliometric studies
Reading fidelity high
Study strength low
not reported
0.12

Notes