Methodological shortcomings of bibliometric papers published in the journal Sustainability (2019-2020)

Abstract

Using Sustainability (the journal outside the IS area that publishes the most bibliometric articles) as a case study, this study uses content analysis to determine various parameters relating to the methodological rigour and reproducibility of the papers published in this journal in 2019 and 2020. In particular, analysis has been performed of the samples and time periods used in the analyses, and whether the authors adequately report the search strategy and the data sources used.

Results show that 181 of the 204 studies analysed (88.7%) have one or more methodological limitations which hinder or prevent their reproducibility. This shows that there is considerable room for improvement in the methodological quality of the bibliometric papers published in Sustainability.