[Purpose/significance] Based on the three fundamental frameworks of responsible metrics:San Francisco Declaration on Research Assessment, Leiden Manifesto for Research Assessment and the Metric Tide, the paper interprets the development trend of research evaluation from the perspective of responsible metrics.[Method/process] The articles and core authors from 2012 to 2020 in Web of Science were used and visualized with VOSviewer, to reflect the changes of diachronic research hotspots in this field.[Result/conclusion] The timeline and overlay views for keywords and authors illustrate that the revolution in research metrics is in progress, and present the development trend with research quality as the center of the circle, researchers as foundation, field-normalization as goal orientation, research impact as radius, citation exploration as root, and altmetrics as reference. The conclusion points out that research evaluation ruled by responsible metrics is the only way to establish a healthy academic ecosystem, however, it is clear that the revolution for deep-rooted academic ecosystem and incentive mechanism is needed.
Song Liping
,
Wang Xiuhan
,
Yuan Shanshan
. Responsible Metrics and the Trend of Research Evaluation[J]. Library and Information Service, 2021
, 65(9)
: 16
-22
.
DOI: 10.13266/j.issn.0252-3116.2021.09.002
[1] WILSDON J,ALLEN L,BELFIORE E,et al.The metric tide:report of the independent review of the role of metrics in research assessment and management[M]. London:SAGE Publications Ltd, 2015.
[2] WILSDON J. Has the tide turned towards responsible metrics in research?[N]. The guardian,2018-07-10(1).
[3] San Francisco declaration on research assessment[EB/OL].[2020-09-23]. http://www.ascb.org/dora/.
[4] HICKS D,WOUTERS P,WALTMAN L,et al.Bibliometrics:the Leiden manifesto for research metrics[J].Nature,2015, 520(7548):429-431.
[5] CASSIDY R S. Theories of informetrics and scholarly communication[M].Berlin:De Gruyter,2016.
[6] WILSDON J. UK progress towards the use of metrics responsibly:three years on from The Metric Tide report.[EB/OL].[2021-03-23].https://dera.ioe.ac.uk/31945/1/UK%20progress%20towards%20the%20use%20of%20metrics%20responsibly%2010072018.pdf.
[7] 李杰.科学知识图谱原理及应用——VOSviewer和CitNetExplorer初学者指南[M]. 北京:高等教育出版社,2018.
[8] GUÉDON J C,KRAMER B,LAAKSO M,et al.Future of scholarly publishing and scholarly communicate on:report of the expert group to the European commission[EB/OL].[2020-09-06].https://op.e-ur-opa.e-u/en/publication-detail/-/publication/464477b3-2559-11e9-8d04-01aa75ed71a1.
[9] STEPHAN P,VEUGELERS R,WANG J. Reviewers are blinkered by bibliometrics[J]. Nature,2017,544(7651):411-412.
[10] LANE J. Let's make science metrics more scientific[J]. Nature,2010,464(7288):488-489.
[11] CURRY S. Let's move beyond the rhetoric:it's time to change how we judge research[J]. Nature,2018,554(7691):147.
[12] HILL S. Four trends shaping the future of research evaluation[EB/OL].[2020-09-06]. https://figshare.c-om/articles/Four_trends_shaping_the_future_of_research_evaluation/11918130/1.
[13] WOUTERS P, SUGIMOTO C R, LARIVIōRE V, et al.Rethinking impact factors:better ways to judge a journal[J]. Nature,2019, 569(7758):621-623.
[14] WALTMAN L. A review of the literature on citation impact indicators[J]. Journal of informetrics,2016,10(2):365-391.
[15] VAN NOORDEN R. Interdisciplinary research by the numbers[J]. Nature,2015,525(7569):306-307.
[16] STERN N. Lord Stern's review of the research excellence framework:call for evidence[EB/OL].[2020-09-08].https://core.ac.uk/download/pdf/74380480.pdf.
[17] Research excellence framework 2021[EB/OL].[2020-09-08]. https://www.ref.ac.uk/.
[18] PARKS S.The changing research landscape and reflections on national research assessment in the future[EB/OL].[2020-09-08]. https://re.ukri.org/documents/2019/rand-europe-full-report/.
[19] BORNMANN L.Scientific revolution in scientometrics:The broadening of impact from citation to societal[M]//CASSIDY R S. Theories of informetrics and scholarly communication[M].Berlin:De Gruyter.2016:347-359.
[20] BORNMANN L, HAUNSCHILD R.Do altmetrics assess societal impact in a comparable way to case studies? an empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)[J]. Journal of informetrics,2019,13(1):325-340.
[21] MACROBERTS M H, MACROBERTS B R. The mismeasure of science:Citation analysis[J]. Journal of the Association for Information Science & Technology,2017,69(3):474-482.
[22] BORNMANN L, HAUNSCHILD R. To what extent does the Leiden manifesto also apply to altmetrics?[J]. A discussion of the manifesto against the background of research into altmetrics,2016,40(4):529-543.
[23] DAVID J. What are responsible metrics[EB/OL].[2020-09-06]. http://www.open.ac.uk/blogs/the_orb/?p=3242.
[24] THELWALL M. Measuring societal impacts of research with altmetrics? common problems and mistakes[EB/OL].[2020-09-08].https://onlinelibrary.wiley.com/doi/pdfdirect/10.1111/joes.12381.
[25] MOED H F. Applied evaluative informetrics[M]. Berlin:Springer International Publishing, 2017.
[26] LARIVIERE V, SUGIMOTO C R. The journal impact factor:a brief history,critique, and discussion of adverse effects[C]//GLÄNZEL W, MOED H F. Springer handbook of science and technology indicators. Berlin:Springer, 2019:3-24.
[27] BORNMANN L,HUG S,MAREWSKI J N. Bibliometrics-based heuristics:what is their definition and how can they be studied?[EB/OL].[2020-09-08]. https://arxiv.org/abs/1810.13005v1.
