[Purpose/Significance] This paper puts forward the disruption success index (DSI) of journals to evaluate journal quality from the perspective of innovation, and promote the environment construction of academic innovation in basic research. [Method/Process] Based on the citation success index (CSI) of journals, the DSI of journals was constructed to measure the innovation quality of journals. Through empirical research, the paper analyzed the performance of DSI in application, and preliminarily discusse the advantages and limitations of the index. [Result/Conclusion] The index can be used to evaluate journal innovation quality. It can effectively identify high-quality journals, has strong robustness, and is not easily affected by extreme values. It can solve problems such as differences in the number of document types and differences in disciplines, and its evaluation results are not affected by the size of journals. However, in the application of DSI, there are certain requirements for the low citation ratio and citation time window of journals.
Liu Xiaohui
,
Liao Yu
. Design and Empirical Study of Journal Disruption Success Index for Quality Innovation[J]. Library and Information Service, 2024
, 68(12)
: 109
-118
.
DOI: 10.13266/j.issn.0252-3116.2024.12.009
[1] 俞立平,黄梦亭.基于评价结果共性的学术期刊组合评价方法——以JCR2020数学期刊评价为例[J].统计学报, 2023, 4(2):83-93.(YU L P, HUANG M T. Combinatorial evaluation method of academic journals based on evaluation result commonality[J]. Journal of statistics, 2023, 4(2):83-93.)
[2] 俞立平,沈洁.数量与质量影响力下的学术期刊评价新指标——C刊影响因子和非C刊影响因子[J].统计与决策, 2022, 38(20):26-30.(YU L P, SHEN J. New index of academic journal evaluation under the influence of quantity and quality:impact factors of CSSCI journals and non-CSSCI journals[J]. Statistics&decision, 2022, 38(20):26-30.)
[3] ZHAO R, WANG X. Evaluation and comparison of influence in international open access journals between China and USA[J]. Scientometrics, 2019, 120(3):1091-1110.
[4] FRANCESCHET M. The difference between popularity and prestigeinthe sciences and in the social sciences:a bibliometric analysis[J]. Journal of informetrics, 2010, 4(1):55-63.
[5] SOMBATSOMPOP N, KOSITCHAIYONG A, MARKPIN T, et al. Scientific evaluations of citation quality of international research articles in the SCI database:Thailand case study[J]. Scientometrics, 2006, 66(3):521-535.
[6] WANG X. Research on the discourse power evaluation of academic journals from the perspective of multiple fusion:taking medicine, general and internal journals as an example[J/OL]. Journal of information science, 2022.[2024-05-24]. https://journals.sagepub.com/home/jis. doi:10.1177/01655515221107334.-2023.09.10.
[7] 姜育彦,刘雪立.科技期刊的创新性评价指标——期刊颠覆性指数(JDI)及其实证研究[J].中国科技期刊研究, 2022, 33(7):965-972.(JIANG Y Y, LIU X L. An innovative evaluation index of scientific journals:Journal Disruption Index (JDI) and its empirical research[J]. Chinese journal of scientific and technical periodicals, 2022, 33(7):965-972.)
[8] JIANG Y, LIU X. A construction and empirical research of the journal disruption index based on open citation data[J]. Scientometrics, 2023(128):3935-3958.
[9] 胡绍君,秦新国.社会科学期刊质量评价维度探析[J].中国科技期刊研究, 2022, 33(12):1701-1710.(HU S J, QIN X G. Quality evaluation dimensions for social science journals[J]. Chinese journal of scientific and technical periodicals, 2022, 33(12):1701-1710.)
[10] 苏新宁.人文社会科学期刊评价指标体系研究[J].图书馆论坛, 2006(6):59-65.(SU X N. Application of knowledge management tactics to library[J]. Library tribune, 2006(6):59-65.)
[11] FUNK R, OWEN-SMITH J. A dynamic network measure of technological change[J]. Management science, 2017, 63(3):791-817.
[12] WU L, WANG D, EVANS J. Large teams develop and small teams disrupt science and technology[J]. Nature, 2019, 566(7744):378.
[13] WU S, WU Q. A confusing definition of disruption[EB/OL].[2024-05-24]. https://osf.io/preprints/socarxiv/d3wpk/. 2023.09.10.
[14] 刘小慧,沈哲思,廖宇,等.科研论文颠覆性指数的改进及其影响因素研究[J].图书情报工作, 2020, 64(24):84-91.(LIU X H, SHEN Z S, LIAO Y, et al. The research about the improved disruption index and its influencing factors[J]. Library and imformation service, 2020, 64(24):84-91.)
[15] 刘小慧,廖宇,朱曼曼.颠覆性指数用于科研评价初探[J].情报理论与实践, 2021, 44(12):34-40.(LIU X H, LIAO Y, ZHU M M. A Preliminary study on the application of disruption index to scientific research evaluation[J]. Information studies:theory&application, 2021, 44(12):34-40.)
[16] MILOJEVIC S, RADICCHI F, BAR-ILAN J. Citation success index:an intuitive pair-wise journal comparison metric[J]. Journal of informetrics, 2017, 11(1):223-231.
[17] 刘小慧,沈哲思,廖宇,等.颠覆性指数的稳定时间窗研究[J].图书情报工作, 2021, 65(18):49-57.(LIU X H, SHEN Z S, LIAO Y, et al. Research on the stable time window of disruption Index[J]. Library and imformation service, 2021, 65(18):49-57.)
[18] 罗式胜.期刊被引半衰期的概念及其应用[J].情报科学, 1994(1):23-25.(LUO S S. The concept of citation halflife of a journal and its application[J]. Information science, 1994(1):23-25.)
