[ 目的 / 意义 ] 提出期刊颠覆性超越指数,从创新角度进行期刊质量评估,促进基础研究学术创新的环境建设。 [ 方法 / 过程 ] 借鉴期刊引文超越指数的设计思想,在学术论文颠覆性指数的基础上,构建期刊颠覆性超越指数,度量期刊的创新质量;通过实证研究,分析期刊颠覆性超越指数在应用中的性能表现,并针对该指数的优点与局限性进行初步探讨。 [ 结果 / 结论 ] 该指标可以用于期刊创新质量评估;能有效识别高质量期刊,鲁棒性较强,不易受极值影响;同时,能解决文献类型差异和学科差异等问题,且评估结果不受期刊载文规模的影响。但该指标在应用时,对期刊的低被引载文比例和引文时间窗有一定的要求。
[Purpose/Significance] This paper puts forward the disruption success index (DSI) of journals to evaluate journal quality from the perspective of innovation, and promote the environment construction of academic innovation in basic research. [Method/Process] Based on the citation success index (CSI) of journals, the DSI of journals was constructed to measure the innovation quality of journals. Through empirical research, the paper analyzed the performance of DSI in application, and preliminarily discusse the advantages and limitations of the index. [Result/Conclusion] The index can be used to evaluate journal innovation quality. It can effectively identify high-quality journals, has strong robustness, and is not easily affected by extreme values. It can solve problems such as differences in the number of document types and differences in disciplines, and its evaluation results are not affected by the size of journals. However, in the application of DSI, there are certain requirements for the low citation ratio and citation time window of journals.
[1] 俞立平,黄梦亭.基于评价结果共性的学术期刊组合评价方法——以JCR2020数学期刊评价为例[J].统计学报, 2023, 4(2):83-93.(YU L P, HUANG M T. Combinatorial evaluation method of academic journals based on evaluation result commonality[J]. Journal of statistics, 2023, 4(2):83-93.)
[2] 俞立平,沈洁.数量与质量影响力下的学术期刊评价新指标——C刊影响因子和非C刊影响因子[J].统计与决策, 2022, 38(20):26-30.(YU L P, SHEN J. New index of academic journal evaluation under the influence of quantity and quality:impact factors of CSSCI journals and non-CSSCI journals[J]. Statistics&decision, 2022, 38(20):26-30.)
[3] ZHAO R, WANG X. Evaluation and comparison of influence in international open access journals between China and USA[J]. Scientometrics, 2019, 120(3):1091-1110.
[4] FRANCESCHET M. The difference between popularity and prestigeinthe sciences and in the social sciences:a bibliometric analysis[J]. Journal of informetrics, 2010, 4(1):55-63.
[5] SOMBATSOMPOP N, KOSITCHAIYONG A, MARKPIN T, et al. Scientific evaluations of citation quality of international research articles in the SCI database:Thailand case study[J]. Scientometrics, 2006, 66(3):521-535.
[6] WANG X. Research on the discourse power evaluation of academic journals from the perspective of multiple fusion:taking medicine, general and internal journals as an example[J/OL]. Journal of information science, 2022.[2024-05-24]. https://journals.sagepub.com/home/jis. doi:10.1177/01655515221107334.-2023.09.10.
[7] 姜育彦,刘雪立.科技期刊的创新性评价指标——期刊颠覆性指数(JDI)及其实证研究[J].中国科技期刊研究, 2022, 33(7):965-972.(JIANG Y Y, LIU X L. An innovative evaluation index of scientific journals:Journal Disruption Index (JDI) and its empirical research[J]. Chinese journal of scientific and technical periodicals, 2022, 33(7):965-972.)
[8] JIANG Y, LIU X. A construction and empirical research of the journal disruption index based on open citation data[J]. Scientometrics, 2023(128):3935-3958.
[9] 胡绍君,秦新国.社会科学期刊质量评价维度探析[J].中国科技期刊研究, 2022, 33(12):1701-1710.(HU S J, QIN X G. Quality evaluation dimensions for social science journals[J]. Chinese journal of scientific and technical periodicals, 2022, 33(12):1701-1710.)
[10] 苏新宁.人文社会科学期刊评价指标体系研究[J].图书馆论坛, 2006(6):59-65.(SU X N. Application of knowledge management tactics to library[J]. Library tribune, 2006(6):59-65.)
[11] FUNK R, OWEN-SMITH J. A dynamic network measure of technological change[J]. Management science, 2017, 63(3):791-817.
[12] WU L, WANG D, EVANS J. Large teams develop and small teams disrupt science and technology[J]. Nature, 2019, 566(7744):378.
[13] WU S, WU Q. A confusing definition of disruption[EB/OL].[2024-05-24]. https://osf.io/preprints/socarxiv/d3wpk/. 2023.09.10.
[14] 刘小慧,沈哲思,廖宇,等.科研论文颠覆性指数的改进及其影响因素研究[J].图书情报工作, 2020, 64(24):84-91.(LIU X H, SHEN Z S, LIAO Y, et al. The research about the improved disruption index and its influencing factors[J]. Library and imformation service, 2020, 64(24):84-91.)
[15] 刘小慧,廖宇,朱曼曼.颠覆性指数用于科研评价初探[J].情报理论与实践, 2021, 44(12):34-40.(LIU X H, LIAO Y, ZHU M M. A Preliminary study on the application of disruption index to scientific research evaluation[J]. Information studies:theory&application, 2021, 44(12):34-40.)
[16] MILOJEVIC S, RADICCHI F, BAR-ILAN J. Citation success index:an intuitive pair-wise journal comparison metric[J]. Journal of informetrics, 2017, 11(1):223-231.
[17] 刘小慧,沈哲思,廖宇,等.颠覆性指数的稳定时间窗研究[J].图书情报工作, 2021, 65(18):49-57.(LIU X H, SHEN Z S, LIAO Y, et al. Research on the stable time window of disruption Index[J]. Library and imformation service, 2021, 65(18):49-57.)
[18] 罗式胜.期刊被引半衰期的概念及其应用[J].情报科学, 1994(1):23-25.(LUO S S. The concept of citation halflife of a journal and its application[J]. Information science, 1994(1):23-25.)