SPECIAL TOPIC: Identification of Breakthrough/Disruptive Technology

Research on Improvement of Disruptive Index Based on Full-text Features of Citations

  • Huang Heng ,
  • Wang Xuefeng ,
  • Zhu Donghua ,
  • Lei Ming
Expand
  • School of Management, Beijing Institute of Technology, Beijing 100081

Received date: 2023-10-25

  Revised date: 2024-02-24

  Online published: 2024-07-30

Supported by

This work is supported by the general program of National Natural Science Foundation of China titled “Methods for Identifying Potentially Disruptive Technologies in the Biomedical Field” (Grant No. 72074020).

Abstract

[Purpose/Significance] To address the issue of disruptive index of papers being influenced by the number and importance of references, the improvement of disruptive index algorithm can distinguish breakthrough papers from other highly cited papers and reflect the breakthrough of papers more effectively. [Method/Process] The citation contents corresponding to the references in the focus paper, and their citation purpose and polarity are used to choose important references. The disruptive index algorithm is improved by revising the numerator and denominator in the formula based on important references related to the study of the focal paper. [Result/Conclusion] It finds that the improved disruptive index can more significantly distinguish breakthrough papers from other highly cited papers. More breakthrough papers can be accurately identified by the improved disruptive index from the group of highly cited papers.

Cite this article

Huang Heng , Wang Xuefeng , Zhu Donghua , Lei Ming . Research on Improvement of Disruptive Index Based on Full-text Features of Citations[J]. Library and Information Service, 2024 , 68(15) : 15 -26 . DOI: 10.13266/j.issn.0252-3116.2024.15.002

References

[1] 徐芳, 李晓轩.跨越科技评价的“马拉河”[J]. 中国科学院院刊, 2017, 32(8): 879-886. (XU F, LI X X. Crossing the Mara River of research evaluation[J]. Bulletin of Chinese Academy of Sciences, 2017, 32(8): 879-886.)
[2] 汪雪锋, 张硕, 刘玉琴, 等. 中国科技评价研究40年:历史演进及主题演化[J]. 科学学与科学技术管理, 2018, 39(12): 67-80. (WANG X F, ZHANG S, LIU Y Q, et al. Forty years of research on science and technology evaluation in China: historical and theme evolution[J]. Science of science and management of S.&T., 2018, 39(12): 67-80.)
[3] BOUDREAU K J. The novelty paradox & bias for normal science: evidence from randomized medical grant proposal evaluations[J]. Harvard business school working paper, 2012: 13-53.
[4] CHAI S, MENON A. Breakthrough recognition: bias against novelty and competition for attention[J]. Research policy, 2019, 48(3): 733-747.
[5] MISHRA S, TORVIK V. Quantifying conceptual novelty in the biomedical literature[J]. D-Lib magazine: the magazine of the Digital Library Forum, 2016, 22(9/10): 1-21.
[6] UZZI B, MUKHERJEE S, STRINGER M, et al. A typical combinations and scientific impact[J]. Science, 2013, 342(6157): 468-472.
[7] WANG J, VEUGELERS R, STEPHAN P. Bias against novelty in science: a cautionary tale for users of bibliometric indicators[J]. Research policy, 2017, 46(8): 1416-1436.
[8] SAVOV P, JATOWT A, NIELEK R. Identifying breakthrough scientific papers[J]. Information processing & management, 2020, 57(2): 1-17.
[9] XU H, LUO R, WINNINK J, et al. A methodology for identifying breakthrough topics using structural entropy[J]. Information processing & management, 2022, 59(2): 1-20.
[10] CHEN C. Predictive effects of structural variation on citation counts[J]. Journal of the American Society for Information Science and Technology, 2012, 63(3): 431-449.
[11] MIN C, BU Y, WU D, et al. Identifying citation patterns of scientific breakthroughs: a perspective of dynamic citation process[J]. Information processing & management, 2021, 58(1): 1-21.
[12] MIN C, BU Y, SUN J. Predicting scientific breakthroughs based on knowledge structure variations[J]. Technological forecasting and social change, 2021, 164: 1-10.
[13] HUANG Y, HSU C, LERMAN K. Identifying transformative scientific research[C]//IEEE. 2013 IEEE 13th international conference on data mining. Dallas: IEEE, 2013: 291-300.
[14] FUNK R J, OWEN-SMITH J. A dynamic network measure of technological change[J]. Management science, 2017, 63(3): 791-817.
[15] WU L, WANG D, EVANS J. Large teams develop and small teams disrupt science and technology[J]. Nature, 2019, 566(7744): 378-382.
[16] 刘小慧, 沈哲思, 廖宇, 等. 科研论文颠覆性指数的改进及其影响因素研究[J]. 图书情报工作, 2020, 64(24): 84-91. (LIU X H, SHENG Z S, LIAO Y, et al. The research about the improved disruption index and its influencing factors[J]. Library and information service, 2020, 64(24): 84-91.)
[17] 刘小慧, 廖宇, 朱曼曼.颠覆性指数用于科研评价初探[J]. 情报理论与实践, 2021, 44(12): 34-40. (LIU X H, LIAO Y, ZHU M M. A preliminary study on the application of disruption index to scientific research evaluation[J]. Information studies: theory & application, 2021, 44(12): 34-40.)
[18] 刘小慧, 沈哲思, 廖宇, 等.颠覆性指数的稳定时间窗研究[J]. 图书情报工作, 2021, 65(18): 49-57. (LIU X H, SHEN Z S, LIAO Y, et al. Research on the stable time window of disruption index[J]. Library and information service, 2021, 65(18): 49-57.)
[19] RUAN X, LYU D, GONG K, et al. Rethinking the disruption index as a measure of scientific and technological advances[J]. Technological forecasting and social change, 2021, 172: 1-10.
[20] BORNMANN L, TEKLES A. Disruptive papers published in Scientometrics[J]. Scientometrics, 2019, 120(1): 331-336.
[21] BORNMANN L, TEKLES A. Disruption index depends on length of citation window[J]. Profesional de la información, 2019, 28(2): 1-2.
[22] 宋培彦, 冯超慧, 龙晨翔, 等. 基于颠覆性指数优化的细分领域优秀科技人才发现研究[J]. 情报杂志, 2022, 41(5): 61-65. (SONG P Y, FENG C H, LONG C X, et al. Study on discovery of outstanding scientific and technological talents in specific domains based on optimized disruptive index[J]. Journal of intelligence, 2022, 41(5): 61-65.)
[23] 姜育彦, 刘雪立. 科技期刊的创新性评价指标——期刊颠覆性指数(JDI)及其实证研究[J]. 中国科技期刊研究, 2022, 33(7): 965-972. (JIANG Y Y, LIU X L. An innovative evaluation index of scientific journals:journal disruption index (JDI) and its empirical research[J]. Chinese journal of scientific and technical periodicals, 2022, 33(7): 965-972.)
[24] BORNMANN L, DEVARAKONDA S, TEKLES A, et al. Are disruption index indicators convergently valid? the comparison of several indicator variants with assessments by peers[J]. Quantitative science studies, 2020, 1(4): 1-31.
[25] LEYDESDORFF L, BORNMANN L. Disruption indices and their calculation using web-of-science data: indicators of historical developments or evolutionary dynamics?[J]. Journal of informetrics, 2021, 15(4): 1-11.
[26] 姜育彦, 刘雪立. 绝对颠覆性指数与同行评议指标及CNCI的关系:基于病毒学论文的研究[J]. 图书情报工作, 2023, 67(3): 96-105. (JIANG Y Y, LIU X L. The relationship between peer review index, CNCI and absolute disruption index: a study based on virology papers[J]. Library and information service, 2023, 67(3): 96-105.)
[27] WU Q, YAN Z. Solo citations, duet citations, and prelude citations: new measures of the disruption of academic papers[J]. arXiv preprint arXiv:1905.03461, 2019: 1-9.
[28] HUANG H, ZHU D and WANG X. Evaluating scientific impact of publications: combining citation polarity and purpose[J]. Scientometrics, 2021, 127(9): 5257-5281.
[29] LI J, YIN Y, FORTUNATO S, et al. A dataset of publication records for Nobel laureates[J]. Scientific data, 2019, 6(1): 1-10.
[30] 梁国强. 变革性研究的引文特征分析与早期识别模型构建[D]. 大连: 大连理工大学, 2021. (LIANG G Q. Citation patterns analysis and the early identification model construction of transformative research[D]. Dalian: Dalian University of Technology, 2021.)
[31] 方开泰, 彭小令. 现代基础统计学[M]. 北京: 高等教育出版社, 2014. (FANG K T, PENG X L. Modern basic statistics[M]. Beijing: Higher Education Press, 2014.)
[32] 王琳, 岳卫平. 基于引文分析的诺贝尔奖级科学家遴选——科睿唯安“引文桂冠奖”详解[J]. 世界科技研究与发展, 2020, 41(5): 447-454. (WANG L, YUE W P. Selection of Nobel prize level scientists based on citation analysis: an overview of Clarivate analytics citation laureates[J]. World sci-tech R&D, 2020, 41(5): 447-454.)
[33] 任晓亚, 张志强. 主要科技领域国际权威奖项规律及其驱动因素分析[J]. 情报学报, 2019, 38(9): 881-893. (REN X Y, ZHANG Z Q. Analysis of the laws of international authoritative awards in main science and technology fields and their driving factors[J]. Journal of the China Society for Scientific and Technical Information, 2019, 38(9): 881-893.)
Outlines

/