专题:突破性/颠覆性技术识别

基于引文全文本特征的论文颠覆性指数改进研究

  • 黄恒 ,
  • 汪雪锋 ,
  • 朱东华 ,
  • 雷鸣
展开
  • 北京理工大学管理学院 北京 100081
黄恒,博士研究生;汪雪锋,教授,博士,博士生导师,通信作者,E-mail:wxf5122@bit.edu.cn;朱东华,教授,博士;雷鸣,博士研究生。

收稿日期: 2023-10-25

  修回日期: 2024-02-24

  网络出版日期: 2024-07-30

基金资助

文系国家自然科学基金面上项目“生物医学领域潜在颠覆性技术识别方法”(项目编号:72074020)研究成果之一。

Research on Improvement of Disruptive Index Based on Full-text Features of Citations

  • Huang Heng ,
  • Wang Xuefeng ,
  • Zhu Donghua ,
  • Lei Ming
Expand
  • School of Management, Beijing Institute of Technology, Beijing 100081

Received date: 2023-10-25

  Revised date: 2024-02-24

  Online published: 2024-07-30

Supported by

This work is supported by the general program of National Natural Science Foundation of China titled “Methods for Identifying Potentially Disruptive Technologies in the Biomedical Field” (Grant No. 72074020).

摘要

[目的/意义] 针对论文颠覆性指数受参考文献数量及其重要程度差异的影响问题,改进颠覆性指数算法,以便更有效地区分突破性论文和其他高被引论文,科学合理地反映论文的突破性。[方法/过程] 结合参考文献在焦点论文全文中对应的引文内容的全文本特征——引文目的和引文极性,筛选出在研究内容上与焦点论文相关的重要参考文献,围绕重要参考文献,修改颠覆性指数计算公式分子和分母,进而改进论文颠覆性指数。[结果/结论] 研究发现,改进后的颠覆性指数使突破性论文更显著地区分于其他高被引论文;利用改进后的颠覆性指数,可从批量的高被引论文中准确识别更多的突破性论文。

本文引用格式

黄恒 , 汪雪锋 , 朱东华 , 雷鸣 . 基于引文全文本特征的论文颠覆性指数改进研究[J]. 图书情报工作, 2024 , 68(15) : 15 -26 . DOI: 10.13266/j.issn.0252-3116.2024.15.002

Abstract

[Purpose/Significance] To address the issue of disruptive index of papers being influenced by the number and importance of references, the improvement of disruptive index algorithm can distinguish breakthrough papers from other highly cited papers and reflect the breakthrough of papers more effectively. [Method/Process] The citation contents corresponding to the references in the focus paper, and their citation purpose and polarity are used to choose important references. The disruptive index algorithm is improved by revising the numerator and denominator in the formula based on important references related to the study of the focal paper. [Result/Conclusion] It finds that the improved disruptive index can more significantly distinguish breakthrough papers from other highly cited papers. More breakthrough papers can be accurately identified by the improved disruptive index from the group of highly cited papers.

参考文献

[1] 徐芳, 李晓轩.跨越科技评价的“马拉河”[J]. 中国科学院院刊, 2017, 32(8): 879-886. (XU F, LI X X. Crossing the Mara River of research evaluation[J]. Bulletin of Chinese Academy of Sciences, 2017, 32(8): 879-886.)
[2] 汪雪锋, 张硕, 刘玉琴, 等. 中国科技评价研究40年:历史演进及主题演化[J]. 科学学与科学技术管理, 2018, 39(12): 67-80. (WANG X F, ZHANG S, LIU Y Q, et al. Forty years of research on science and technology evaluation in China: historical and theme evolution[J]. Science of science and management of S.&T., 2018, 39(12): 67-80.)
[3] BOUDREAU K J. The novelty paradox & bias for normal science: evidence from randomized medical grant proposal evaluations[J]. Harvard business school working paper, 2012: 13-53.
[4] CHAI S, MENON A. Breakthrough recognition: bias against novelty and competition for attention[J]. Research policy, 2019, 48(3): 733-747.
[5] MISHRA S, TORVIK V. Quantifying conceptual novelty in the biomedical literature[J]. D-Lib magazine: the magazine of the Digital Library Forum, 2016, 22(9/10): 1-21.
[6] UZZI B, MUKHERJEE S, STRINGER M, et al. A typical combinations and scientific impact[J]. Science, 2013, 342(6157): 468-472.
[7] WANG J, VEUGELERS R, STEPHAN P. Bias against novelty in science: a cautionary tale for users of bibliometric indicators[J]. Research policy, 2017, 46(8): 1416-1436.
[8] SAVOV P, JATOWT A, NIELEK R. Identifying breakthrough scientific papers[J]. Information processing & management, 2020, 57(2): 1-17.
[9] XU H, LUO R, WINNINK J, et al. A methodology for identifying breakthrough topics using structural entropy[J]. Information processing & management, 2022, 59(2): 1-20.
[10] CHEN C. Predictive effects of structural variation on citation counts[J]. Journal of the American Society for Information Science and Technology, 2012, 63(3): 431-449.
[11] MIN C, BU Y, WU D, et al. Identifying citation patterns of scientific breakthroughs: a perspective of dynamic citation process[J]. Information processing & management, 2021, 58(1): 1-21.
[12] MIN C, BU Y, SUN J. Predicting scientific breakthroughs based on knowledge structure variations[J]. Technological forecasting and social change, 2021, 164: 1-10.
[13] HUANG Y, HSU C, LERMAN K. Identifying transformative scientific research[C]//IEEE. 2013 IEEE 13th international conference on data mining. Dallas: IEEE, 2013: 291-300.
[14] FUNK R J, OWEN-SMITH J. A dynamic network measure of technological change[J]. Management science, 2017, 63(3): 791-817.
[15] WU L, WANG D, EVANS J. Large teams develop and small teams disrupt science and technology[J]. Nature, 2019, 566(7744): 378-382.
[16] 刘小慧, 沈哲思, 廖宇, 等. 科研论文颠覆性指数的改进及其影响因素研究[J]. 图书情报工作, 2020, 64(24): 84-91. (LIU X H, SHENG Z S, LIAO Y, et al. The research about the improved disruption index and its influencing factors[J]. Library and information service, 2020, 64(24): 84-91.)
[17] 刘小慧, 廖宇, 朱曼曼.颠覆性指数用于科研评价初探[J]. 情报理论与实践, 2021, 44(12): 34-40. (LIU X H, LIAO Y, ZHU M M. A preliminary study on the application of disruption index to scientific research evaluation[J]. Information studies: theory & application, 2021, 44(12): 34-40.)
[18] 刘小慧, 沈哲思, 廖宇, 等.颠覆性指数的稳定时间窗研究[J]. 图书情报工作, 2021, 65(18): 49-57. (LIU X H, SHEN Z S, LIAO Y, et al. Research on the stable time window of disruption index[J]. Library and information service, 2021, 65(18): 49-57.)
[19] RUAN X, LYU D, GONG K, et al. Rethinking the disruption index as a measure of scientific and technological advances[J]. Technological forecasting and social change, 2021, 172: 1-10.
[20] BORNMANN L, TEKLES A. Disruptive papers published in Scientometrics[J]. Scientometrics, 2019, 120(1): 331-336.
[21] BORNMANN L, TEKLES A. Disruption index depends on length of citation window[J]. Profesional de la información, 2019, 28(2): 1-2.
[22] 宋培彦, 冯超慧, 龙晨翔, 等. 基于颠覆性指数优化的细分领域优秀科技人才发现研究[J]. 情报杂志, 2022, 41(5): 61-65. (SONG P Y, FENG C H, LONG C X, et al. Study on discovery of outstanding scientific and technological talents in specific domains based on optimized disruptive index[J]. Journal of intelligence, 2022, 41(5): 61-65.)
[23] 姜育彦, 刘雪立. 科技期刊的创新性评价指标——期刊颠覆性指数(JDI)及其实证研究[J]. 中国科技期刊研究, 2022, 33(7): 965-972. (JIANG Y Y, LIU X L. An innovative evaluation index of scientific journals:journal disruption index (JDI) and its empirical research[J]. Chinese journal of scientific and technical periodicals, 2022, 33(7): 965-972.)
[24] BORNMANN L, DEVARAKONDA S, TEKLES A, et al. Are disruption index indicators convergently valid? the comparison of several indicator variants with assessments by peers[J]. Quantitative science studies, 2020, 1(4): 1-31.
[25] LEYDESDORFF L, BORNMANN L. Disruption indices and their calculation using web-of-science data: indicators of historical developments or evolutionary dynamics?[J]. Journal of informetrics, 2021, 15(4): 1-11.
[26] 姜育彦, 刘雪立. 绝对颠覆性指数与同行评议指标及CNCI的关系:基于病毒学论文的研究[J]. 图书情报工作, 2023, 67(3): 96-105. (JIANG Y Y, LIU X L. The relationship between peer review index, CNCI and absolute disruption index: a study based on virology papers[J]. Library and information service, 2023, 67(3): 96-105.)
[27] WU Q, YAN Z. Solo citations, duet citations, and prelude citations: new measures of the disruption of academic papers[J]. arXiv preprint arXiv:1905.03461, 2019: 1-9.
[28] HUANG H, ZHU D and WANG X. Evaluating scientific impact of publications: combining citation polarity and purpose[J]. Scientometrics, 2021, 127(9): 5257-5281.
[29] LI J, YIN Y, FORTUNATO S, et al. A dataset of publication records for Nobel laureates[J]. Scientific data, 2019, 6(1): 1-10.
[30] 梁国强. 变革性研究的引文特征分析与早期识别模型构建[D]. 大连: 大连理工大学, 2021. (LIANG G Q. Citation patterns analysis and the early identification model construction of transformative research[D]. Dalian: Dalian University of Technology, 2021.)
[31] 方开泰, 彭小令. 现代基础统计学[M]. 北京: 高等教育出版社, 2014. (FANG K T, PENG X L. Modern basic statistics[M]. Beijing: Higher Education Press, 2014.)
[32] 王琳, 岳卫平. 基于引文分析的诺贝尔奖级科学家遴选——科睿唯安“引文桂冠奖”详解[J]. 世界科技研究与发展, 2020, 41(5): 447-454. (WANG L, YUE W P. Selection of Nobel prize level scientists based on citation analysis: an overview of Clarivate analytics citation laureates[J]. World sci-tech R&D, 2020, 41(5): 447-454.)
[33] 任晓亚, 张志强. 主要科技领域国际权威奖项规律及其驱动因素分析[J]. 情报学报, 2019, 38(9): 881-893. (REN X Y, ZHANG Z Q. Analysis of the laws of international authoritative awards in main science and technology fields and their driving factors[J]. Journal of the China Society for Scientific and Technical Information, 2019, 38(9): 881-893.)
文章导航

/