情报研究

一种多篇科技论文新颖性对比评估方法

  • 张吉玉 ,
  • 张均胜 ,
  • 乔晓东
展开
  • 1 中国科学技术信息研究所 北京 100038;
    2 国家新闻出版署富媒体数字出版内容组织与知识服务重点实验室 北京 100038
张吉玉,硕士研究生;乔晓东,研究员,硕士。

收稿日期: 2023-04-14

  修回日期: 2023-06-01

  网络出版日期: 2023-10-25

基金资助

本文系国家重点研发计划项目“颠覆性技术识别理论、方法与专家预判系统”(项目编号:2019YFA0707201)和中国科学技术信息研究所创新研究基金“科技论文原创性与新颖性评估方法研究”(项目编号:MS2022-05)研究成果之一。

A Comparative Evaluation Method for the Novelty of Multiple Scientific and Technical Articles

  • Zhang Jiyu ,
  • Zhang Junsheng ,
  • Qiao Xiaodong
Expand
  • 1 Institute of Scientific and Technical Information of China, Beijing 100038;
    2 Key Laboratory of Rich-Media Knowledge Organization and Service of Digital Publishing Content of National Press and Publication Administration, Beijing 100038

Received date: 2023-04-14

  Revised date: 2023-06-01

  Online published: 2023-10-25

摘要

[目的/意义] 结合科技论文内容与引文信息对多篇论文的新颖性进行综合评估,为代表作评价与人才遴选等提供辅助。[方法/过程] 提出一种对多篇科技论文新颖性进行对比评估的方法。该方法建立多篇论文问题—方法矩阵关联模型,计算多篇论文的问题新颖度与方法新颖度,并结合施引文献的引文文本与引用情况,构建多篇科技论文的评述画像用于新颖性对比评估。[结果/结论] 以图情领域两名学者为例,将两位学者的多篇论文组合分别编号为 D1 与 D2 并对其新颖性进行对比评估,得出 D2 的问题新颖度优于 D1,而 D1 的方法新颖性略高于 D2 等结论,验证了所提方法的可行性与合理性。

本文引用格式

张吉玉 , 张均胜 , 乔晓东 . 一种多篇科技论文新颖性对比评估方法[J]. 图书情报工作, 2023 , 67(19) : 68 -79 . DOI: 10.13266/j.issn.0252-3116.2023.19.007

Abstract

[Purpose/Significance] This paper uses the content and citation information of scientific and technical articles to evaluate the novelty of multiple articles comprehensively, which can assist in evaluating representative works, selecting talents, and other tasks. [Method/Process] This paper proposed a method to evaluate the novelty of multiple scientific and technical articles. This method established the correlation model of the problem-method matrices of multiple papers, and calculated the problem novelty and the method novelty of these papers. Then combining citation text and citation data, this method constructed the review portraits of multiple papers. [Result/Conclusion] Taking two scholars D1 and D2 in library and information research field as examples, multiple scientific and technological articles of D1 and D2 were selected for evaluation. It concludes that the novelty of research problems of D2 are better than those of D1, while the novelty of research methods of D1 are better than those of D2. The results above verify the feasibility and rationality of the proposed method.

参考文献

[1] 科技部, 教育部, 工业和信息化部, 等. 科技部等八部门印发《关于开展科技人才评价改革试点的工作方案》的通 知[EB/OL].[2023-09-04]. http://www.gov.cn/zhengce/zhengceku/2022-11/10/content_5725957.htm. (Ministry of Science and Technology, Ministry of Education, Ministry of Industry and Information Technology, et al. Eight departments including the Ministry of Science and Technology, issued the "work plan on carrying out the pilot program for the evaluation of scientific and technological talents"[EB/OL].[2023-09- 04]. http://www.gov.cn/zhengce/zhengceku/2022-11/10/content_5725957.htm.)
[2] 杨瑞仙, 高鑫宁, 董克. 我国学术代表作评价研究进展[J]. 图书 情报 工作, 2022, 66(17):129-140. (YANG R X, GAO X N, DONG K. Research progress on evaluation of academic representative works in China[J]. Library and information service, 2022, 66(17):129-140.)
[3] 刘益东. 用" 互联网+ 代表作" 落实代表作评价制度——并论开放评价引发的开放教育革命[J]. 情报资料工作, 2020, 41(3):14-19. (LIU Y D. Implementation of the representative works evaluation system based on internet & representative works:on the open education revolution caused by open evaluation[J]. Information and documentation services, 2020, 41(3):14-19.)
[4] 陈燕, 韩菲. 代表作评价制度:制约因素与对策分析[J]. 中国高教研究, 2020(12):15-20. (CHEN Y, HAN F. Representative evaluation system:restrictive factors and countermeasures analysis[J]. China higher education research, 2020(12):15-20.)
[5] 索传军, 盖双双, 周志超. 认知计算——单篇学术论文评价的新视角[J]. 中国图书馆学报, 2018, 44(1):50-61. (SUO C J, GAI S S, ZHOU Z C. Cognitive computing:a new perspective for evaluating the individual academic paper[J]. Journal of library science in China, 2018, 44(1):50-61.)
[6] SINGH S, AGGARWAL Y. In search of a consensus definition of innovation:a qualitative synthesis of 208 definitions using grounded theory approach[J]. Innovation:the European journal of social science research, 2022, 35(2):177-195.
[7] 迟培娟, 丁洁兰, 冷伏海. 突破性论文的三元计量特征及识别研究——以生物医学领域为例[J]. 情报学报, 2022, 41(7):663-675. (CHI P J, DING J L, LENG F H. Characteristics of the technology impact of breakthrough papers in biology and medicine[J]. Journal of the China Society for Scientific and Technical Information, 2022, 41(7):663-675.)
[8] 许佳琪, 汪雪锋, 雷鸣, 等. 从突破性创新到颠覆性创新:内涵、特征与演化[J]. 科研管理, 2023, 44(2):1-13. (XU J Q, WANG X F, LEI M, et al. From breakthrough innovation to disruptive innovation:their connotations, characteristics and evolution[J]. Science research management, 2023, 44(2):1-13.)
[9] 罗卓然, 陆伟, 蔡乐, 等. 学术文本词汇功能识别——在论文新颖性度量上的应用[J]. 情报学报, 2022, 41(7):720-732. (LUO Z R, LU W, CAI L, et al. application of lexical functions in novelty measurement of academic papers[J]. Journal of the China Society for Scientific and Technical Information, 2022, 41(7):720-732.)
[10] 贺婉莹. 基于机器学习的论文学术创新力评价研究[D]. 南京:南京大学, 2019:5. (HE W Y. Research on academic innovation evaluation of papers based on machine learning[D]. Nanjing:Nanjing University, 2019:5.)
[11] WANG Z, WANG K, LIU J, et al. Measuring the innovation of method knowledge elements in scientific literature[J]. Scientometrics, 2022, 127(5):2803-2827.
[12] 逯万辉, 苏金燕, 余倩. 学术成果主题新颖性与学术引用的相关关系研究[J]. 情报资料工作, 2018(6):68-73. (LU W H, SU J Y, YU Q. Research on correlation of academic achievement theme novelty and academic citation[J]. Information and documentation services, 2018(6):68-73.)
[13] 钱佳佳, 罗卓然, 陆伟. 基于问题-方法组合的科技论文新颖性度量与创新类型识别[J]. 图书情报工作, 2021, 65(14):82-89. (QIAN J J, LUO Z R, LU W. Novelty measurement and innovation type identification of scientific literature based on question-method combination[J]. Library and information service, 2021, 65(14):82-89.)
[14] 梁兴堃. 守正能否创新?——基于我国图情领域论文新颖性和传统性的分析[J]. 图书情报工作, 2022, 66(20):148- 161. (Liang X K. Novelty, conventionality, and scientific impact of papers in library and information science in China:evidence from papers in CSSCI (2000-2019)[J]. Library and information service, 2022, 66(20):148-161.)
[15] 曹树金, 闫颂. 基于语义角色信息的科技论文创新段落定位及功能句识别方法研究——以中文情报学领域论文为例[J]. 情报理论与实践, 2022, 45(11):1-9, 20. (Cao S J, YAN S. Research on innovative paragraph positioning and functional sentence identification method of scientific and technical papers based on semantic role information:a case study of papers in the field of Chinese intelligence[J]. Information studies:theory & application, 2022, 45(11):1-9, 20.)
[16] 章成志, 李铮. 基于学术论文全文的创新研究评价句抽取研究[J]. 数据分析与知识发现, 2019, 3(10):12-19. (ZHANG C Z, LI Z. Extracting sentences of research originality from full text academic articles[J]. Data analysis and knowledge discovery, 2019, 3(10):12-19.)
[17] YANG J, LU W, HU J, et al. A novel emerging topic detection method:a knowledge ecology perspective[J]. Information processing & management, 2022, 59(2):102843.
[18] LUO Z, LU W, HE J, et al. Combination of research questions and methods:a new measurement of scientific novelty[J]. Journal of informetrics, 2022, 16(2):101282.
[19] 王艳艳, 张均胜, 乔晓东, 等. 基于问题-方法矩阵的文献新颖性评估方法[J]. 情报理论与实践, 2021, 44(2):90-95. (WANG Y Y, ZHANG J S, QIAO X D, et al. Evaluating novelty of scientific literature based on question-method matrix[J]. Information studies:theory & application, 2021, 44(2):90-95.)
[20] 张吉玉, 张均胜. 考虑时序的单篇科技文献新颖性评估方法[J]. 图书 情报 工作, 2022, 66(17):93-105. (ZHANG J Y, ZHANG J S. Novelty evaluation method of single scientific and technical literature considering time series[J]. Library and information service, 2022, 66(17):93-105.)
[21] 赵丽莉, 张晨, 周海燕, 等. 基于SciVal的高校临床医学学科学术竞争力分析及提升路径——以首都医科大学为例[J]. 医学教育管理, 2022, 8(5):589-596, 601. (Zhao L L, Zhang C, Zhou H Y, et al. Academic competitiveness of clinical medicine disciplines based on SciVal and discussion on the improvement path:based on Capital Medical University[J]. Medical education management, 2022, 8(5):589-596, 601.)
[22] 张旭, 吕冬晴, 阮选敏, 等. 融合文献计量与同行评议共识的期刊评价方法研究[J]. 情报学报, 2022, 41(5):486-496. (ZHANG X, LV D Q, RUAN X M, et al. Journal evaluation method based on the integration of peer-review consensus and bibliometric indicators[J]. Journal of the China Society for Scientific and Technical Information, 2022, 41(5):486-496.)
[23] 逯万辉, 谭宗颖. 学术成果主题新颖性测度方法研究——基于 Doc2Vec和HMM算法[J]. 数据分析与知识发现, 2018, 2(3):22-29. (LU W H, TAN Z Y. Measuring novelty of scholarly articles[J]. Data analysis and knowledge discovery, 2018, 2(3):22-29.)
[24] 冯立杰, 刘可辉, 王金凤, 等. 基于知识网络与多维技术创新地图的技术机会识别路径研究与应用[J/OL]. 数据分析 与知 识发 现:1-24[2023-09-04]. http://kns.cnki.net/kcms/detail/10.1478.g2.20221223.1540.005.html.http://kns.cnki.net/kcms/detail/10.1478.g2.20221223.1540.005.html (FENG L J, LIU K H, WANG J F, et al. Research on technology opportunity identification path based on knowledge network and multidimensional map of technology innovation[J/OL]. Data analysis and knowledge discovery:1-24[2023-09-04]. http://kns.cnki.net/kcms/detail/10.1478.g2.20221223.1540.005.html)
[25] 邱悦文. 离群专利与论文视角下新兴技术主题识别研究[J]. 情报工程, 2021, 7(3):81-93. (QIU Y W. Research on emerging technology topic identification based on outlier patent and paper[J]. Technology intelligence engineering, 2021, 7(3):81-93.)
[26] 杜学亮. 代表作评价制度的困境与出路[J]. 中国政法大学学报, 2019(2):74-79, 207. (DU X L. Dilemma and outlet of the representative work evaluation system[J]. Journal of CUPL, 2019(2):74-79, 207.)
[27] 苏鹏, 张琳. 学术代表作时间周期、首发载体及题材类型特征研究——以图灵奖为例[J]. 图书情报知识, 2021(1):66- 75. (SU P, ZHANG L. Research on time cycle, first carrier and research type of academic representative works:a case study of Turing award[J]. Documentation, information & knowledge, 2021(1):66-75.)
[28] ZHOU J, ZENG A, FAN Y, et al. The representative works of scientists[J]. Scientometrics, 2018, 117(3):1721-1732.
[29] BAO P, WANG J. Identifying your representative work based on credit allocation[C]//Companion proceedings of the web conference 2018. Geneva:International World Wide Web Conferences Steering Committee, 2018:5-6.
[30] MARIANI M S, MEDO M, ZHANG Y C. Identification of milestone papers through time-balanced network centrality[J]. Journal of informetrics, 2016, 10(4):1207-1223.
[31] 俞立平. 规范使用SCI下科技评价的问题与解决路径研究[J]. 情报资料工作, 2020, 41(2):64-69. (YU L P. A probe into the problems and solutions of scientific research evaluation under standard use of SCI[J]. Information and documentation services, 2020, 41(2):64-69.)
[32] 谢珍, 马建霞, 胡文静. 学术代表作评价:方法述评与研究展望[J]. 情报理论与实践, 2021, 44(12):190-196. (XIE Z, MA J X, HU W J. Evaluation of academic representative works:methods review and research prospects[J]. Information studies:theory & application, 2021, 44(12):190-196.)
[33] 王世鹏, 包翔, 宋余庆, 等. " 代表作" 制度的理论研究综述[J]. 情报工程, 2022, 8(2):97-108. (WANG S, BAO X, SONG Y. Review of the Theory Research of the "Representative Work" System[J]. Technology Intelligence Engineering, 2022, 8(2):97-108.)
[34] WANG R, ZHOU Y, ZENG A. Evaluating scientists by citation and disruption of their representative works[J]. Scientometrics, 2023, 128(3):1689-1710.
[35] 张吉玉, 张均胜, 乔晓东. 辅助新颖性评估的科技论文评述画像构建方法[J]. 情报理论与实践, 2023, 46(1):159-167. (ZHANG J Y, ZHANG J S, QIAO X D. Constructing review profile of scientific article for novelty evaluation assistance[J]. Information studies:theory & application, 2023, 46(1):159-167.)
文章导航

/

〈 〉