图书情报工作 ›› 2021, Vol. 65 ›› Issue (23): 100-105.DOI: 10.13266/j.issn.0252-3116.2021.23.011

• 情报研究 • 上一篇    下一篇

以共引网络识别研究领域的引文评价方法有效性分析

宋丽萍1, 王建芳2, 付婕1, 苑珊珊1   

  1. 1. 天津师范大学管理学院 天津 300387;
    2. 中国科学院科技战略咨询研究院 北京 100190
  • 收稿日期:2021-05-18 修回日期:2021-09-21 出版日期:2021-12-05 发布日期:2021-12-18
  • 通讯作者: 王建芳,副研究员,博士,通讯作者,E-mail:wangjianfang@casisd.cn
  • 作者简介:宋丽萍,教授,博士,硕士生导师; 付婕,讲师,博士;苑珊珊,硕士研究生。
  • 基金资助:
    本文系国家社会科学基金一般项目"负责任计量视角下科学评价方法与指标优化研究"(项目编号:18BTQ074)研究成果之一。

Analysis on the Effectiveness of Citation Evaluation Methods in the Research Field Identification by Co-Citation Network

Song Liping1, Wang Jianfang2, Fu Jie1, Yuan Shanshan1   

  1. 1. School of Management, Tianjin Normal University, Tianjin 300387;
    2. Institutes of Science and Development, Chinese Academy of Sciences, Beijing 100190
  • Received:2021-05-18 Revised:2021-09-21 Online:2021-12-05 Published:2021-12-18

摘要: [目的/意义]为探讨论文层面学术规范化引用影响力指标,对基于共引网络识别研究领域的引文评价方法Relative Citation Ratio (RCR)的有效性进行分析。[方法/过程]选取iCite、F1000、InCites数据库,以739 604篇文献为样本,采用R语言对RCR与基于先验分类的Category Normalized Citation Impact (CNCI)、期刊影响因子(JIF)等进行相关分析,以检验RCR在学术影响力评价中的有效性。[结果/结论]RCR与CNCI高度相关、与JIF弱相关,因此表明RCR与CNCI具有相似性与差异性,并揭示了其在践行《旧金山宣言》、摆脱"以刊评文"方面的可操作性;交叉科学中RCR、JIF相关度与学科交叉数目的反变关系以及RCR与JIF相关度低于单一学科的结果,揭示了RCR在交叉科学论文学术影响力评价中具有一定的适用性与有效性。因此,RCR借助共引网络识别研究领域的算法为论文影响力评价,特别是为交叉科学研究成果的评价提供了新的解题思路。

关键词: CNCI, RCR, F1000, 期刊影响因子

Abstract: [Purpose/significance] To investigate field-normalized reference influence indicators on the level of papers, the effectiveness of a citation evaluation method (Relative Citation Ratio, RCR) based on the research field identification by co-citation network is analyzed.[Method/process] In order to test the effectiveness of RCR in the evaluation of academic impact, the paper chose iCite, F1000, InCites, then took 739 604 articles as a sample, and analyzed the correlation among RCR, Category Normalized Citation Impact (CNCI) and journal impact factor (JIF) by the R language.[Result/conclusion] The paper shows that RCR strongly correlates with CNCI, and poorly correlates with journal impact factor, which indicate the similarities and differences between RCR and CNCI and confirm that it is a good practice for implementing San Francisco Declaration on Research Assessment and assessing research on its own merits rather than on the basis of the journal in which the research is published. It also turns out the inverse relationship of the correlation and the number of interdisciplinary subjects between RCR and journal impact factor in interdisciplinary science, and lower correlation between RCR and journal impact factor than in a single discipline, which appears the applicability and effectiveness of RCR in evaluating the influence of academic papers in interdisciplinary science. The paper concludes that RCR based on research field identification by co-citation network provides new solution for the evaluation of paper influence, especially for interdisciplinary research outputs.

Key words: CNCI, RCR, F1000, journal impact factor

中图分类号: