Paper Citation Standardized Index(PCSI): a New Index to Quantitatively Evaluate Scientific Articles Based on Citation

  • Wu Junhong ,
  • Xiao Hong ,
  • Ren Meiya ,
  • Feng Shiyong ,
  • Ding Zhe
Expand
  • 1 Chinese Academic Journal(CD) Electronic Journals Publishing House, Beijing 100192;
    2 Tongfang Knowledge Network Technology Co., Ltd(Beijing), Beijing 100192;
    3 Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190;
    4 Southern University of Science and Technology, Shenzhen 518055

Received date: 2020-08-13

  Revised date: 2020-09-23

  Online published: 2020-12-05

Abstract

[Purpose/significance] The citation count of an article has always been an important factor to quantitatively evaluate its academic influence. However, articles published in different disciplines and years will show great differences due to factors such as the number of research articles in this field and the lag of citation. Therefore, when comparing two papers, it is difficult to judge the influence of papers simply according to the absolute citation counts. Therefore, we design a new calculable mathematical model, so that each paper can have a standardized citation index, so as to directly compare the academic influence of papers published in different disciplines and years. [Method/process] In this paper, by analyzing the citation distribution law of papers in various disciplines of science and technology in Chinese academic journals in 2006 and 2017, and adopting the precondition that the citation distribution of papers of the same subject is closest to the lognormal distribution, an index for standardizing the citation——Paper Citation Standardized Index (PCSI) is proposed. Finally, taking the selection results of The Outstanding Papers from Sci-tech Journals of China Association for Science and Technology as an example, an empirical comparative study is made between them and all the papers in the same subject. [Result/conclusion] The results show that PCSI standardizes the citation counts of papers in different years and different disciplines, which reflects the linear difference of citation, thus PCSI is an ideal tool for comparative evaluation of academic influence of single paper.

Cite this article

Wu Junhong , Xiao Hong , Ren Meiya , Feng Shiyong , Ding Zhe . Paper Citation Standardized Index(PCSI): a New Index to Quantitatively Evaluate Scientific Articles Based on Citation[J]. Library and Information Service, 2020 , 64(23) : 22 -30 . DOI: 10.13266/j.issn.0252-3116.2020.23.003

References

[1] 复旦力推学术评价"代表作"制度[N/OL].中国高校之窗. http://www.gx211.com/news/2012329/n899593985.html.
[2] 孙亮. 我看"学术代表作"评价制度[N]. 北京日报,2012-09-24(020).
[3] 姜春林,赵宇航.代表作评价:探索之路与完善之策[J].甘肃社会科学,2016(3):143-148.
[4] 叶继元. 有益遏制学术评价形式化数量化[N]. 中国教育报,2012-03-28(003).
[5] 付慧真,张琳,胡志刚,等.基础理论视角下的科研评价思考[J].情报资料工作,2020,41(2):31-37.
[6] 杨兴林.高校教师职务晋升的学术代表作评价研究[J].江苏高教,2015(2):34-37.
[7] 石晶,李晓彤.热与冷:高校学术代表作评价制度的思考[J].甘肃社会科学,2014(6):73-75.
[8] 刘蓉蓉,卢垚,刘涛.中国农业科学院科技论文评价探索实践[J].农业科技管理,2018, 37(3):14-17.
[9] De B R E, KINT A, LUWEL M, et al. A study of research evaluation and planning:the University of Ghent[J]. Research evaluation, 1993(1):25-41.
[10] MOED H F, BRUIN R E D, LEEUWEN T N V. New bibliometric tools for the assessment of national research performance:database description, overview of indicators and first applications[J]. Entometrics, 1995, 33(3):381-422.
[11] BRAUN T, W. Glänzel. United Germany:the new scientific superpower?[J]. Entometrics, 1990.19(5/6):513-521.
[12] SCHUBERT A, BRAUN T. Relative indicators and relational charts for comparative assessment of publication output and citation impact[J]. Entometrics, 1986, 9(5/6):281-291.
[13] VINKLER P. Evaluation of some methods for the relative assessment of scientific publications[J]. Entometrics, 1986, 10(3):157-177.
[14] 张志辉. 论文影响力的线性学科标准化方法研究[D].上海:上海交通大学,2015.
[15] 陈仕吉,史丽文,李冬梅,等.论文被引频次标准化方法述评[J].现代图书情报技术,2012(4):54-60.
[16] 刘运梅,李长玲,冯志刚,等.改进的p指数测度单篇论文学术质量的探讨[J].图书情报工作,2017,61(21):106-113.
[17] 何春建.单篇论文学术影响力评价指标构建[J].图书情报工作,2017, 61(4):98-107.
[18] 曹进军.基于Total-Top论文引用均值的非线性分段评价体系研究[J].情报杂志,2017,36(4):189-195,201.
[19] 陈小清,刘丽,邢美园.单篇论著影响力评价指标比较分析——学术迹与Altmetrics评分、F1000评分、Comment的比较[J].情报理论与实践,2017,40(3):114-118.
[20] Scopus:访问和利用支持中心.什么是领域加权的引用影响(FWCI)?[EB/OL].[2020-09-22].https://cn.service.elsevier.com/app/answers/detail/a_id/16215/c/10547/supporthub/scopus/kw/FWCI/.
[21] 科睿维安.Indicators Handbook.Impact indicators category normalized citation impact[EB/OL].[2020-09-22].https://incites.help.clarivate.com/Content/Indicators-Handbook/ih-impact-indicators.htm?Highlight=CNCI.
[22] EOM Y, FORTUNATO S. Characterizing and modeling citation dynamics[J]. PLoS ONE, 2011, 6(9):e24926.
[23] CHATTERJEE A, GHOSH A, CHAKRABARTI B K. Universality of citation distributions for academic institutions and journals[J]. PLoS ONE, 2016, 11(2):e0148863.
[24] VIEIRA E, GOMES J. Citations to scientific articles:Its distribution and dependence on the article features[J]. Journal of informetrics, 2009. 4(1):1-13.
[25] REDNER S. Citation statistics from 110 years of physical review[J]. Physics today, 58(6), 49-54.
[26] BRZEZINSKI M. Power laws in citation distributions:Evidence from Scopus[J]. entometrics, 2015, 103(1):213-228.
[27] 邓慧颖,邹武,刘金福,等.水稻病毒期刊论文被引频次分布拟合与分析[J].中国农学通报,2013,29(33):265-270.
[28] 汪跃春,史新和.期刊论文被引频次分布拟合与分析[J].情报学报,2012,31(2):196-203.
[29] 毛国敏,蒋知瑞,任蕾,等.期刊论文被引频次的幂律分布研究[J].中国科技期刊研究,2014,25(02):293-298,307.
Outlines

/

〈 〉