图书情报工作

图书情报工作 >

2017 , Vol. 61 >Issue 4: 98 - 107

DOI: https://doi.org/10.13266/j.issn.0252-3116.2017.04.013

情报研究

单篇论文学术影响力评价指标构建

  • 何春建
展开
  • 南京师范大学图书馆 南京 210023
何春建(ORCID:0000-0002-4488-3429),馆员,硕士,E-mail:cjhe@njnu.edu.cn。

收稿日期: 2016-10-09

  修回日期: 2017-01-09

  网络出版日期: 2017-02-20

收起

Study on the Evaluation Indicators of Single Article Academic Impact

  • He Chunjian
Expand
  • Library of Nanjing Normal University, Nanjing 210023

Received date: 2016-10-09

  Revised date: 2017-01-09

  Online published: 2017-02-20

Fold

摘要

[目的/意义] 基于评价指标设计原理，建立可扩展到多篇论文评价的单篇论文学术影响力评价指标体系，为多角度评价单篇论文学术影响力提供多种指标。[方法/过程] 兼顾施引文献的数量与质量，建立包含TVF、TVF（n）以及VF（t）等单篇论文影响力评价指标的指标体系，提出将TVF指标扩展到多篇论文影响力的分析方法。通过实证研究，计算TVF、TVF（3）与被引次数C及施引文献的h指数的皮尔森相关性，并与他人的评价结论对照印证。[结果/结论] 对TVF及TVF（n）等指标不同的用途进行了探讨：TVF是累计综合影响力，用于全面评价论文的影响力；TVF（n）可用于比较不同年份论文间的影响力，且可预测它们未来的TVF表现。TVF还可被扩展应用到多篇论文学术影响力的评价中。

关键词： 单篇论文; 多篇论文; 评价指标; 累计综合影响力(TVF); 年度新增影响力(VF(t))

本文引用格式

何春建 . 单篇论文学术影响力评价指标构建[J]. 图书情报工作, 2017 , 61(4) : 98 -107 . DOI: 10.13266/j.issn.0252-3116.2017.04.013

Abstract

[Purpose/significance] On the basis of the design principle of evaluation indicators, the author proposes the evaluation indicator system of single article impact which can be extended to the multiple articles evaluation, and makes an empirical study, providing various indicators from multiple perspectives.[Method/process] Combining both the quantity and quality of the cited articles, an evaluation index system of single article impact including TVF, TVF(n) and VF(t) was designed at first. An analytical method for extending the TVF index to the evaluation of multiple articles was designed. Then an empirical study of three different samples was made with further analysis of Pearson Correlation Coefficient between the indicators, times cited C and h-index of the cited article. Finally, the analytic result was contrasted with those of Shen Lihua and Wang Shu for verification.[Result/conclusion] The paper has discussed the different functions of such indicators as TVF, TVF(n) and VF(t). In summary, TVF can be used for overall impact of the article; TVF(n) can be used for comparison between articles published in different years, which also leads to the prediction of their final impact. TVF can be extended to the evaluation of academic influence of multiple articles

Key words： single article; multiple articles; evaluation indicators; total comprehensive impact(TVF); new impact per year(VF(t))

参考文献

[1] GARFIELD E. Citation indexes for science; a new dimension in documentation through association of ideas.[J]. Science, 1955,122(3159):1127-1128.
[2] GARFIELD E. Citation analysis as a tool in journal evaluation.[J]. Science, 1972,178(4060):471-479.
[3] HIRSCH J E. An index to quantify an individual's scientific research output[J]. Proceedings of the National Academy of Sciences of the United States of America, 2005,102(46):16569-16572.
[4] EGGHE L. Theory and practice of the g-Index[J]. Scientometrics, 2006,69(1):131-152.
[5] KOSMULSKI M. A new Hirsch-type index saves time and works equally well as the original h-index[J]. ISSI newsletter, 2006,3(2):4-6.
[6] 叶鹰. h指数和类h指数的机理分析与实证研究导引[J]. 大学图书馆学报, 2007,25(5):2-5.
[7] JIN B H, LIANG L M, ROUSSEAU R, et al. The R- and AR-indices:complementing the h-index[J]. Science bulletin, 2007,52(6):855-863.
[8] NEYLON C, WU S. Article-level metrics and the evolution of scientific impact[J]. PLoS biol, 2009,7(11):e1000242.
[9] PRIEM J, PIWOWAR H A, HEMMINGER B M. Altmetrics in the wild:Using social media to explore scholarly impact[J]. Computer science, 2012,[EB/OL].[2016-10-27]. http://arxiv.org/abs/1203.4745v1.
[10] JAHANDIDEH S, ABDOLMALEKI P, ASADABADI E B. Prediction of future citations of a research paper from number of its internet downloads[J]. Medical hypotheses, 2007,69(2):458-459.
[11] O'EARY D E. The relationship between citations and number of downloads in Decision Support Systems[J]. Decision support systems, 2008,45(4):972-980.
[12] LIPPI G, FAVALORO E J. Article downloads and citations:is there any relationship?[J]. Clin chim acta, 2013,415:195.
[13] COATS A J S. Top of the charts:download versus citations in the International Journal of Cardiology[J]. International journal of cardiology, 2005,105(2):123-125.
[14] EYSENBACH G. Can tweets predict citations? metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact.[J]. Journal of medical internet research, 2011,13(4):526-533.
[15] XIN S, PEPE A, BOLLEN J. How the scientific community reacts to newly submitted preprints:article downloads, Twitter mentions, and citations.[J]. PLos One, 2012,7(11):e47523(e47523.
[16] THELWALL M, HAUSTEIN S, LARIVI?RE V, et al. Do Altmetrics work? Twitter and ten other social web services[J]. PLos one, 2013,8(5):e64841.
[17] HAUSTEIN S, PETERS I, SUGIMOTO C R, et al. Tweeting biomedicine:an analysis of tweets and citations in the biomedical literature[J]. Journal of the Association for Information Science and Technology, 2014,4(65):656-669.
[18] LI X, THELWALL M. F1000, mendeley and traditional bibliometric indicators[EB/OL].[2017-01-02]. http://sticonference.org/Proceedings/vol2/Li_F1000_541.pdf.
[19] 宋丽萍, 王建芳, 王树义. 科学评价视角下F1000、Mendeley与传统文献计量指标的比较[J]. 中国图书馆学报, 2014(4):48-54.
[20] WARDLE D A. Do ‘Faculty of 1000’ (F1000) ratings of ecological publications serve as reasonable predictors of their future impact?[J]. Ideas in ecology & evolution, 2010,3:11-15.
[21] 余厚强, 邱均平. 替代计量指标分层与聚合的理论研究[J]. 图书馆杂志, 2014(10):13-19.
[22] 王贤文, 方志超, 王虹茵. 连续、动态和复合的单篇论文评价体系构建研究[J]. 科学学与科学技术管理, 2015(8):37-48.
[23] 邱均平, 余厚强. 替代计量学的提出过程与研究进展[J]. 图书情报工作, 2013,57(19):5-12.
[24] ALBERTS B. Impact factor distortions[J]. Science, 2013,340(6134):787.
[25] GARFIELD E. The history and meaning of the journal impact factor.[J]. Jama the Journal of the American Medical Association, 2006, 295(1):90-93.
[26] BORDONS M, FERNÁNDEZ M T, GÓMEZ I. Advantages and limitations in the use of impact factor measures for the assessment of research performance[J]. Scientometrics, 2002,53(2):195-206.
[27] 刘盛博, 王博, 唐德龙, 等. 基于引用内容的论文影响力研究——以诺贝尔奖获得者论文为例[J]. 图书情报工作, 2015,59(24):109-114.
[28] 王剑, 高峰, 满芮, 等. 基于引用频次和内容分析的引文分布与动机关系研究[J]. 情报杂志, 2013(9):100-103.
[29] 赵蓉英, 曾宪琴, 陈必坤. 全文本引文分析——引文分析的新发展[J]. 图书情报工作, 2014,58(9):129-135.
[30] 钟文一, 陈云鹏. 基于引证系数的论文影响力评价方法研究[J]. 情报科学, 2011(5):706-712.
[31] SCHUBERT A. Using the h-index for assessing single publications[J]. Scientometrics, 2009,78(3):559-565.
[32] 杨建林, 严明. 单篇期刊论文h指数的实证研究——以图书情报学为例[J]. 图书情报工作, 2010,54(12):145-148.
[33] 王凌峰, 张泽玺. 基于引文网络的单篇论文新评价指标:Hi指标[J]. 情报理论与实践, 2012(11):52-55.
[34] AJIFERUKE I, WOLFRAM D. Citer analysis as a measure of research impact:library and information science as a case study[J]. Scientometrics, 2010,83(3):623-638.
[35] 王术, 叶鹰. 影响矩作为测度单篇论著影响力的评价指标探讨[J]. 大学图书馆学报, 2014(5):12-18.
[36] 吴勤. 基于引证强度的学术论文质量评价方法研究[J]. 情报学报, 2007,26(4):522-526.
[37] 宋歌. 网络分析方法在引文分析中的整合研究[J]. 中国图书馆学报, 2011(4):106-114.
[38] 韩毅, 夏慧, 童迎. 引用结构视角下单篇学术文献影响力测度的ID指数[J]. 情报学报, 2013,32(9):968-975.
[39] CHEN P, XIE H, MASLOV S, et al. Finding scientific gems with Google's PageRank algorithm[J]. Journal of Informetrics, 2006,1(1):8-15.
[40] MA N, GUAN J, ZHAO Y. Bringing PageRank to the citation analysis[J]. Information processing & management, 2008,44(2):800-810.
[41] SU C, PAN Y T, ZHEN Y N, et al. PrestigeRank:a new evaluation method for papers and journals[J]. Journal of informetrics, 2011,5(1):1-13.
[42] 李仲谋. ScholarRank:一种新的评价学术论文影响力的方法[J]. 情报理论与实践, 2014(7):102-105.
[43] 郑美莺, 梁飞豹, 梁嘉熹. 单篇论文评价方法——PaperRank算法[J]. 科技与出版, 2016(7):94-98.
[44] 牛琪锴, 狄增如, 樊瑛. 科学引文网中基于"H指数"的文章影响力评价[J]. 北京师范大学学报(自然科学版), 2014(6):672-675.
[45] 李长玲, 翟雪梅. 基于PageRank的引文分析方法探讨[J]. 情报理论与实践, 2007,30(1):122-124.
[46] HICKS D, WOUTERS P, WALTMAN L, et al. Bibliometrics:the Leiden Manifesto for research metrics.[J]. Nature, 2015,520(7548):429-431.
[47] Elsevier. Response to HEFCE's call for evidence:independent review of the role of metrics in research assessment[EB/OL].[2016-10-25].https://www.elsevier.com/__data/assets/pdf_file/0019/53416/Elsevier-response-HEFCE-review-role-of-metrics.pdf.
[48] 沈利华, 缪家鼎, 陈国钢, 等. "客观同行评议"方法探索性研究——一种基于引文分析法的学术论文影响力评价方法[J]. 图书情报工作, 2012,56(18):144-148.
Options
文章导航

/

〈 〉