Library and Information Service

Library and Information Service >

2018 , Vol. 62 >Issue 16: 132 - 143

DOI: https://doi.org/10.13266/j.issn.0252-3116.2018.16.015

Research on Evaluation Methods of Academic Journals Impact

  • Zhang Huiling ,
  • Dong Kun ,
  • Xu Haiyun
Expand
  • 1. School of Information Management, Shanxi University of Finance & Economics, Taiyuan 030006;
    2. Chengdu Documentation and Information Center, Chinese Academy of Sciences, Chengdu 610041;
    3. University of Chinese Academy of Sciences, Beijing 100190;
    4. Institute of Scientific and Technical Information of China(ISTIC), Beijing 100038

Received date: 2017-12-19

  Revised date: 2018-04-08

  Online published: 2018-08-20

Fold

Abstract

[Purpose/significance]Periodicals' influence evaluation is an important part and application field of scientific metrology research, which is of great significance for optimizing journal quality and promoting scientific exchange.[Method/process]This review summarizes the research progress of influencing evaluation methods of journals at home and abroad. In terms of traditional indicators, the series of influencing factors, index H and derivative indices, PageRank and its derivative indicators, the method of comprehensive evaluation based on multiple factors and the impact of periodicals based on social media, interdisciplinary journal evaluation methods, the characteristics and deficiencies of current evaluation methods are pointed out.[Result/conclusion]The paper finds that the existing evaluation indexes are poorly integrated. The citation skewness and self-citation problems are less considered, and the feasibility of emerging social media-based evaluation methods needs to be discussed. In the future we should pay attention to the in-depth integration of evaluation indicators, the diversification of citations for biased improvement methods, the standardization of evaluation methods for social media journals, and the systematization of cross-disciplinary journal evaluation methods.

Key words： journal influence; periodical evaluation; evaluation index; academic journal evaluation

Cite this article

Zhang Huiling , Dong Kun , Xu Haiyun . Research on Evaluation Methods of Academic Journals Impact[J]. Library and Information Service, 2018 , 62(16) : 132 -143 . DOI: 10.13266/j.issn.0252-3116.2018.16.015

References

[1] ZUCKERMAN H,MERTON R K.Patterns of evaluation in science:institutionalisation,structure and functions of the referee system[J].Minerva,1971,9(1):66-100.
[2] 耿艳辉,王立新,朱晓华.期刊同行评议研究综述[J].编辑之友,2015(5):48-52.
[3] 万昊,谭宗颖,朱相丽.同行评议与文献计量在科研评价中的作用分析比较[J].图书情报工作,2017(1):134-152.
[4] GARFIELD E.Citation analysis as a tool in journal evaluation.[J].Science,1972,178(4060):471-479.
[5] 潘云涛.2011年版中国科技期刊引证报告:核心版[M].北京:科学技术文献出版社,2011.
[6] POLCHINSKI J. Dirichlet branes and ramond-ramond charges.[J].Physical review letters,1995,75(26):4724-4727.
[7] GARFIELD E.Journal impact factor:a brief review[J].CMAJ:Canadian medical association journal,1999,161(8):979-980.
[8] PENDLEBURY D A.The use and misuse of journal metrics and other citation indicators[J].Archivum immunologiae et therapiae experimentalis,2009,57(1):1-11.
[9] 张积玉.学术期刊影响力及其评价指标体系的构建[J].陕西师范大学学报(哲学社会科学版),2010(5):70-76.
[10] SCHUBERT A,GLANZEL W.Statistical reliability of comparisons based on the citation impact of scientific publications[J].Scientometrics,1983,5(1):59-73.
[11] ROUSSEAU R.Why am I not cited or why are multi-authored papers more cited than others?[J].Journal of documentation,1992,48(1):79-80.
[12] GARFIELD E.Long-term vs. short-term journal impact:does it matter?[J].Physiologist,1998, 41(3):113.
[13] ZYCZKOWSKI K.Citation graph,weighted impact factors and performance indices[J].Scientometrics,2010,85(1):301-315.
[14] ZHANG C,LIU X,XU Y,et al.Quality-structure index:a new metric to measure scientific journal influence[J].Journal of the American Society for Information Science & Technology,2014,62(4):643-653.
[15] 许海云,方曙,付鑫金.基于特征向量中心度加权的期刊影响因子研究[J].情报理论与实践,2011,34(11):108-112.
[16] VINKLER P. Introducing the current contribution index for characterizing the recent,relevant of journals[J].Scientometrics,2009,79(2):409-420.
[17] 俞立平.历史影响因子:一个新的学术期刊存量评价指标[J].图书情报工作,2015,59(2):89-92.
[18] 马瑞敏.学术期刊影响力评价研究——基于历时视角的新实践[J].中国科技期刊研究,2014(11):1397-1403.
[19] 许海云,方曙.非参数统计的期刊影响力评价方法研究[J].图书情报工作,2013,57(5):107-113.
[20] MOED H F.Measuring contextual citation impact of scientific journals[J].Journal of Informetrics,2009,4(3):265-277.
[21] SILVA J A T D,MEMON A R.CiteScore:a cite for sore eyes,or a valuable,transparent metric?[J].Scientometrics,2017,111(1):1-4.
[22] GLANZEL W,MOED H.Journal impact measures in bibliometric research[J].Scientometrics, 2002,53(2):171-193.
[23] JACSO P.Five-year impact factor data in the journal citation reports[J].Online information review,2009,33(3):603-614.
[24] 赵星.JCR五年期影响因子探析[J].中国图书馆学报,2010,36(3):120-126.
[25] 王娟,郑春厚.JCR5年期影响因子实证分析[J].图书情报工作,2012, 56(4):143-147.
[26] SALA S,GRAFMAN J.Cortex 20095-year and 2-year Impact Factor:4.1[J].Cortex,2010, 46(9):1069.
[27] 张李义,叶艳.Google H5指数与CiteScore指数的期刊定量评价方法对比分析——基于知识扩散的视角[J].情报杂志,2017,36(11):175-179.
[28] 郝若扬.H5指数研究及其与影响因子的比较分析[J].情报科学,2017(6):120-124.
[29] LINE M,SANDISON A."Obsolescence" and changes in the use of literature with time.[J]. Journal of Documentation,1974,30:283-350.
[30] EGGHE L,ROUSSEAU R.Aging,obsolescence,impact,growth,and utilization:definitions and relations[J].Journal of the American Society for Information Science,2000,51(11):1004-1017.
[31] 俞立平,王艳.学术期刊被引频次的时间分布规律研究——以图书馆、情报、文献学期刊为例[J].情报科学,2016,34(5):159-162.
[32] 方红玲.国外期刊论文被引峰值年代及其影响因素研究——以SSCI收录图书情报学期刊为例[J].中国科技期刊研究,2015,26(11):1200-1204.
[33] HIRSCH J.HIRSCH J.An index to quantify an individual's scientific research output[J].Proceedings of the national academy of sciences of the United States of America,2005,102(46):16569-16572.
[34] BRAUN T,GLANZEL W, Schubert A.A hirsch-type index for journals[J].Scientometrics,2006,69(1):169-173.
[35] EGGHE L,ROUSSEAU R.An informetric model for the Hirsch-index[J].Scientometrics,2006,69(1):121-129.
[36] EGGHE L.Theory and practise of the g-index[J].Scientometrics,2006,69(1):131-152.
[37] WOEGINGER G J. An axiomatic characterization of the Hirsch-index[J].Mathematical social sciences,2008,56(2):224-232.
[38] WOEGINGER G J.A symmetry axiom for scientific impact indices[J].Journal of informetrics,2008,2(4):298-303.
[39] ZHANG C T.The e-index,complementing the h-index for excess citations[J].Plos one,2009,4(5):5429.
[40] YE F Y, Rousseau R.Probing the h-core:an investigation of the tail-core ratio for rank distributions[J].Scientometrics,2010,84(2):431-439.
[41] KOSMULSKI M.A new Hirsch-type index saves time and works equally well as the original h-index[J].ISSI newsletter,2006,2(3):4-6.
[42] 黄黄.HS指数——期刊评价新指标浅析[J].科技情报开发与经济,2013(21):116-118.
[43] PRATHAP G.Is there a place for a mock h-index?[J].Scientometrics,2010,84(1):153-165.
[44] PRATHAP G.The iCE approach for journal evaluation[J].Scientometrics,2010,85(2):561-565.
[45] 王超,彭超群.P指数用于中国SCI期刊评价的有效性分析[J].中国科技期刊研究,2016(8):893-899.
[46] 安静,李海燕,夏旭.期刊评价新指标——A指数与h指数的相关性分析[J].科技管理研究,2012,32(15):264-266.
[47] JIN B,LIANG L,ROUSSEAU R,EGGHE L. The R-and AR-indices:complementing the h-index[J].Chinese science bulletin,2007,52(6):855-863.
[48] BORNMANN L,MUTZ R,DANIEL H D.Are there better indices for evaluation purposes than the h index? A comparison of nine different variants of the h index using data from biomedicine[J].Journal of the American Society for Information Science and Technology,2008,59(5):830-837.
[49] VINKLER P.The π-index:a new indicator for assessing scientific impact[J].Journal of information science,2009,35(5):602-612.
[50] VINKLER P.The πv-index:a new indicator to characterize the impact of journals[J].Scientometrics,2010,82(3):461-475.
[51] PINSKI G,NARIN F.Citation influence for journal aggregates of scientific publications:theory, with application to the literature of physics[J].Information processing & management,1976,12(5):297-312.
[52] BERGSTROM C.Measuring the value and prestige of scholarly journals[J].College and Research Libraries News,2007,68(5):314-316.
[53] 刘艳华,华薇娜.期刊评价新指标——特征因子[J].情报杂志,2010(7):122-126.
[54] Krajna T.SCImago Journal & Country Rank[J].Polimeri,2009,29(4):258-262.
[55] 杨康,刘明政,张旭.SJR指数研究及其与影响因子的比较分析[J].情报杂志,2009(11):27-30.
[56] 赵星,高小强,唐宇.SJR与影响因子、h指数的比较及SJR的扩展设想[J].大学图书馆学报,2009(2):80-84.
[57] 俞立平,李守伟.标准特征因子的特点与应用分析[J].中国科技期刊研究,2016,27(9):990-993.
[58] 赵星.期刊引文评价新指标Eigenfactor的特性研究——基于我国期刊的实证[J].情报理论与实践,2009,32(8):53-56.
[59] BERGSTROM C T,WEST J D,Wiseman M A. The eigenfactor metrics.[J].Journal of neuroscience,2008, 28(45):11433-11434.
[60] FERSHT A.The most influential journals:impact factor and eigenfactor[J].Proceedings of the national academy of sciences of the United States of America,2009,106(17):6883-6884.
[61] DAVIS P M.Eigenfactor:does the principle of repeated improvement result in better estimates than raw citation counts?[J].Journal of the American Society for Information Science & Technology,2008,59(13):2186-2188.
[62] 蒋勇青,齐萍.学术期刊影响力评价方法研究[J].中国软科学,2017(3):178-185.
[63] 苏成,潘云涛,马峥,等.权威因子:一个新的期刊评价指标[J].编辑学报,2010,22(4):369-373.
[64] 李超."HIF指数"评价科技期刊学术影响的机理与实践[J].情报理论与实践,2011(7):44-48.
[65] VINKLER P.Comparative rank assessment of journal articles[J].Journal of informetrics, 2013,7(3):712-717.
[66] 李华,张学梅,刘文芝.PRP指标:一种跨学科期刊评价方法及与期刊H指数之比较[J].情报杂志,2015(8):60-64.
[67] 邵作运,李秀霞.f(x)指数:期刊学术影响力评价新指标[J].中国科技期刊研究,2015(11):1194-1199.
[68] LEYDESDORFF L.Alternatives to the journal impact factor:I3 and the top-10% (or top-25%?) of the most-highly cited papers[J].Scientometrics,2012,92(2):355-365.
[69] 伍军红,孙秀坤,孙隽,等.期刊影响力指数与影响因子评价国际期刊的比较研究[J].编辑学报,2017,29(5):500-504.
[70] 伍军红,肖宏,张艳,等.科技期刊国际影响力评价指标研究[J].编辑学报,2015,27(3):214-218.
[71] 由庆斌,汤珊红.补充计量学及应用前景[J].情报理论与实践,2013,36(12):6-10.
[72] 赵蓉英,汪少震,陈志毅.补充计量学及其分析工具之探究[J].情报理论与实践,2015,38(6):29-34.
[73] 张洋,吴娟平,郎林芳.基于不同网络数据源的期刊评价研究[J].中国科技期刊研究,2017,28(2):176-183.
[74] 余以胜,赵月华.基于Twitter关注度的期刊影响力评价指标——以国际图书情报学顶级期刊为例[J].图书情报工作,2016,60(8):99-105.
[75] 冀芳,张夏恒.学术期刊微信公众平台影响力研究——基于5种CSSCI来源期刊的实证分析[J].情报杂志,2016,35(4):147-151.
[76] KOUSHA K, THELWALL M.Sources of Google Scholar citations outside the science citation index:a comparison between four science disciplines[J].Scientometrics,2008,74(2):273-294.
[77] ZAHEDI Z,COSTAS R,WOUTERS P.How well developed are altmetrics?A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications[J].Scientometrics,2014,101(2):1491-1513.
[78] THELWALL M,HAUSTEIN S,LARIVIERE V,et al.Do altmetrics work? Twitter and ten other social Web services[J].Plos one,2013,8(5):64841.
[79] 舒非,HAUSTEIN S,全薇.推特(Twitter)对中国论文的国际关注度影响研究[J].图书馆论坛,2017,37(6):55-60.
[80] LIN J,FENNER M.Altmetrics in evolution:defining and redefining the ontology of article-level metrics[J].Information standards quarterly,2013,25(2):20.
[81] 许海云,尹春晓,郭婷,等.学科交叉研究综述[J].图书情报工作,2015,59(5):119-127.
[82] STIRLING A.A general framework for analysing diversity in science,technology and society. Journal of the royal society interface,2007,4(15):707-719.
[83] PORTER A L,Chubin D E. An indicator of cross-disciplinary research[J].Scientometrics,1985, 8(3/4):161-176.
[84] SHANNON C E.A mathematical theory of communication (parts I and Ⅱ)[J].Bell system technical journal,1949,27(3):379-423.
[85] 俞立平."影响因子百分位"指标的特点研究[J].图书情报工作,2016,60(10):103-107.
[86] 刘雪立,魏雅慧,盛丽娜,等.期刊PR8指数:一个新的跨学科期刊评价指标及其实证研究[J].图书情报工作,2017,61(11):116-123.
[87] 陈卫静, 张宇娥, 蔺梅芳.引文分布视角下期刊评价的P指数研究[J].图书情报工作,2017,61(17):122-130.
Options
Outlines

/

〈 〉

    Copyrights © LIS Press Co., Ltd. Reproduction is prohibited without permission.