A New Method of Academic Journal Evaluation Based on FDH Model

  • Zhao Rongying ,
  • Wang Jianpin
Expand
  • 1. Research Center for China Science Evaluation, Wuhan University, Wuhan 430072;
    2. School of Information Management, Wuhan University, Wuhan 430072;
    3. School of Information Technology, Shangqiu Normal University, Shangqiu 476000

Received date: 2017-11-07

  Revised date: 2018-01-12

  Online published: 2018-04-20

Abstract

[Purpose/significance] This article aims at exploring different methods of evaluating academic journals, so that we can obtain more effective, fair and valuable information, and then promote the development of theory and the practice of journal evaluation.[Method/process] In this paper, a new method of academic journal evaluation is constructed by introducing FDH model that is used for efficiency evaluation in economics into bibliometrics. Then, we selected seven indicators to evaluate 41 journals in library and information science, and carried out correlation analysis between the evaluation results and other periodical rankings.[Result/conclusion] Firstly, the evaluation results of journal evaluation method based on FDH are more objective, and these results are consistent with other well-known reference rankings. Secondly, this method aggregates several journal evaluation indicators, which not only can calculate the score of each journal, but also can provide more valuable information. So, it may be benefit for the editorial board to formulate strategies. For example, the FDH model can identify "benchmarks" and "dominating journals" of the evaluated journal. The journal can find out its own shortcomings and gaps through comparing journals whose performance is close to it, and then achieve the goal of continual improvement and surpassing competitors.

Cite this article

Zhao Rongying , Wang Jianpin . A New Method of Academic Journal Evaluation Based on FDH Model[J]. Library and Information Service, 2018 , 62(8) : 100 -106 . DOI: 10.13266/j.issn.0252-3116.2018.08.013

References

[1] HADDOW G, GENONI P. Citation analysis and peer ranking of Australian social science journals[J]. Scientometrics, 2010, 85(2):471-487.
[2] BENATI S, STEFANI S. The academic journal ranking problem:a fuzzy-clustering approach[J]. Journal of classification, 2011, 28(1):7-20.
[3] CURRIE R R, PANDHER G S. Finance journal rankings and tiers:an active scholar assessment methodology[J]. Journal of banking & finance, 2011, 35(1):7-20.
[4] ENNAS G, BIGGIO B, GUARDO M C D. Data-driven journal meta-ranking in business and management[J]. Scientometrics, 2015, 105(3):1911-1929.
[5] BORGER B D, KERSTENS K. Cost efficiency of Belgian local governments:a comparative analysis of FDH, DEA, and econometric approaches[J]. Regional science & urban economics, 1996, 26(2):145-170.
[6] GUPTA S, VERHOEVEN M. The efficiency of government expenditure:experiences from Africa[J]. Journal of policy modeling, 2001, 23(4):433-467.
[7] 邱兆祥,张爱武. 基于FDH方法的中国商业银行X-效率研究[J]. 金融研究, 2009(11):91-102.
[8] 董晨景,梁樑,丁晶晶. 并联生产系统FDH模型及其在分配问题中的应用[J]. 系统管理学报, 2015,24(4):595-601.
[9] FEALING K H, LANE J I, Ⅲ J H M, et al. The science of science policy[M]. Stanford:Stanford University Press, 2011.
[10] DEPRINS D, SIMAR L, TULKENS H. Measuring labor-efficiency in post offices[J]. Performance of public enterprises concepts & measurement, 1984:285-309.
[11] TULKENS H. On FDH efficiency analysis:some methodological issues and applications to retail banking, courts, and urban transit[J]. Journal of productivity analysis, 1993, 4(1):183-210.
[12] LOVELL C A K, PASTOR J T. Radial DEA models without inputs or without outputs[J]. European journal of operational research, 1999, 118(1):46-51.
[13] 李浩,王公宝,宋业新,等. 只有输出(入)的DEA改进模型及其应用[J]. 模糊系统与数学, 2011, 25(3):168-174.
[14] HALKOS G E, TZEREMES N G. Measuring economic journals' citation efficiency:a data envelopment analysis approach[J]. Scientometrics, 2011, 88(3):979-1001.
[15] TVSELMANN H, SINKOVICS R R, PISHCHULOV G. Towards a consolidation of worldwide journal rankings-a classification using random forests and aggregate rating via data envelopment analysis[J]. Omega, 2015, 51:11-23.
[16] LOVELL C A K. Measuring the macroeconomic performance of the Taiwanese economy[J]. International journal of production economics, 1995, 39(1):165-178.
[17] GARCÍA-ROMERO A, SANTÍN D, SICILIA G. Another brick in the wall:a new ranking of academic journals in economics using FDH[J]. Scientometrics, 2016, 107(1):91-101.
[18] HARNAD S. Multiple metrics required to measure research performance[J]. Nature, 2009, 457(7231):785.
[19] 吴涛,杨筠,陈晨,等. 基于因子分析法的科技期刊引文综合评价指标研究[J]. 中国科技期刊研究, 2015, 26(2):205-209.
[20] 李晓燕. 基于数据包络分析的标杆管理理论与应用研究[D].南京:南京理工大学, 2010.
Outlines

/

〈 〉