收稿日期: 2014-08-19
修回日期: 2014-09-23
网络出版日期: 2014-11-07
Effect on Academic Journals Evaluation of Index Data Distribution and the Internal Gap: Taking JCR Mathematics Journals as an Example
Received date: 2014-08-19
Revised date: 2014-09-23
Online published: 2014-11-07
以2012年JCR收录的数学期刊为例,采用偏度、峰度、JB检验、极大极小值比、离散系数、中位数均值比分析期刊评价指标的数据分布特点,并首次采用基尼系数分析期刊评价指标的内部差距,发现期刊评价指标普遍是右偏的,并且不服从正态分布;总被引频次、特征因子、即年指标的内部差距较大。期刊评价指标数据偏倚情况从好到坏的次序为:影响因子与5年影响因子>被引半衰期>论文影响分值>即年指标>特征因子>总被引频次。得出结论:指标数据偏倚会影响评价指标的数据标准化;指标数据偏倚会影响期刊一般水平的判断;指标数据右偏会导致期刊评价值偏低;最好选取数据偏倚情况相对较好的指标来评价期刊平均水平;数据偏倚对基于传统回归的计量研究影响较大。该结论有待进一步检验。
俞立平 , 刘爱军 . 指标数据分布与内部差距对学术期刊评价的影响——以JCR数学期刊为例[J]. 图书情报工作, 2014 , 58(21) : 105 -110 . DOI: 10.13266/j.issn.0252-3116.2014.21.015
This paper takes JCR 2012 mathematics journals as an example, using skewness, kurtosis, JB test, maximum and minimum value ratio, dispersion coefficient, the average median ratio analysis the data distribution characteristics of periodical evaluation indicator. And for the first time using the Gini coefficient to analyze the internal gap of journal evaluation indicators, it has found that the periodical evaluation indicator is generally skewed to the right, and do not obey the normal distribution; there is a wide internal gap among total citations, characteristic factor and immediacy index. The order from good to bad of journal evaluation indicators in bias is impact factor and 5-year impact factor> cited half-life> papers affect scores> immediacy index> features factor> total citations. The paper comes to the conclusions as follows: indicator data bias affects data standardization of evaluation indicator; index data bias affects the judgment of journal general level; indicator data skewed to the right will cause low journal evaluation value; it's better to select the relatively good indicators in data bias to evaluate journals' average level; data bias has a greater impact on measurement research which based on traditional regression; the above conclusions are pending further testing in this paper.
Key words： academic journals; evaluation index; date bias; the Gini coefficient
[1] Moed H F. Measuring contextual citation impact of scientific journals[J]. Journal of Informetrics,2010,4(3):265-277.
[2] Kosmulski M. Successful papers: A new idea in evaluation of scientific output[J]. Journal of Informetrics,2011,5(3):481-485.
[3] Vinkler P. Introducing the current contribution index for characterizing the recent, relevant impact of journals[J].Scientometrics,2008,79(2):409-420.
[4] Seglen P O. The skewness of science[J]. Journal of the American Society for Information Science,1992,43(9):628-638.
[5] Adler R, Ewing J,Taylor P. Citation statistics[J]. Statistical Science, 2009,24(1): 1-26.
[6] Glänzel W. Seven myths in bibliometrics about facts and fiction in quantitative science studies[J]. ISSI Newsletter,2008,4(2):24-32.
[7] Bornmann L,Mutz R,Neuhaus C,et al. Citation counts for research evaluation: Standards of good practice for analyzing bibliometric data and presenting and interpreting results[J]. Ethics in Science and Environmental Politics,2008,8(1):93-102.
[8] van Raan A F J. Measurement of central aspects of scientific research: Performance, interdisciplinarity, structure[J]. Measurement,2005,3(1):1-19.
[9] Davis P M. Eigenfactor: Does the principle of repeated improvement result in better estimates than raw citation counts[J].Journal of the American Society for Information Science and Technology,2008,59(13):2186- 2188.
[10] 邓三鸿,梁勇,杨建林. 改进型 h 型指数在期刊评价上的应用探讨[J]. 西南民族大学学报(人文社会科学版),2012(7):226-229.
[11] 胡祖光.基尼系数理论最佳值及其简易计算公式研究[J]. 经济研究,2004(9):60-68.
[12] 俞立平,潘云涛,武夷山. 学术期刊综合评价数据标准化方法研究[J]. 图书情报工作,2009,53(12):136-139.
/
| 〈 |
|
〉 |
