Considering the critical role of academic paper' evaluation method in leading behaviors and scientific outputs of basic discipline researchers, it is of much necessary to design evaluation system with reasonable cost and scientific and fair methods. Taking the paper recommendation-propagation model proposed in Ref.[3] as the benchmark, three strategies are proposed to optimize the academic evaluation function of the recommendation-propagation model, including controlling the rate of big peers and small peers in evaluation information, choosing the appropriate method of evaluating objects, and assigning weight to eachpaper recommender. Based on validating the effects of the optimization strategies with simulation experiments, this paper proposes an academic paper's evaluation method, which automatically computes influence index, quality index and value index to measure the academic contribution of papers through users' recommendation-propagation behaviors.
Hui Shumin
. Evaluation Method of Academic Paper Based on the Recommendation-propagation Model[J]. Library and Information Service, 2014
, 58(04)
: 85
-93
.
DOI: 10.13266/j.issn.0252-3116.2014.04.014
[1] 吴建国.国立科研机构经费使用效益比较研究[J].科研管理, 2011, 32(5): 163-168.
[2] Lutz B.Scientificpeer review:An analysis of the peer review process from the perspective of sociology of science theories[J].Human Architecture: Journal of The Sociology of Self-Knowledge, 2008, 6(2): 23-38.
[3] 段文奇, 惠淑敏.基于协同过滤的论文推荐-传播平台模型研究[J].科学学研究, 2012, 30(10):24-29.
[4] Bruno S F, Katja R.Do rankings reflect research quality?[J].Journal of Applied Economics, 2010, 8(1): 1-38.
[5] 蔡琼, 苏丽, 丁宇.从行政主导转向国家主导: 我国科研评价制度的理性选择[J].科学学与科学技术管理, 2009, 30(9): 35-39.
[6] 王莉华.同行评议科研评价的运行管理: 英国RAE案例的启示[J].中国高教研究, 2012, 27(5): 53-57.
[7] Lawrence S, Aaron L.Citation rates in mathematics a study of variation by subdiscipline[J].Scientometrics, 2012, 91(3): 911-924.
[8] MacRoberts M H, MacRoberts B R.Problems of citation analysis:A study of uncited and seldom-cited influences[J].Journal of the American Society for Information Science and Technology, 2010, 61(1):1-13.
[9] Zhou Yanbo, Lv Linyuan, Li Menghui.Quantifying the influence of scientists and their publications distinguishing between prestige and popularity[J].New Journal of Physics, 2012, 14 (033033): 1-17.
[10] Buschman M, Michalek A.Are alternative metrics still alternative[J].Bulletin of the Association for Information Science and Technology, 2013, 39(4): 35-39.
[11] Hirsch J E.An index to quantify an individual's scientific research output[J].Proceedings of the National Academy of Sciences of the United States, 2005, 102(46):16569-16572.
[12] Saha S, Saint S, Christakis D A.Impact factor:A valid measure of journal quality[J].Journal of the Medical Library Association, 2003, 91(1): 42-46.
[13] 叶继元.学者评价期刊与引文评价期刊异同之思考——以史学学术期刊评价为例[J].中国图书馆学报, 2008, 34(4): 23-28.
[14] 刘宇, 叶继元, 袁曦临.图书情报学期刊的分层结构:基于同行评议的实证研究[J].中国图书馆学报, 2011, 37(2): 105-114.
[15] Hwang San-Yih, Yang Wan-Shiou, Ting Kang-Di.Automatic index construction for multimedia digital libraries[J].Information Processing and Management, 2010, 46(3): 295-307.
[16] 常富洋, 林鸿飞, 许侃.基于用户向量扩展的协同推荐方法[J].情报学报, 2010, 29(4): 688-694.
[17] 魏建良, 朱庆华.基于社会化标注的个性化推荐研究进展[J].情报学报, 2010, 29(4): 625-633.
[18] 胡昌平, 孙高岭.个性化网络协同推荐服务的扩展及其实现[J].中国图书馆学报, 2008, 34(5): 61-64.
[19] 桑艳艳, 刘培刚, 李勇.拟合用户兴趣演变特性的协作过滤推荐算法[J].情报学报, 2009, 28(1): 109-113.
[20] Hwang San-Yih, Hsiung Wen-Chiang, Yang Wan-Shiou.Aprototype WWW literature recommendation system for digital libraries[J].Online Information Review, 2003, 27(3): 169-182.
[21] Hwang San-Yih, Chuang Shi-Min.Combiningarticle content and Web usage for literature recommendation in digital libraries[J].Online Information Review, 2004, 28(4): 260-272.
[22] Ding Ying, Liu Xiaozhong, Guo Chun, et al.The distribution of references across texts:Some implications for citation analysis[J].Journal of Informetrics, 2013, 7 (3): 583-592.