[Purpose/significance] Innovation is the essence requirement of academic papers, and how to effectively evaluate the innovation of academic papers has been concerned about by domestic and foreign experts and scholars. The development of information technology makes it possible to automatically evaluate papers' innovation based on the content using computers. [Method/process] This paper presents a method to evaluate papers' innovation based on the research theme comparing. Firstly, keygraph algorithms is used to extract keywords which represent papers' theme.Then, the similarity of the research theme and the scientific research front theme is calculated.Lastly, a comprehensive model is presented to determine the level of papers' innovation bytwo external indicators includingthe journal impact factor and altmetrics. [Result/conclusion] An empirical study of carbon nanotube field demonstrated thatthis method can evaluate papers' innovation from the perspective of papers' contents effectively, quickly and accurately.
Yang Jing
,
Wang Fang
,
Bai Rujiang
. A Method to Evaluate Academic Papers' Innovation Based on the Research Theme Comparing[J]. Library and Information Service, 2018
, 62(17)
: 75
-83
.
DOI: 10.13266/j.issn.0252-3116.2018.17.010
[1] 逯万辉,谭宗颖.学术成果主题新颖性测度方法研究——基于Doc2Vec和HMM算法[J].数据分析与知识发现,2018(3):22-29.
[2] 杨锋,梁棵,苟清龙,等.同行评议制度缺陷的根源及完善机制[J].科学学研究,2008(3):569-572.
[3] 白如江,杨京,王效岳.单篇学术论文评价研究现状与发展趋势[J].情报理论与实践,2015,38(11):11-17.
[4] UZZI B, MUKHERJEE S, STRINGER M, et al. Atypical combinations and scientific impact[J]. Science,2013, 342(6157):468-472.
[5] 沈律.科技创新的一般均衡理论——关于科技成果创新度评价的科学计量学分析[J].科学学研究, 2003(2):205-209.
[6] 任海英,王德营,王菲菲.主题词组合新颖性与论文学术影响力的关系研究[J].图书情报工作,2017,61(9):87-93.
[7] 沈阳.一种基于关键词的创新度评价方法[J].情报理论与实践,2007(1):125-127.
[8] YOGATAMA D, HEILMAN M, O'Connor B, et al. Predicting a scientific community's response to an article[C]//Proceedings of the Conference on Empirical Methods in Natural Language Processing. Edinburgh:Association for Computational Linguistics, 2011:594-604.
[9] 杨建林,钱玲飞.基于关键词对逆文档频率的主题新颖度度量方法[J].情报理论与实践,2013,36(3):99-102.
[10] 朱大明.参考文献的主要作用与学术论文的创新性评审[J].编辑学报,2004(2):91-92.
[11] 索传军.知识转移视角下的学术论文老化与创新研究[J].图书情报工作, 2014,58(5):5-12.
[12] 袁曦临,常娥.网络发表学术论文的影响力评价研究[J].图书情报工作,2011,55(10):51-54.
[13] 陈建青.对我国学术论文创新性评审的几点思考[J].青年记者, 2013(18):33-35.
[14] 周露阳.论审评学术论文创新因素的指标体系[J].编辑学报, 2006(1):68-70.
[15] HEINZE T, SHAPIRA P, ROGERS J, et al. Creativity capabilities and the promotion of highly innovative research in Europe and the United States[J/OL].[2018-05-10]. http://www.crea-ei2.org/2010/07/creativity-capabilities-and-the-promotion-of-highly-innovative-research-in-europe-and-the-united-states/.
[16] 叶亮,路琳.基于有用性与新颖性维度区分的创造力概念及其影响因素研究[J].科技管理究,2015,35(18):252-258.
[17] 郭红梅, 张智雄.基于图挖掘的文本主题识别方法研究综述[J].中国图书馆学报, 2015(6):97-108.
[18] YANG M, ZHANG L, YANG J, et al. Robust sparse coding for face recognition[C]//Proceedings of IEEE conference on computer vision and pattern recognition (CVPR).Shanghai:IEEE, 2011:625-632.
[19] OHSAWA Y, BENSON N E, YACHIDA M. KeyGraph:automatic indexing by co-occurrence graph based on building construction metaphor[C]//Proceedings of IEEE international forum on Research and technology advances in digital libraries. Washington:IEEE, 1998:12-18.
[20] 白如江, 杨振瑜, 王效岳.基于KeyGraph关键词抽取的长句查询扩展技术研究[J]. 情报理论与实践, 2014(6):123-127.
[21] ZHANG M, SONG R, LIN C, et al. Expansion-based technologies in finding relevant and new information:THUTREC 2002 Novelty Track Experiments[C]//Proceedings of the 11th text retrieval conference. Gaithersburg:National Institute of Standards and Technology, 2002:586-590.
[22] ALLAN J, WADE C, BOLIVAR A. Retrieval and novelty detection at the sentence level[C]//Proceedings of the 26th annual international ACM SIGIR conference on research and development in informaion retrieval. New York:ACM, 2003:314-321.
[23] ZHANG Y, CALLAN J, MINKA T. Novelty and redundancy detection in adaptive filtering[C]//Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval. New York:ACM, 2002:81-88.
[24] 王贤文,刘趁,毛文莉.数字出版时代的科学论文综合评价研究[J].中国科技期刊研究,2014,25(11):1391-1396.
[25] 贾品, 李晓斌, 王金秀.几种典型综合评价方法的比较[J].中国医院统计, 2008(4):351-353.
