[Purpose/significance]To solve some defects of peer review and scientometrics methods in the evaluation of philosophy and social sciences academic outputs, the reform and realization of the evaluation of the academic achievements are explored, especially the evaluation index system of the academic achievements of philosophy and social sciences based on the big data thinking are designed.[Method/process]Based on the comparative analysis and comprehensive analysis, this paper analyzes the disadvantages of the traditional philosophy and social sciences evaluation methods, and then analyzes the changes brought by the big data to the philosophy and social sciences evaluation, finally, it puts forward the philosophy and social sciences evaluation strategies and the index systems based on the big data environment.[Result/conclusion]In big data era, it is possible to analyze the semantics and its relevance based on all-round academic contents and activity data. By using the citation content and behavior evaluation, the academic activities-centered whole process dynamic evaluation, academic value and social function evaluation, value of academic achievements of philosophy and social sciences can be truly, comprehensively and objectively reflected. Based on above research, an index system for evaluation of academic achievements of philosophy and social sciences is constructed, which is composed of two first-level indicators, five two-level indicators and 34 three-level indicators.
[1] 苏新宁. 学术评价与学术考核奖励机制的辩证观[J]. 西南民族大学学报(人文社科版),2017,38(9):1-5.
[2] 李冲,苏永建.学术评价:量化模式的反思与超越[J].自然辩证法研究,2017,33(2):59-63.
[3] 朱剑.大数据之于学术评价:机遇抑或陷阱?[J].中国青年社会科学,2015(4):66-78.
[4] 赵丹群.定量化学术评价研究的最新进展[J].情报理论与实践,2017,40(4):133-137.
[5] 彭秋归. 哲学社会科学评价具有意识形态属性[EB/OL].[2017-08-12].http://theory.gmw.cn/2016-04/21/content_19796235.htm.
[6] 姜春林.人文社会科学研究成果评价的矛盾及其调适[J].西南民族大学学报(人文社科版),2015,36(12):233-236.
[7] 代金平.哲学社会科学发展与学术评价体系[J]. 重庆社会科学,2016(6):13.
[8] 韩毅,夏慧.时间因素视角下科研人员评价的Pt指数研究[J].中国图书馆学报,2015,41(6):73-85.
[9] SELVARAJOO K. Measuring merit:take the risk[J].Science,2015,347(6218):139-140.
[10] 杨瑞仙,梁艳平.国内外高校科研评价方法比较研究[J].情报杂志,2015,34(9):107-110.
[11] BROOKS T A. Evidence of complex citer motivations[J].Journal of the American Society for Information Science,1986,37(1):34-36
[12] PINSKI G,NARIN F. Citation influence for journal aggregates of scientific publications:theory with applications to literature of physics[J].Information processing & management, 1976,12(5):297-312.
[13] SMALL H. Cited documents as concept symbols[J].Social studies of science, 1978,8(3):327-340.
[14] 丁卫.引文分析的演变与展望[J].情报科学,1992(1):65-72.
[15] 仲伟民.量化评价扼杀人文学术[J].澳门理工学报,2015(3):100-109.
[16] 王晓莉,叶良均,徐飞,等. SCI作为科研成果评价标准的局限性研究[J].自然辩证法研究,2001(11):41-47.
[17] GARFIELD E. Can citation indexing be automated?[C]//Proceedings of symposium on statistical association methods for mechanized documentation.Washington:National Bureau of Standards Miscellaneous Publication,1964:189-192.
[18] 张耀铭.学术评价存在的问题、成因及其治理[J].清华大学学报(哲学社会科学版),2015,30(6):73-88,190-191.
[19] 武夷山,王海燕. 无中生有与唤醒"睡美人"[J].情报学报,2014(2):113.
[20] GLANZEL W,GARFIEL E.The myth of delayed recognition[J].Scientist,2004,18(11):8-9.
[21] VAN RAAANA A F J.Sleeping beauties in science[J].Scientometrics,2004,59(3):467-472.
[22] 韩毅.非正式交流回归语境下科技评价的融合路径取向[J].中国图书馆学报,2016,42(4):64-74.
[23] TAYLOR M. Exploring the boundaries:how altmetrics can expand our vision of scholarly communication and social impact[J]. Information standards quarterly, 2013,25(2):27-32.
[24] SPAAPEN J, VAN DROOGE L. Introducing ‘productive interactions’ in social impact assessment[J]. Research evaluation,2011,20(3):211-218.
[25] SMALL H. Citation context analysis[J].Progress in communication science,1982(3):287-312.
[26] 陆伟,孟睿,刘兴帮. 面向引用关系的引文内容标注框架研究[J].中国图书馆学报,2014,40(6):93-104.
[27] ZHANG G, DING Y, MILOJEVIC S. Citation content analysis (CCA):a framework for syntactic and semantic analysis of citation content[J]. Journal of the American Society for Information Science and Technology, 2013,64(7):1490-1503.
[28] SMALL H,KLAVANS R. Identifying scientific breakthroughs by combining co-citation analysis and citation context[C]//Proceedings of the 13th international conference of the International Society for Scientometrics & Informetrics. Leuven:International Society for Scientometrics & Informetrics,2011:783-793.
[29] DING Y. Content-based citation analysis:the next generation in citation analysis[EB/OL].[2017-08-26].http://www.lis.illinois.edu/events/2012/09/26/content-based-citation-analysis-next-generation-citation-analysis.
[30] 刘清堂,张思,范桂林,等. 教育大数据视角下的内容语义分析模型及应用研究[J].电化教育研究,2017,38(1):54-61,93.
[31] CRONIN B. Progress in documentation:Invisible colleges and information transfer,are view and commentary with particular reference to the social sciences[J].Journal of documentation, 1982(38):212-236.
[32] PRICE J. Little science, big science-and beyond[M]. NewYork:Columbia University Press, 1986.
[33] 黄水清, 王超.网络环境下非正式信息交流的概念、类别与特点[J].图书馆杂志, 2004(6):8-11.
[34] JULIA L.Let's make science metrics more scientific[J].Nature, 2010, 464(7288):488-4899.
[35] MCNUTT M.The measure of research merit[J].Science, 2014, 346(6214):1155.
[36] GODIN B,DORE C.Measuring the impacts of science, beyond the economic dimension[EB/OL].[2017-08-26]. http://www.csiic.ca/PDF/Godin_Dore_Impacts.pdf.
[37] BORNMANN L. What is societal impact of research and how can it be assessed? a literature survey[J]. Journal of the American Society for Information Science and Technology, 2013,64(2):217-233.
[38] HOLBROOK J B.The use of societal impacts considerations in grant proposal peer review:a comparison of five models[J]. Technology & innovation, 2010,12(3):213-224.
[39] BOAZ A, FITZPATRICK S, SHAW B. Assessing the impact of research on policy:a literature review[J]. Science & public policy,2009,36(4):255-270.
[40] BORNMANN L. Alternative metrics in scientometrics:a meta-analysis of research into three altmetrics[J].Scientometrics, 2015,103(3):1123-1144.
[41] SANUEL G N,DERRIC G E. Societal impact evaluation:exploring evaluator perceptions of the characterization of impact under the REF2014[J].Research evaluation,2015,24(3):229-241.
[42] 刘盛博,丁堃,唐德龙.引用内容分析的理论与方法[J].情报理论与实践,2015,38(10):27-32.
[43] 化柏林,王惠临. 语法开发平台的系统设计[J].情报学报, 2006, 25(2):189-196.
[44] 邱均平,赵岩杰,罗力. 科学评价中的论文分类方法研究[J]. 情报学报,2011(5):554-560.
[45] 马费成,宋恩梅.我国情报学研究分析:以ACA为方法[J]. 情报学报, 2006, 25(3):259-268.
[46] YE F Y,LEYDESFORFF L. The "academic trace" of the performance matrix:a mathematical synthesis of the h-index and the Integrated Impact Indicator (I3)[J].Journal of the Association for Information Science and Technology,2014,65(4):742-750.
[47] 贺德方.我国科技投入效率、效果评价研究[J].情报学报,2006(6):740-748.
[48] 苏新宁. 图书馆、情报与文献学学术影响力研究报告(2000-2004)——基于CSSCI的分析[J].情报学报,2006, 25(2):131-153.
[49] 陆伟,黄永,程齐凯.学术文本的结构功能识别功能框架及基于章节标题的识别[J].情报学报, 2014(9):979-985.
[50] 裴雷,孙建军.中国科技报告质量评价体系与推进策略[J].情报学报,2014(8):813-823.
[51] 李勇,邵钟钰,赵星. Altmetrics背景下的期刊多维度测评指标研究[J]. 情报学报,2017(2):190-196.
[52] 余厚强,肖婷婷,王曰芬,等.政策文件替代计量指标分布特征研究[J].中国图书馆学报,2017,43(5):57-69.
[53] 武夷山.科研评价指标纵横谈[J].中国科技奖励,2015(3):68-69.
