[Purpose/Significance] This paper analyzes the novelty of scientific and technical literature in combination with time series, evaluates its innovativeness from the perspective of historical development, and assists in the evaluation of representative works of scientific and technical literature.[Method/Process] This paper proposed a question-method matrix for scientific and technical literature that considers time series and was used for novelty assessment of a single literature. First, this method used pattern matching and vocabulary matching to extract the research questions and research methods of the literature. Secondly, the Jaccard coefficient was used to calculate the text similarity to cluster similar texts. Next, the problem-method matrix was constructed for assessing the time-relevant novelty of the literature and presented the assessment results in the form of a visual matrix.[Result/Conclusion] In the experiment, 222 papers published in 2019-2021 and classified as TP391.1 are selected as the dataset to verify the effectiveness and feasibility of the method proposed in this paper. The results show that the method can assist in novelty evaluation in the evaluation of representative works.
[1] 科技部. 科技部印发《关于破除科技评价中"唯论文"不良导向的若干措施(试行)》的通知[EB/OL].(2020-02-17)[2022-02-28]. http://www.most.gov.cn/xxgk/xinxifenlei/fdzdgknr/fgzc/gfxwj/gfxwj2020/202002/t20200223_151781.html.
[2] 谢珍,马建霞,胡文静.学术代表作评价:方法述评与研究展望[J].情报理论与实践,2021,44(12):190-196.
[3] 柴嘉琪,陈仕吉.论文新颖性测度研究综述[J].农业图书情报学报,2020,32(10):56-61.
[4] 闻浩,鲁立.科技期刊论文质量评价方法及相关研究[J].情报工程,2017,3(5):60-67.
[5] MARSH H W, JAYASINGHE U W, BOND N W. Improving the peer-review process for grant applications:reliability, validity, bias, and generalizability[J]. American psychologist, 2008, 63(3):160.
[6] 玄兆辉.中国国家创新调查制度建设研究与展望[J].科学管理研究,2018,36(5):15-18.
[7] 罗卓然,王玉琦,钱佳佳,等.学术论文创新性评价研究综述[J].情报学报,2021,40(7):780-790.
[8] COSTANZO B P, SÁNCHEZ L E. Innovation in impact assessment theory and practice:how is it captured in the literature?[J]. Environmental impact assessment review, 2019, 79:106289.
[9] LEE Y, WALSH J P, WANG J, et al. Creativity in scientific teams:unpacking novelty and impact[J]. Research policy, 2015, 44 (3):684-697.
[10] HOFSTRA B, KULKARNI V V, MUNOZ-NAJAR GALVEZ S, et al. The diversity-innovation paradox in science[J]. Proceedings of the National Academy of Sciences, 2020, 117(17):9284-9291.
[11] 张金柱,王秋月,仇蒙蒙.颠覆性技术识别研究进展综述[J/OL].数据分析与知识发现:1-27[2022-06-30].http://kns.cnki.net/kcms/detail/10.1478.g2.20220304.1437.002.html.
[12] WANG Z, WANG K, LIU J, et al. Measuring the innovation of method knowledge elements in scientific literature[J]. Scientometrics, 2022, 127(5):2803-2827.
[13] ZHANG Y, TSAI F S. Chinese novelty mining[C]//Proceedings of the 2009 conference on empirical methods in natural language processing. Stroudsburg:Association for Computational Linguistics, 2009, 3:1561-1570.
[14] JEON D, AHN J M, KIM J, et al. A doc2vec and local outlier factor approach to measuring the novelty of patents[J]. Technological forecasting and social change, 2022, 174:121294.
[15] 陈斯斯,董立平,许丹,等.三种信息粒度下的新颖性探测理论及其应用[J].中华医学图书情报杂志,2016,25(11):16-19.
[16] 李鲲. 面向科技文献自动摘要的科研事件抽取研究[D]. 北京:中国科学技术信息研究所,2017.
[17] 王小玉,董诚,曾文.科技政策语义分析方法研究[J].情报工程,2015,1(6):102-108.
[18] 杨建林,钱玲飞.基于关键词对逆文档频率的主题新颖度度量方法[J].情报理论与实践,2013,36(3):99-102.
[19] 许丹,徐爽,陈斯斯,等.基于自然语言词对法的文献主题新颖性探测研究[J].图书情报工作,2018,62(8):130-138.
[20] YANG J, LU W, HU J, et al. A novel emerging topic detection method:a knowledge ecology perspective[J]. Information processing & management, 2022, 59(2):102843.
[21] 王艳艳,张均胜,乔晓东,等. 基于问题-方法矩阵的文献新颖性评估方法[J]. 情报理论与实践,2021,44(2):90-95.
[22] 钱佳佳,罗卓然,陆伟.基于问题-方法组合的科技论文新颖性度量与创新类型识别[J].图书情报工作,2021,65(14):82-89.
[23] CHEN C, CHEN Y, HOROWITZ M, et al. Towards an explanatory and computational theory of scientific discovery[J]. Journal of informetrics, 2009, 3(3):191-209.
[24] UZZI B, MUKHERJEE S, STRINGER M, et al. Atypical combinations and scientific impact[J]. Science, 2013, 342(6157):468-472.
[25] 任海英,王德营,王菲菲. 主题词组合新颖性与论文学术影响力的关系研究[J]. 图书情报工作,2017(9):87-93.
[26] MATSUMOTO K, SHIBAYAMA S, KANG B, et al. Introducing a novelty indicator for scientific research:validating the knowledge-based combinatorial approach[J]. Scientometrics, 2021, 126(8):6891-6915.
[27] WANG J, VEUGELERS R, STEPHAN P. Bias against novelty in science:a cautionary tale for users of bibliometric indicators[J]. Research policy, 2017, 46(8):1416-1436.
[28] BORNMANN L, TEKLES A, ZHANG H H, et al. Do we measure novelty when we analyze unusual combinations of cited references? a validation study of bibliometric novelty indicators based on F1000Prime data[J]. Journal of informetrics, 2019, 13(4):100979.
[29] 罗芳琼,吴春梅.时间序列分析的理论与应用综述[J].柳州师专学报,2009,24(3):113-117.
[30] 徐珍珍,张均胜,刘文斌.科技文献中技术关联自动发现方法研究[J].图书情报工作,2021,65(20):113-122.
[31] 王海林,张雅君.基于LDA的长短文本分类比较[J].数字技术与应用,2016(10):230.
[32] 谢红.基于词频比的改进Jaccard系数文本相似度计算[J].内江科技,2021,42(8):27-2.
[33] 秦岩,代君,廖莹驰.学术会议论文新颖性测度研究——以计算机学科人工智能领域为例[J].情报科学,2021,39(1):104-110.
