SPECIAL TOPIC: A Thematic Study of Data-Driven Academic Evaluation Paradigms

Novelty Measurement of Academic Literature Based on the Innovative Knowledge Elements Genealogy

  • Rong Juntao ,
  • Suo Chuanjun ,
  • Zhou Yanting ,
  • Li Yiting
Expand
  • School of Information Resource Management, Renmin University of China, Beijing 100872

Received date: 2023-08-10

  Revised date: 2023-11-03

  Online published: 2024-01-16

Abstract

[Purpose/Significance] The paper evaluation based on “frequency” and “citation” essentially evaluates the “influence” of academic papers, which is not completely equivalent to academic innovation. Measuring the novelty from the content and semantic levels is a new approach for evaluating the innovation of academic papers. [Method/Process] This study followed the data-driven academic evaluation paradigm. Firstly, it constructed a conceptual model of the innovative knowledge elements genealogy on classification and comparison. Secondly, it proposed a model for measuring the novelty of academic papers on the innovative knowledge elements genealogy. Finally, it empirically verified the applicability of the model. [Result/Conclusion] The empirical results indicate that the novelty measurement model is able to measure the novelty of academic papers at the level of semantic content on the innovative knowledge elements genealogy and the idea of classification and comparison. However, the model also suffers from the limitation of genealogical applicability.

Cite this article

Rong Juntao , Suo Chuanjun , Zhou Yanting , Li Yiting . Novelty Measurement of Academic Literature Based on the Innovative Knowledge Elements Genealogy[J]. Library and Information Service, 2024 , 68(1) : 27 -38 . DOI: 10.13266/j.issn.0252-3116.2024.01.003

References

[1] 索传军, 于果鑫. 学术论文研究亮点的语言学特征与分布规律研究[J]. 图书情报工作, 2020, 64(9): 104-113. (SUO C J, YU G X. Exploration of the research “highlights” in academic papers[J]. Library and information service, 2020, 64(9): 104-113.)
[2] 索传军, 盖双双. 单篇学术论文的评价本质、问题及新视角分析[J]. 情报杂志, 2018, 37(6): 102-107. (SUO C J, GAI S S. Analysis on the essence, problems and new perspective of individual academic paper evaluation[J]. Journal of intelligence, 2018, 37(6): 102-107.)
[3] 索传军. 学术评价论[M]. 北京: 科学技术文献出版社, 2020: 198-207. (SUO C J. On academic evaluation [M]. Beijing: Scientific and Technical Documentation Press, 2020: 198-207.)
[4] 曹树金, 曹茹烨. 情报学论文创新性评价研究——LDA和SVM融合方法的应用[J]. 图书情报知识, 2022, 39(4): 56-67. (CAO S J, CAO R Y. Evaluation of paper innovativeness in information science by a method integrated of LDA and SVM[J]. Documentation, information & knowledge, 2022, 39(4): 56-67.)
[5] 沈阳. 一种基于关键词的创新度评价方法[J]. 情报理论与实践, 2007, 30(1): 125-127. (SHEN Y. A keyword-based innovation evaluation method[J]. Information studies: theory & application, 2007, 30(1): 125-127.)
[6] 张金柱, 张晓林. 利用引用科学知识突变识别突破性创新[J]. 情报学报, 2014, 33(3): 259-266. (ZHANG J Z, ZHANG X L. Identification of radical innovation based on mutation of cited scientific knowledge[J]. Journal of the China Society for Scientific and Technical Information, 2014, 33(3): 259-266.)
[7] 谢珍, 马建霞, 胡文静. 面向代表作评价的学术论文创新性测度方法[J]. 情报理论与实践, 2022, 45(7): 81-88. (The innovation measurement method for academic papers oriented to the evaluation of representative works[J]. Information studies: theory & application, 2022, 45(7): 81-88.)
[8] 杨建林, 钱玲飞. 基于关键词对逆文档频率的主题新颖度度量方法[J]. 情报理论与实践, 2013, 36(3): 99-102. (YANG J L, QIAN L F. Theme novelty measurement based on inverse document frequency of keyword pairs[J]. Information studies: theory & application, 2013, 36(3): 99-102.)
[9] 迟培娟, 丁洁兰, 冷伏海. 突破性论文的三元计量特征及识别研究——以生物医学领域为例[J]. 情报学报, 2022, 41(7): 663-675. (CHI P J, DING J L, LENG F H. Characteristics of the technology impact of breakthrough papers in biology and medicine [J]. Journal of the China Society for Scientific and Technical Information, 2022, 41(7): 663-675.)
[10] 钱佳佳, 罗卓然, 陆伟. 基于问题—方法组合的科技论文新颖性度量与创新类型识别[J]. 图书情报工作, 2021, 65(14): 82-89. (QIAN J J, LUO Z R, LU W. Novelty measurement and innovation type identification of scientific literature based on question-method combination[J]. Library and information service, 2021, 65(14): 82-89.)
[11] 钱玲飞, 杨建林, 张莉. 基于关键词分析的学科创新力比较——以情报学图书馆学为例[J]. 情报理论与实践, 2011, 34(1): 117-120. (QIAN L F, YANG J L, ZHANG L. Disciplinary creativity comparison based on keyword analysis[J]. Information studies: theory & application, 2011, 34(1): 117-120.)
[12] 侯剑华, 王东毅. 基于SAO-ADV模型的学术论文创新性的测度方法研究[J]. 情报理论与实践, 2020, 43(11): 129-136. (HOU J H, WANG D Y. Research on innovation measurement method of academic papers based on SAO-ADV model[J]. Information studies: theory & application, 2020, 43(11): 129-136.)
[13] 杨京, 王芳, 白如江. 一种基于研究主题对比的单篇学术论文创新力评价方法[J]. 图书情报工作, 2018, 62(17): 75-83. (YANG J, WANG F, BAI R J. A method to evaluate academic papers' innovation based on the research theme comparing [J]. Library and information service, 2018. 62(17): 75-83.)
[14] 逯万辉, 谭宗颖. 学术成果主题新颖性测度方法研究——基于Doc2Vec和HMM算法[J]. 数据分析与知识发现, 2018, 2(3): 22-29. (LU W F, TAN Z Y. Measuring novelty of scholarly articles [J]. Data analysis and knowledge discovery, 2018, 2(3): 22-29.)
[15] 曹树金, 曹茹烨. 基于知识图谱的科技论文创新点动态识别研究[J]. 现代情报, 2022, 42(12): 22-41, 82. (CAO S J, CAO R Y. Research on dynamic recognition of innovation points in scientific papers based on knowledge graph[J]. Journal of modern information, 2022, 42(12): 22-41, 82.)
[16] 戎军涛, 吴鹏飞, 李华. 面向知识发现的学术文献内容情景模型构建研究[J]. 情报理论与实践, 2019, 42(3): 153-159. (RONG J T, WU P F, LI H. Construction of academic literature content scenario model for knowledge discovery[J]. Information studies: theory & application, 2019, 42(3): 153-159.)
[17] 索传军. 知识转移视角下的学术论文老化与创新研究[J]. 图书情报工作, 2014, 58(5): 5-12. (SUO C J. Study on obsolescence and innovation of academic papers from perspective of knowledge transfer[J]. Library and information service, 2014, 58(5): 5-12.)
[18] 索传军, 张璇, 李木子. 论评价参照系的内涵、作用与构建——兼论学术谱系的功能与作用[J]. 中国人民大学学报, 2022(4): 180-190. (SUO C J, ZHANG X, LI M Z. On the referential frame of academic evaluation and the function of academic genealogy[J]. Journal of Renmin university of China, 2022(4): 180-190.)
[19] 刘益东. 问题谱系比较评议法——同行评议方法新探[J]. 自然辩证法研究, 1998, 14(10): 31-35. (LIU Y D. Comparative evaluation method of problem genealogy: a new exploration of peer evaluation method[J]. Studies in dialectics of nature, 1998, 14(10): 31-35.)
[20] 汪信砚. 哲学社会科学创新论[M]. 北京: 中国社会科学出版社, 2014: 61-64. (WANG X Y. Innovation in philosophy and social sciences [M]. Beijing: China Social Sciences Press, 2014: 61-64.)
[21] CHRISTENSEN C M. The innovator's dilemma: when new technologies cause great firms to fail[M]. Boston: Harvard Business School Press, 1997.
[22] 索传军, 盖双双, 周志超. 认知计算——单篇学术论文评价的新视角[J]. 中国图书馆学报, 2018, 44(1): 50-61. (SUO C J, GAI S S, ZHOU Z C. Cognitive computing: a new perspective for evaluating the individual academic paper[J]. Journal of library science in China, 2018, 44(1): 50-61.)
[23] 索传军, 王春明. 基于引文的知识转移类型与方式分析[J]. 情报理论与实践, 2023, 46(4): 114-121. (SUO C J, WANG C M. Analysis of knowledge transfer types and modes based on citations[J]. Information studies: theory & application, 2023, 46(4): 114-121.)
[24] MILLER G A. WordNet: a lexical database for English[J]. Communications of the ACM, 1995, 38(11): 39-41.
[25] 梅家驹, 竺一鸣, 高蕴琦, 等. 同义词词林[M]. 上海: 上海辞书出版社, 1983. (MEI J J, ZHU Y M, GAO Y Q, et al. Chinese Thesaurus [M]. Shanghai: Shanghai Lexicographical Publishing House, 1983.)
[26] 董振东. 语义关系的表达和知识系统的建造[J]. 语言文字应用, 1998(3): 76-82. (DONG Z D. The expression of semantic relationships and the construction of knowledge systems[J]. Applied linguistics, 1998(3): 76-82.)
[27] 索传军, 盖双双. 知识元的内涵、结构与描述模型研究[J]. 中国图书馆学报, 2018, 44(4): 54-72. (SUO C J, GAI S S. The connotation, structure and description model of knowledge Unit[J]. Journal of library science in China, 2018, 44(4): 54-72.)
[28] 王晓光, 孙梦琳, 宋宁远. 科学论文功能单元本体设计与设计应用实验[J]. 中国图书馆学报, 2018, 44(4): 73-88. (WANG X G, SUN M L, SONG N N. Design and application of scientific paper functional units ontology[J]. Journal of library science in China, 2018, 44(4): 73-88.)
[29] 孙建军, 裴雷, 蒋婷. 面向学科领域的学术文献语义标注框架研究[J]. 情报学报, 2018, 37(11): 1077-1086. (SUN J J, PEI L, JIANG T. Research on semantic annotation in academic literature[J]. Journal of the China Society for Scientific and Technical Information, 2018, 37(11): 1077-1086.)
[30] 李春秋, 徐增旭林, 宋宁远, 等. 基于纳米出版物的中文学位论文语义组织研究[J]. 中国图书馆学报, 2021, 47(5): 97-115. (LI C Q, XU Z X L, SONG N Y, WANG X G. Nanopublication-based semantic organization of Chinese dissertation[J]. Journal of library science in China, 2021, 47(5): 97-115.)
[31] 化柏林, 刘一宁, 郑彦宁. 针对学术定义的抽取规则构建方法研究[J]. 情报理论与实践, 2011, 34(12): 5-9. (HUA B L, LIU Y N, ZHENG Y N. Studies on methods of formulating rules for academic definition extraction[J]. Information studies: theory & application, 2011, 34(12): 5-9.)
[32] 索传军, 赖海媚. 学术论文问题知识元的类型与描述规则[J]. 中国图书馆学报, 2021, 47(2): 95-109. (SUO C J, LAI H M. Types and description rules of problem knowledge units in academic papers[J]. Journal of library science in China, 2021, 47(2): 95-109.)
[33] 李贺, 杜杏叶. 基于知识元的学术论文内容创新性智能化评价研究[J]. 图书情报工作, 2020, 64(1): 93-104. (LI H, DU X Y. Research on intelligent evaluation for the content innovation of academic papers [J]. Library and information service, 2020, 64(1): 93-104.)
[34] 赵蓉英, 张心源. 基于知识元抽取的中文智库成果描述规则研究[J]. 图书与情报, 2017(1): 119-127. (ZHAO R Y, ZHANG X Y. On descriptive rules of Chinese think-tank products based on knowledge element extraction[J]. Library & information, 2017(1): 119-127.)
[35] 牛丽慧, 欧石燕. 纳米出版物及其应用研究进展[J]. 图书情报工作, 2018, 62(7): 125-133. (NIU L H, OU S Y. Research advances of nanopublication and its applications[J]. Library and information service, 2018, 62(7): 125-133.)
[36] 中国图书馆学会. 中国图书馆学学科史[M]. 北京: 中国科学技术出版社, 2014: 184-185. (Library Society of China. History of library science in China[M]. Beijing: China Science and Technology Press, 2014: 184-185.)
[37] 马恒通. 新中国图书馆学研究对象争鸣50年(1949—1999)[J]. 图书馆, 2000(1): 22-27, 37. (MA H T. On the contention of study object of library science in China in the past 60 years. [J]. Library, 2000(1): 22-27, 37.)
[38] 王子舟. 图书馆学研究对象的认识过程及范式特征[J]. 江西图书馆学刊, 2002(3): 4-8. (WANG Z Z. Cognitive process and paradigm characteristics of the research object in library science[J]. Journal of the library science in Jiangxi, 2002(3): 4-8.)
[39] 徐引篪, 霍国庆. 图书馆学研究对象的认识过程——兼论资源说[J]. 中国图书馆学报, 1998(3): 3-13. (XU Y C, HUO G Q. Cognition process of research objects in library science: on the resource[J]. Journal of library science in China, 1998(3): 3-13.)
[40] 许丹, 徐爽, 陈斯斯, 等. 基于自然语言词对法的文献主题新颖性探测研究[J]. 图书情报工作, 2018, 62(8): 130-138. (XU D, XU S, CHEN S S. Document theme novelty detection research based on natural language pairs[J]. Library and information service, 2018, 62(8): 130-138.)
[41] 叶继元. 人文社会科学评价体系探讨[J]. 南京大学学报(哲学·人文科学·社会科学), 2010(1): 97-110, 160. (YE J Y. Approaching evaluation system in humanities and social sciences[J]. Journal of Nanjing University (philosophy humanities and social sciences), 2010(1): 97-110, 160.)
[42] 盖双双. 学术论文的价值评价研究[D]. 北京: 中国人民大学, 2020: 143-144. (GAI S S. Research on the value evaluation of academic papers[D]. Beijing: Renmin University of China, 2020: 143-144.)
[43] 孙震, 冷伏海. 基于知识元的新型科学计量范式探析[J]. 情报学报, 2017, 36(6): 555-564. (SUN Z, LENG F H. Research on the new paradigm of scientometrics based on knowledge element[J]. Journal of the China Society for Scientific and Technical Information, 2017, 36(6): 555-564.)
[44] 索传军. 论学术评价的价值尺度——兼谈“唯论文”问题的根源[J]. 中国社会科学评价, 2021(1): 122-131, 160. (SUO C J. The value yardstick for academic evaluation: the root of the problem of “only publications count”[J]. China social science review, 2021(1): 122-131, 160.)
Outlines

/