专题:数据驱动的学术评价范式专题研究

学术论文模糊评价方法研究

  • 牌艳欣 ,
  • 索传军 ,
  • 肖玥 ,
  • 李艺亭
展开
  • 中国人民大学信息资源管理学院 北京 100872
牌艳欣,博士研究生;肖玥,博士研究生;李艺亭,博士研究生。

收稿日期: 2023-08-10

  修回日期: 2023-11-02

  网络出版日期: 2024-01-16

基金资助

本文系国家社会科学基金项目“数据驱动的学术评价范式研究”(项目编号:21BTQ008)研究成果之一。

Research on Fuzzy Evaluation Methods of Academic Papers

  • Pai Yanxin ,
  • Suo Chuanjun ,
  • Xiao Yue ,
  • Li Yiting
Expand
  • School of Information Resources Management, Renmin University of China, Beijing 100872

Received date: 2023-08-10

  Revised date: 2023-11-02

  Online published: 2024-01-16

摘要

[目的/意义]引入模糊数学相关理论与方法,为完善现有论文评价理论和方法,探索一种实现学术论文的科学性评价的新视角。[过程/方法]借鉴模糊数学评价的理论和方法,在分析学术论文评价中的模糊性现象的基础上,探讨学术论文模糊评价的内涵、功能与作用,论证将模糊评价法应用于学术评价的科学性与合理性。在此基础上,提出学术论文模糊评价的方法与实现路径,主要通过建立学术论文的评测集和评判集,构建模糊判别函数,实现对学术论文价值的模糊评价。结合具体实例重点分析学术论文模糊评价实现路径中的几个关键性问题。[结果/结论]学术论文评价本质上是一个涉及模糊概念、模糊划分、模糊判别、模糊决策等诸多过程的复杂事件,将模糊评价思想与方法应用于学术论文评价具有明显的应用潜能和优势。

本文引用格式

牌艳欣 , 索传军 , 肖玥 , 李艺亭 . 学术论文模糊评价方法研究[J]. 图书情报工作, 2024 , 68(1) : 13 -26 . DOI: 10.13266/j.issn.0252-3116.2024.01.002

Abstract

[Purpose/Significance] How to evaluate academic papers is a focal point in the academic and scientific communities, and it is also a complex issue influenced by various factors such as academia, society, technology, and humanities. Fuzzy mathematics is a mathematical approach used to study and deal with phenomena involving fuzziness. To enhance the existing evaluation of academic paper, fuzzy mathematics is used to make scientific assessment of academic papers from a new perspective. [Process/Method] On the evaluation theory and methods of fuzzy mathematics, the paper analyzed the fuzziness in the evaluation of academic papers, discussed the connotation, function, and role of the fuzzy evaluation, and demonstrated its scientificity and rationality in academic evaluation. Then, it put forward the methods and implementation pathways for fuzzy evaluation of academic papers by establishing evaluation sets and judgment sets and constructing fuzzy discriminant functions for the value of academic papers. Finally, it pointed out several key problems in the realization of academic paper fuzzy evaluation with examples. [Result/Conclusion] The evaluation of academic papers is a complex process involving fuzzy concepts, fuzzy division, fuzzy discrimination, fuzzy decision, and so on. The application of fuzzy evaluation ideas and methods to academic paper evaluation has obvious potential and advantages.

参考文献

[1] 王曰芬, 路菲, 吴小雷. 文献计量和内容分析的比较与综合研究[J]. 图书情报工作, 2005, 49(9): 70-73. (WANG Y F, LU F, WU X L.Comparative and synthetic research on content analysis and bibliometrics[J]. Library and information service, 2005, 49(9): 70-73.)
[2] CAMPANARIO J M. Large increases and decreases in journal impact factors in only one year:the effect of journal selfcitations[J]. Journal of the American Society for Information Science and Technology, 2011, 62(2): 230-235.
[3] MIN C, BU Y, WU D, et al. Identifying citation patterns of scientific breakthroughs: a perspective of dynamic citation process[J]. Information processing & management, 2021, 58(1): 102428.
[4] MIN C, BU Y, SUN J. Predicting scientific breakthroughs based on knowledge structure variations[J]. Technological forecasting and social change, 2021, 164:120502.
[5] BETTENCOURT L M A, KAISER D I, KAUR J. Scientific discovery and topological transitions in collaboration networks[J]. Journal of informetrics, 2009, 3(3): 210-221.
[6] SU C, PAN Y, ZHEN Y, et al. PrestigeRank: a new evaluation method for papers and journals[J]. Journal of informetrics, 2011, 5(1): 1-13.
[7] 李铮, 邓三鸿, 孔嘉, 等. 学者学术影响力识别研究——基于引文全数据的视角[J]. 图书情报工作, 2020, 64(12): 87-94. (LI Z, DENG S H, KONG J, et al. Research on scholar's academic influence:from the perspective of full citation data[J]. Library and information service, 2020, 64(12): 87-94.)
[8] 魏绪秋, 姜召昊, 常霞, 等. 基于引证意图的学术论文创新性评价研究[J]. 情报理论与实践, 2023, 46(9): 24-30, 46. (WEI X Q, JIANG Z H, CHANG X. Research on the innovation evaluation of academic papers based on citing intention[J]. Information studies:theory & application, 2023, 46(9): 24-30, 46.)
[9] 谢珍, 马建霞, 胡文静. 基于多维度引用特征的学术论文评价研究[J]. 情报理论与实践, 2023, 46(8): 51-58, 76. (XIE Z, MA J X, HU W J. Research on the evaluation of academic paper based on multidimensional citation characteristics[J]. Information studies:theory & application, 2023, 46(8): 51-58, 76)
[10] PRIEM J, TARABORELLT D, GROTH P. Altmetrics: a manifesto[EB/OL]. [2023-09-01]. http://altmetrics.org/manifesto/.
[11] TAHAMTAN I, BORNMANN L. Creativity in science and the link to cited references: is the creative potential of papers reflected in their cited references?[J]. Journal of informetrics, 2018, 12(3): 906-930.
[12] KARLOVCEC M, MLADENIC D. Interdisciplinarity of scientific fields and its evolution based on graph of project collaboration and co-authoring[M]. New York: Springer, 2015.
[13] WANG J, LEE Y, WALSH J P. Funding model and creativity in science: competitive versus block funding and status contingency effects[J]. Research policy, 2018, 47(6): 1070-1083.
[14] 姜春林, 张立伟, 谷丽, 等. 知识单元视角下学术论文评价研究[J]. 情报杂志, 2014, 33(4): 29-34. (JIANG C L, ZHANG L W, GU L, et al. Research on the evaluation of academic papers from the perspective of knowledge unit[J]. Journal of intelligence, 2014, 33(4): 29-34.)
[15] HE J, CHEN C. Predictive effects of novelty measured by temporal embeddings on the growth of scientific literature[J]. Frontiers in research metrics and analytics, 2018, 3:9-12.
[16] 任海英, 王德营, 王菲菲. 主题词组合新颖性与论文学术影响力的关系研究[J]. 图书情报工作, 2017, 61(9): 87-93.(REN H Y, WANG D Y, WANG F F. Relationship between novelty of key-term combinations and papers' scientific impact[J]. Library and information service, 2017, 61(9): 87-93.)
[17] HEFFERNAN K, TEUFEL S. Identifying problems and solutions in scientific text[J]. Scientometrics, 2018, 116(2): 1367-1382.
[18] MADRCONDES C H, COSTA L C D. A model to represent and process scientific know ledge in biomedical articles with semantic web technologies[J]. Knowledge organization, 2016, 43(2): 86-101.
[19] 刘熠, 张智雄, 王宇飞, 等. 基于语步识别的科技文献结构化自动综合工具构建[J/OL]. 数据分析与知识发现, 2023:1-12. [2023-12-21] http://kns.cnki.net/kcms/detail/10.1478.G2.20230504.1651.002.html. (LIU Y, ZAHNG Z X, WNAG Y F, et al. Construction of automatic structured synthesis tool of scientific & technological literature based on move recognition[J]. Data analysis and knowledge discovery, 2023: 1-12. [2023-12-21] http://kns.cnki.net/kcms/detail/10.1478.G2.20230504.1651.002.html.)
[20] 罗卓然, 蔡乐, 钱佳佳, 等. 学术论文创新贡献句识别研究[J]. 图书情报工作, 2021, 65(12): 93-100. (LUO Z R, CAI L, QIAN J J, et al. Research on the recognition of innovative contribution sentences of academic papers[J]. Library and information service, 2021, 65(12): 93-100.)
[21] 钱佳佳, 罗卓然, 陆伟. 基于问题—方法组合的科技论文新颖性度量与创新类型识别[J]. 图书情报工作, 2021, 65(14): 82-89. (QIAN J J, LUO Z R, LU W. Novelty measurement and innovation type identification of scientific literature based on question-method combination[J]. Library and information service, 2021, 65(14): 82-89.)
[22] 章成志, 张颖怡. 基于学术论文全文的研究方法实体自动识别研究[J]. 情报学报, 2020, 39(6): 589-600. (ZAHNG C Z, ZHANG Y Y. Automatic recognition of research methods from the full-text of academic articles[J]. Journal of the China Society for Scientific and Technical Information, 2020, 39(6): 589-600.)
[23] 卢超, 章成志, 王玉琢, 等. 语义特征分析的深化——学术文献的全文计量分析研究综述[J]. 中国图书馆学报, 2021, 47(2): 110-131. (LU C, ZAHNG C Z, WNAG Y Z, et al. Strengthened analyses of semantic features:review of full-text bibliometrics of academic documents [J]. Journal of library science in China, 2021, 47(2): 110-131.)
[24] 索传军, 盖双双. 知识元的内涵、结构与描述模型研究[J]. 中国图书馆学报, 2018, 44(4): 54-72. (SUO C J, GAI S S. The connotation, structure and description model of knowledge unit[J]. Journal of library science in China, 2018, 44(4): 54-72.)
[25] 索传军, 赖海媚. 学术论文问题知识元的类型与描述规则[J]. 中国图书馆学报, 2021, 47(2): 95-109. (SUO C J, LAI H M. Types and description rules of problem knowledge units in academic papers[J]. Journal of library science in China, 2021, 47(2): 95-109.)
[26] 全国哲学社会科学工作办公室. 大数据时代的社会科学研究新范式[EB/OL]. [2023-07-30]. http://cass.cssn.cn/xueshuchengguo/jingjixuebu/201911/t20191106_5028448.shtml. (National Office of Philosophy and Social Sciences. A new paradigm of social science research in the era of big data[EB/OL]. [2023-07-30]. http://cass.cssn.cn/xueshuchengguo/jingjixuebu/201911/t20191106_5028448.shtml.)
[27] 潘教峰, 张晓林. 第四范式: 数据密集型科学发现[M]. 北京: 科学出版社, 2012: 14-18. (PAN X F, ZHANG X L. The fourth paradigm: data-intensive scientific discovery [M]. Beijing: Science Press, 2012: 14-18.)
[28] 司梦兰, 王鐾璇, 缪培琪, 等. 基于数据驱动的过程智能优化技术研究现状及其在中药先进制药中的应用展望[J]. 天津中医药大学学报, 2020, 39(5): 485-492. (SI M L, WANG B X, MIAO P Q, et al.Research progress of data driven technologies for intelligent process optimal control and prospects of its applications in advanced manufacturing of traditional Chinese medicine[J]. Journal of Tianjin University of Traditional Chinese Medicine, 2020, 39(5): 485-492.)
[29] 戴潘. 基于大数据的科学研究范式的哲学研究[J]. 哲学动态, 2016(9): 105-109. (DAI P. Philosophical research on scientific research paradigm based on big data [J]. Philosophical trends, 2016(9): 105-109.)
[30] 张耀铭. 人工智能驱动的人文社会科学研究转型[J]. 济南大学学报(社会科学版), 2019, 29(4): 20-28. (ZAHNG Y M. Transformation of humanities and social sciences research caused by artificial intelligence[J]. Journal of Jinan University (social science edition), 2019, 29(4): 20-28.)
[31] 薛亚龙, 刘如意. 论数据驱动情报侦查方法的转型[J]. 中国刑警学院学报, 2020(5): 42-47. (XUE Y L, LIU R Y.Investigation transformation of data driven intelligence[J]. Journal of Criminal Investigation Police University of China, 2020(5): 42-47.)
[32] 索传军, 于淼, 牌艳欣, 等. 数据驱动的学术评价理论框架研究[J]. 图书情报工作, 2024, 68(1): 5-12. (SUO C J, YU M, PAI Y X, et al. Research on the theoretical framework of data-driven academic evaluation[J]. Library and information service, 2024, 68(1): 5-12.)
[33] 李品, 杨建林. 大数据时代哲学社会科学学术成果评价:问题、策略及指标体系[J]. 图书情报工作, 2018, 62(16): 5-14. (LI P, YANG J L.Questions, strategies and index systems on evaluation of academic output for philosophy and social sciences in the big data era[J]. Library and information service, 2018, 62(16): 5-14.)
[34] 李贺, 杜杏叶. 基于知识元的学术论文内容创新性智能化评价研究[J]. 图书情报工作, 2020, 64(1): 93-104. (LI H, DU X Y.Research on intelligent evaluation for the content innovation of academic papers[J]. Library and information service, 2020, 64(1): 93-104.)
[35] 索传军, 盖双双, 周志超. 认知计算——单篇学术论文评价的新视角[J]. 中国图书馆学报, 2018, 44(1): 50-61. (SUO C J, GAI S S, ZHOU Z C. Cognitive computing: a new perspective for evaluating the individual academic paper[J]. Journal of library science in China. 2018, 44(1): 50-61.)
[36] 盖双双. 学术论文的价值评价研究[D]. 北京: 中国人民大学, 2018. (GAI S S. Research on the value evaluation of academic papers [D]. Beijing: Renmin University of China, 2018.)
[37] ZADEN L A.Fuzzy sets[J]. Information and control, 1965, 8: 338-353.
[38] 彭先图, 汪培庄, 白绍勤, 等. 科技管理中的综合评价方法[J]. 北京师范大学学报, 1985(3): 91-96. (PENG X T, WANG P Z, BAI S Q, et al.A synthetical method of evaluation in scientific and technological management[J]. Journal of Beijing Normal University, 1985(3): 91-96.)
[39] 范守义. 模糊数学与译文评价[J]. 中国翻译, 1987(4): 2-9. (FAN S Y.Fuzzy mathematics and translation evaluation [J]. Chinese translators journal, 1987(4): 2-9.)
[40] 赵红梅. 基于模糊评价信息的多属性决策方法研究[D]. 北京: 北京交通大学, 2021. (ZHAO H M, Research on multi-attribute decision making method based on fuzzy evaluation information [D]. Beijing: Beijing Jiaotong University, 2021.)
[41] 刘晓娜, 杜永文. 模糊数学在计算机辅助教学评估系统中的应用[J]. 电脑知识与技术, 2013, 9(1): 145-147. (LIU X N, DU Y W. The application of fuzzy mathematics in computer teaching evaluation system[J]. Computer knowledge and technology, 2013, 9(1): 145-147.)
[42] 邱香华. 模糊综合评判法在学术型硕士学位论文质量评价中的应用[J]. 西南大学学报(自然科学版), 2018, 40(11): 81-85. (QIU X H. Application of fuzzy comprehensive evaluation method in evaluating the quality of the academic master's degree thesis[J]. Journal of Southwest University (natural science edition), 2018, 40(11): 81-85.)
[43] 汪培庄, 刘锡荟. 人脑·计算机·模糊数学[J]. 大自然探索, 1987(1): 36-42. (WANG P Z, LIU X H. Human brain, computer, fuzzy mathematics [J] Discovery of nature, 1987(1): 36-42.)
[44] 索传军. 学术评价论[M]. 北京: 科学技术文献出版社, 2020. (SUO C J. Academic evaluation[M]. Beijing: Scientific and Technical Literature Press, 2020)
[45] 杜威. 评价理论[M]. 冯平, 余泽娜, 译.上海: 上海译文出版社, 2007. (DEWEY J. Theory of valuation[M]. FENG P, YU Z N, trans. Shanghai: Shanghai Translation Publishing House, 2007.)
[46] 冯平. 评价论[M]. 北京: 东方出版社, 1995. (FENG P. Evaluation theory[M]. Beijing: Oriental Press, 1995.)
[47] 夏征农. 辞海[M]. 上海: 上海辞书出版社, 1989. (XIA Z N. Cihai[M]. Shanghai: Shanghai Lexicography Publishing House, 1989.)
[48] 汪培庄, 李洪兴. 模糊信息与模糊决策[J]. 天津纺织工学院学报, 1986(S1): 107-111. (WANG F Z, LI H X. Fuzzy information and fuzzy decision[J]. Journal of Tianjin Textile Institute of Technology, 1986(S1): 107-111.)
[49] 汪培庄, 张大志. 思维的数学形式初探[J]. 高校应用数学学报, 1986(1): 85. (WANG P Z, ZAHNG D Z. Discussion on mathematical forms of thinking[J]. Journal of applied mathematics in universities, 1986(1): 85.)
[50] 文庭孝, 刘晓英. 中文文本解构与知识发现研究[J]. 图书与情报, 2009(3): 86-88, 139. (WEN T X, LIU X Y. Research on Chinese text structure analysis and knowledge discovery[J]. Library and information, 2009(3): 86-88, 139.)
[51] 索传军, 戎军涛. 知识元理论研究述评[J]. 图书情报工作, 2021, 65(11): 133-142. (SUO C J, RONG J T. Review on the theory of knowledge element[J]. Library and information service, 2021, 65(11): 133-142.)
[52] 秦岩, 代君, 廖莹驰. 学术会议论文新颖性测度研究——以计算机学科人工智能领域为例[J]. 情报科学, 2021, 39(1): 104-110. (QIN Y, DAI J, LIAO Y C. Novelty measurement of academic conference papers: taking artificial intelligence field of computer science as the example[J]. Information science, 2021, 39(1): 104-110.)
[53] 李姗, 单磊, 崔雷. 学术论文新颖性评价方式[J]. 中华医学图书情报杂志, 2020, 29(8): 71-74. (LI S, SHAN L, CUI L. Novelty assessment methods of academic papers[J]. Chinese journal of medical library and information science, 2020, 29(8): 71-74.)
[54] AMABVILE T M.The social psychology of creativity: a componential conceptualization[J]. Journal of personality and social psychology, 1983, 45:2.
[55] 杨京, 王芳, 白如江. 基于研究水平的单篇学术论文创新力评价研究——以碳纳米管材料领域为例[J]. 情报理论与实践, 2017, 40(9): 105-111. (YANG J, WANG F, BAI R J. Evaluation of a single academic paper's innovation based on the research level[J]. Information studies: theory & application, 2017, 40(9): 105-111.)
[56] 陈孝国, 张晓光, 杨悦作. 模糊可拓多属性决策理论与方法[M]. 哈尔滨: 哈尔滨工业大学出版社, 2021. (CHEN X G, ZAHNG X G, YANG Y Z. Theory and method of fuzzy extension multi-attribute decision making [M]. Harbin: Harbin Institute of Technology Press, 2021.)
[57] 王篪. 构建分类理论综合框架——基于文化社会学的视角[J]. 中国人民大学学报, 2023, 37(3): 84-97. (WANG C. Towards a comprehensive theory of classification:a cultural sociological approach [J]. Journal of Renmin University of China, 2023, 37(3): 84-97.)
[58] 李路. 数学建模与数学实验[M]. 上海: 东华大学出版社, 2013. (LI L. Mathematical modeling and mathematical experiment [M]. Shanghai: Donghua University Press, 2013.)
[59] 李柏年. 模糊数学及其应用[M]. 合肥: 合肥工业大学出版社, 2007. (LI B N. Fuzzy mathematics and its application [M]. Hefei: Hefei University of Technology Press, 2007.)
[60] 焦玉英, 符绍宏, 何绍华. 信息检索[M]. 武汉: 武汉大学出版社, 2008. (JIAO Y Y, FU S H, HE S H. Information retrieval [M]. Wuhan: Wuhan University Press, 2008.)
[61] 秦春秀, 刘杰, 马晓悦. 知识单元间的语义关系研究进展[J]. 情报理论与实践, 2017, 40(6): 128-133. (QIN C X, LIU J, MA X Y. Research progress of semantic relationship among knowledge units[J]. Information studies: theory & application, 2017, 40(6): 128-133.)
[62] 余永权. 模糊控制技术与模糊家用电器[M]. 北京: 北京航空航天大学出版社, 2000. (YU Y Q. Fuzzy control technology and fuzzy household appliances [M]. Beijing: Beijing University of Aeronautics and Astronautics Press, 2000.)
[63] 秦春秀, 杨智娟, 赵捧未, 等. 面向科技文献知识表示的知识元本体模型[J]. 图书情报工作, 2018, 62(3): 94-103. (QIN C X, YANG Z J, ZHAO P W. The knowledge element ontology model of scientific literature for knowledge representation[J]. Library and information service, 2018, 62(3): 94-103.)
文章导航

/