[Purpose/Significance] Breaking the “five-only evaluation” is the biggest difficulty in the current academic evaluation activities, which has attracted great attention from the whole society. With the gradual weakening of the five indicators, the new basis in academic evaluation is the most important problem. [Method/Process] With the data-driven ideas and methods, we analyzed the theoretical and methodological difficulties in the development of bibliometrics and peer review, as well as the root causes of the difficulties. Then, we analyzed the main contents and the key problems of data-driven academic evaluation. [Result/Conclusion] Finally, we constructed the theoretical framework of data-driven academic evaluation paradigm. It concludes the definition of academic evaluation issues, the collection of data on academic evaluation objects, the construction of academic evaluation models and data analysis, and the interpretation of results.
Suo Chuanjun
,
Yu Miao
,
Pai Yanxin
,
Rong Juntao
. Theoretical Framework of Data-Driven Academic Evaluation[J]. Library and Information Service, 2024
, 68(1)
: 5
-12
.
DOI: 10.13266/j.issn.0252-3116.2024.01.001
[1] 章成志, 李卓, 赵梦圆, 等. 基于引文内容的中文图书被引行为研究[J]. 中国图书馆学报, 2019, 45(3): 96-109. (ZHANG C Z, LI Z, ZHAO M Y, et al. Citing behavior of Chinese books based on citation content[J]. Journal of library science in China, 2019, 45(3): 96-109.)
[2] 胡志刚, 陈超美, 刘则渊, 等. 基于XML全文数据引文分析系统的设计与实现[J]. 现代图书情报技术, 2012(11): 72-77. (HU Z G, CHEN C M, LIU Z Y, et al. Design and implementation of the citation analysis system based on XML full-text articles[J]. New technology of library and information service, 2012(11): 72-77.)
[3] SUGIMOTO C R, WORK S, LARIVIÈRE V, et al. Scholarly use of social media and altmetrics: a review of the literature[J]. Journal of the Association for Information Science & Technology, 2017, 68(9): 2037-2062.
[4] 索传军, 张博, 贾冰怡, 等. 基于语篇结构功能理论视角的引文特征与功能分析[J]. 情报理论与实践, 2023, 46(3): 189-199. (SUO C J, ZHANG B, JIA B Y, et al. Analysis of citation characteristics and functions from perspective of discourse structure-function theory[J]. Information studies: theory & application, 2023, 46(3): 189-199.)
[5] 索传军. 论学术评价的价值尺度——兼谈“唯论文”问题的根源[J]. 中国社会科学评价, 2021, 25(1): 122-131, 160. (SUO C J. The value yardstick for academic evaluation: the root of the problem of “only publications count”[J]. China social science review, 2021, 25(1): 122-131, 160.)
[6] 李明禄. 英汉云计算·物联网·大数据辞典[M]. 上海: 上海交通大学出版社, 2018: 147. (LI M L. A concise English-Chinese dictionary of cloud computing IOT big data[M]. Shanghai: Shanghai Jiao Tong University Press, 2018: 147.)
[7] 苏新宁, 王东波. 学术评价相关问题与思考[J]. 信息资源管理学报, 2018, 8(3): 4-11. (SU X N, WANG D B. Related questions and thoughts of academic evaluation[J]. Journal of information resources management, 2018, 8(3): 4-11.)
[8] 王晓峰, 高俊波, 孔繁荣. 英汉人工智能辞典[M]. 上海: 上海交通大学出版社, 2019: 90. (WANG X F, GAO J B, KONG F R. An English-Chinese artificial intelligence dictionary[M]. Shanghai: Shanghai Jiao Tong University Press, 2019:90.)
[9] 术语在线. 数据驱动[EB/OL]. [2023-10-27]. https://www.termonline.cn/wordDetail?termName=%E6%95%B0%E6%8D%AE%E9%A9%B1%E5%8A%A8&subject=9dab173e26b011eebe5ab068e6519520&base=1. (TermOnline. Data driven[EB/OL]. [2023-10-27]. https://www.termonline.cn/wordDetail?termName=%E6%95%B0%E6%8D%AE%E9%A9%B1%E5%8A%A8&subject=9dab173e26b011eebe5ab068e6519520&base=1.)
[10] 国家标准化管理委员会. 数据管理能力成熟度评估模型: GB/T 36073—2018[S]. 北京:中国标准出版社, 2018: 12-17. (Standardization Administration. Data management capability maturity assessment model: GB/T 36073—2018[S]. Beijing: Standards Press of China, 2018: 12-17.)
[11] 王飞. 数据架构与商业智能[M]. 北京: 机械工业出版社, 2015: 44-56. (WANF F. Data architecture and business intelligence[M]. Beijing: China Machine Press, 2015: 44-56.)
[12] 索传军, 张璇, 李木子. 论评价参照系的内涵、作用与构建——兼论学术谱系的功能和作用[J]. 中国人民大学学报, 2022, 36(4): 180-190. (SUO C J, ZHANG X, LI M Z. On the referential frame of academic evaluation and the function of academic genealogy[J]. Journal of Renmin University of China, 2022, 36(4): 180-190.)
