THEORETICAL STUDY

Research on the Optimization of Performance Evaluation Indicator System for Scientific Research Institutions

  • He Jun ,
  • Yu Jianjun ,
  • Rong Xiaohui
Expand
  • 1 Department of Management Science and Engineering, School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100871;
    2 Computer Network Information Center, Chinese Academy of Sciences, Beijing 100871

Received date: 2023-10-20

  Revised date: 2024-02-02

  Online published: 2024-06-19

Abstract

[Purpose/Significance] The performance evaluation of scientific research institutions is an effective way to reflect the value of their research activities, outputs, and impacts, and its core content is to establish a scientific and reasonable evaluation indicator system. [Method/Process] This paper designed a set of systematic sub-domain and sub-regional performance evaluation indicator system to support the reform of scientific research evaluation. According to its characteristics of the performance evaluation, this paper constructed an optimization model based on random forest algorithm. By analyzing the contribution indicators in the existing system, it selected the common key indicators of performance evaluation. Meanwhile, it respectively analyzed the importance of indicators in different subjects and regions, optimized the structural weight ratio of common and individual indicators, and established a systematic system in different fields and regions. [Result/Conclusion] This indicator system can not only meet the evaluation objectives, but also dynamically and appropriately adjust the indicators according to the characteristics of scientific research institutions in many subjects and wide regions.

Cite this article

He Jun , Yu Jianjun , Rong Xiaohui . Research on the Optimization of Performance Evaluation Indicator System for Scientific Research Institutions[J]. Library and Information Service, 2024 , 68(11) : 72 -81 . DOI: 10.13266/j.issn.0252-3116.2024.11.006

References

[1] 吴丛,韩青,阿儒涵.美国联邦政府科技预算绩效评价的发展演变与启示[J].中国科学院院刊, 2023, 38(2):230-240.(WU C, HAN Q, Aruhan. Evolution trajectory of performance evaluation of the US federal government S&T budget[J]. Bulletin of Chinese Academy of Sciences, 2023, 38(2):230-240.)
[2] DESMOND R. Indicators of performace:reactions and issues[J]. Assessment&evaluation in higher education, 1987, 12(2):94-104.
[3] DAVID D, MARK G. Statistical analysis of performance indicators in UK higher education[J]. Journal of the Royal Statistical Society:Series A (statistics in society), 2004, 167(3):449-474.
[4] QWUSU E, GABRIEL D, MINTA C, et al. Assessing the relationship between budget participation and employees' performance of public universities in Ghana:a case of university of education[J]. International journal of academic research in accounting, finance and management sciences, 2014, 4(1):85-95.
[5] ARINA B. Budget optimization modelling for sustainable development of the university research:the example of Russia[J]. Journal of hysics:conference series, 2018, 1117(1):012012-012019.
[6] BROWN R E, MYRING M J, GARD C G. Activity-based costing in government:possibilities and pitfalls[J]. Public budgeting finance, 2018, 32(2):32-33.
[7] 汤浩,阿儒涵,何峻,等.中国科学院研究所整体预算绩效评价试点的实践与思考[J].中国科学院院刊, 2023, 38(2):211-218.(TANG H, ARUHAN, HE J, et al. Practice and thinking of agency level budget performance evaluation pilot in Chinese Academy of Sciences[J]. Bulletin of Chinese Academy of Sciences, 2023, 38(2):211-218.)
[8] 陈琛,刘宇.科研单位全面预算绩效评价体系构建——基于新《预算法实施条例》[J].新会计, 2023, 173(5):24-27.(CHEN C, LIU Y. Construction of a comprehensive budget performance evaluation system for scientific research institutions-based on the new "Implementation Regulations of the Budget Law" [J]. Modern accounting, 2023, 173(5):24-27.)
[9] 乐音.农业科研单位预算绩效管理之思考[J].中国农业会计, 2023, 33(1):48-50.(YUE Y. Thoughts on budget performance management of agricultural research units[J]. Chinese agricultural accounting, 2023, 33(1):48-50.)
[10] 朱利艳.科研事业单位全面实施预算绩效管理的措施探讨——基于基层科研事业单位的工作现状[J].财会学习, 2020, 264(19):53-55.(ZHU L Y. Discussion on measures for fully implementing budget performance management in scientific research institutions:based on the work status of grassroots scientific research institutions[J]. Accounting learning, 2020, 264(19):53-55.)
[11] 刘超,崔珑,董柳圻.高校预算绩效管理框架与评价体系构建[J].财会通讯, 2022(2):166-171.(LIU C, CUI L, DONG L Q. Construction of budget performance management framework and evaluation system in colleges and universities[J]. Communication of finance and accounting, 2022(2):166-171.)
[12] 陈招娣.部门整体支出绩效评价指标体系构建与应用研究[D].厦门:厦门大学, 2020.(CHEN Z D. The construction and application of the departmental overall expenditure performance evaluation index system[D]. Xiamen:Xiamen University, 2020.)
[13] 钱方明,王帅.吉林省省属高校整体支出预算绩效评价研究[J].长春师范大学学报, 2023(2):183-186.(QIAN F M, WANG S. Research on the performance evaluation of the overall expenditure budget of provincial universities in Jilin province[J]. Journal of Changchun Normal University, 2023(2):183-186.)
[14] 刘敏,王萌.整体支出绩效评价指标体系设计方法初探[J].财政监督, 2015(10):50-52.(LIU M, WANG M. A preliminary study on the design of the overall expenditure performance evaluation index system[J]. Finance supervision, 2015(10):50-52.)
[15] 郑方辉,廖逸儿,卢扬帆.财政绩效评价:理念、体系与实践[J].中国社会科学, 2017(4):84-108, 207-208.(ZHENG F H, LIAO Y E, LU Y F. Assessment of financial performance:concepts, systems and practice[J]. Social sciences in China, 2017(4):84-108, 207-208)
[16] 王瑞华,王吉祥,王英.基于平衡计分卡的地方政府绩效评估体系[J].辽宁工程技术大学学报(社会科学版), 2016(4):84-108.(WANG R H, WANG J X, WANG Y. Local government performance evaluation system based on the balanced scorecard[J]. Journal of Liaoning Technical University (Social science edition), 2016(4):84-108.)
[17] LEE C, LEE G. Information gain and divergence-based feature selection for machine learning-based text categorization[J]. Information processing and management, 2006, 42(1):155-165.
[18] ZHANG Y, WANG S, PHILLIPS P, et al. Binary PSO with mutation operator for feature selection using decision tree applied to spam detection[J]. Knowledge-based systems, 2014, 64:22-31.
[19] HALDUN A. Feature selection for support vector machines using generalized benders decomposition[J]. European journal of operational research, 2015, 244(1):210-218.
[20] 迟国泰,陈洪海.基于信息敏感性的指标筛选与赋权方法研究[J].科研管理, 2016, 37(1):155-160, 162.(CHI G T, CHEN H H. Study of indice screening and weighting method based on the information sensitivity[J]. Science research management, 2016, 37(1):155-160, 162.)
[21] 李鸿禧,迟国泰.基于DEA-t检验的以企业为主体的科技创新效率评价[J].中国管理科学, 2016, 24(11):109-119.(LI H X, CHI G T. The efficiency evaluation of technology innovation centered on enterprise based on DEA and T test[J]. Chinese journal of management science, 2016, 24(11):109-119.)
[22] 刘冉.基于R聚类和变异系数构建企业专利质量评价指标[J].上海质量, 2023(3):33-38.(LIU R. Constructing enterprise patent quality evaluation indicators based on R-Clustering and coefficient of variation[J]. Shanghai quality, 2023(3):33-38.)
[23] 王璐,刘妍,李战江,等.基于非参数K近邻-秩相关的信用评价指标构建模型[J].内蒙古大学学报(自然科学版), 2021(6):153-160, 162(WANG L, LIU Y, LI Z J, et al. Construction model of credit evaluation index based on nonparametric K neighborhood-rank correlation[J]. Acta scientiarum naturalium universitatis Neimongol, 2021(6):153-160, 162)
[24] KIRA K, RENDELL LA. A practical approach to feature selection[C]//Proceedings of the ninth international workshop on machine learning. San Francisco:Morgan Kaufmann, 1992:249-256.
[25] KONONENKO I. Estimating attributes:Analysis and extensions of RELIEF[C]//Machine Learning:ECML-94. Berlin:Springer, 1994:171-182.
Outlines

/