RESEARCH PAPERS

Evaluation of Digital Resources Consortium Procurement on the All-round Evaluation Theory: A Case Study of the Comprehensive Evaluation of Digital Resources Introduced by DRAA

  • Zhu Yizhen ,
  • Wang Le ,
  • Shao Chengmin ,
  • Yao Xiaoxia ,
  • Li Ying
Expand
  • 1 Fudan University Library, Shanghai 200433;
    2 Fudan University National Experiment Base for the Intelligent Evaluation and Governance, Shanghai 200433;
    3 Peking University Library, Beijing 100871
Zhu Yizhen, Librarian, Master’s Degree; Wang Le, Deputy Director, Research Librarian, Master’s Degree, Corresponding Author, E-mail: lewang@fudan.edu.cn; Shao Chengmin, Associate Research Librarian, Bachelor’s Degree; Yao Xiaoxia, Deputy Director, Research Librarian, PhD; Li Ying, Librarian, Bachelor’s Degree.

Received date: 2024-10-28

  Revised date: 2025-05-06

  Online published: 2025-11-19

Abstract

[Purpose/Significance] To cope with the dual challenges of financial pressure and organizational management faced by consortium procurement, this paper constructs an evaluation system for the consortium procurement of digital resources. The system aims to guide database vendors to provide better quality programs and services, and to promote the healthy and sustainable development of the consortium procurement of digital resources. [Method/Process] Under the guidance of the “All-round Evaluation” theory, this paper took digital resources introduced by the DRAA as an example. It constructed a comprehensive evaluation system for the procurement of digital resources from the perspective of consortium purchasing by combining experts’ opinions, and tested its practical effect through the evaluation in three consecutive years from 2022 to 2024. [Result/Conclusion] The results show that the evaluation system effectively drives optimization through evaluation. It helps to realize a virtuous circle of service optimization and procurement standardization, positively influences database vendor to provide better quality service and improve cooperation, and can provide valuable assistance and reference for consortium purchasing.

Cite this article

Zhu Yizhen , Wang Le , Shao Chengmin , Yao Xiaoxia , Li Ying . Evaluation of Digital Resources Consortium Procurement on the All-round Evaluation Theory: A Case Study of the Comprehensive Evaluation of Digital Resources Introduced by DRAA[J]. Library and Information Service, 2025 , 69(22) : 73 -84 . DOI: 10.13266/j.issn.0252-3116.2025.22.006

References

[1] ICOLC. Participating consortia[EB/OL]. [2025-06-27]. https://icolc.net/.
[2] 肖珑, 姚晓霞.我国图书馆电子资源集团采购模式研究[J]. 中国图书馆学报, 2004(5): 33-36. (XIAO L, YAO X X. A study of patterns for the group purchase of electronic resources in China[J]. Journal of library science in China, 2004(5): 33-36.)
[3] 教育部高等学校图书情报工作指导委员会. 统计数据[EB/OL]. [2025-06-27]. http://www.scal.edu.cn/tjpg/tjsj. (SCAL. Statistical data[EB/OL]. [2025-06-27]. http://www.scal.edu.cn/tjpg/tjsj.)
[4] 张轶华, 李芳, 宋海艳, 等. 基于实证比较的外文期刊数据库评价模型构建与应用[J]. 图书馆杂志, 2019, 38(8): 65-73, 16. (ZHANG Y H, LI F, SONG H Y, et al. Establishment and application of foreign journal database evaluation model by empirical comparison[J]. Library journal, 2019, 38(8): 65-73, 16.)
[5] 庄纪林, 陈凌, 姚晓霞. 外文期刊数据库内容质量指标的量化研究[J]. 图书情报工作, 2021, 65(2): 54-64. (ZHUANG J L, CHEN L, YAO X X. Quantitative research on content quality indicators of foreign journal database[J]. Library and information service, 2021, 65(2): 54-64.)
[6] WIERSMA G. Report of the ALCTS Collection Management Section(CMS) collection evaluation and assessment interest group meeting. American library association annual conference. Orlando, June 2016[J]. Technical services quarterly, 2017, 34(1): 68-78.
[7] 李建霞. 图书馆绩效评价国际标准体系分析[J]. 图书馆杂志, 2012, 31(11): 38-41, 85. (LI J X. International evaluation index system research of library performance[J]. Library journal, 2012, 31(11): 38-41, 85.)
[8] LibQUAL+®. About[EB/OL]. [2025-06-27]. http://www.libqual.org/about.
[9] 覃凤兰. 高校图书馆数字资源绩效评价[M]. 武汉: 武汉大学出版社, 2015. (QIN F L. Performance evaluation of digital resources in higher education libraries[M]. Wuhan: Wuhan University Press, 2015.)
[10] Content Reuse Working Group, DLF Assessment Interest Group. Digital content reuse assessment framework toolkit (D-CRAFT); Council on library & information resources[EB/OL]. [2025-06-27]. https://reuse.diglib.org/toolkit/use-and-reuse/.
[11] 肖珑, 张宇红.电子资源评价指标体系的建立初探[J]. 大学图书馆学报, 2002(3): 35-42, 91. (XIAO L, ZHANG Y H. On the development of the electronic resources evaluation system[J]. Journal of academic libraries, 2002(3): 35-42.91.)
[12] 王乐. 网络资源购前试用与评价体系初探[J]. 图书情报工作, 2003(12): 49-51. (WANG L. A study on the system of online resources trial and evaluation before purchasing[J]. Library and information service, 2003(12): 49-51.)
[13] 徐洁. 面向学科建设的“精益采购”策略研究——以南京师范大学物理学科外文电子期刊利用计量为例[J]. 新世纪图书馆, 2019(6): 26-29. (XU J. A study on library lean procurement strategy for discipline construction: a case study of the foreign language electronic journals in physics of Nanjing Normal University[J]. New century library, 2019(6): 26-29.)
[14] 段惠静. 数字资源使用统计分析——以山西大学图书馆为例[J]. 晋图学刊, 2012(3): 24-27. (DUAN H J. The statistical analysis on digital library resource usage: taking Shanxi University Library as an example[J]. Shanxi library journal, 2012(3): 24-27.)
[15] 张赟玥, 秦鸿, 杜丽. 应用ERS评估外文电子图书绩效的实践探索——以电子科技大学为例[J]. 图书情报工作, 2020, 64(21): 50-57. (ZHANG Y Y, QIN H, DU L. Performance evaluation of foreign e-books based on electronical resource system: the case of UESTC Library collections[J]. Library and information service, 2020, 64(21): 50-57.)
[16] 戴咏梅, 邵波. 高校图书馆电子资源科研支持力评估实证研究[J]. 高校图书馆工作, 2022, 42(5): 46-52. (DAI Y M, SHAO B. An empirical study on the evaluation of scientific research support of electronic resources in academic libraries[J]. Library work in colleges and universities, 2022, 42(5): 46-52.)
[17] SPARC. Data analysis for negotiation[EB/OL]. [2025-06-27]. https://sparcopen.org/our-work/negotiation-resources/data-analysis/.
[18] 周琴, 李军莲, 任慧玲.加州大学电子期刊订购向开放获取转换的策略研究[J]. 数字图书馆论坛, 2021(11): 37-41. (ZHOU Q, LI J L, REN H L. Research on the strategies of transformation from electronic journal subscription to open access in the University of California[J]. Digital library forum, 2021(11): 37-41.)
[19] DRAA. 高校图书馆数字资源采购联盟工作规范[EB/OL]. [2025-06-27]. http://www.libconsortia.edu.cn/Spage/view.action?pagecode=glgf_2. (DRAA. Code of practice for Digital Resource Acquisition Alliance of Chinese Academic Libraries[EB/OL]. [2025-06-27]. http://www.libconsortia.edu.cn/Spage/view.action?pagecode=glgf_2.)
[20] 罗祺姗, 翟爽, 张静. 电子资源订购决策评价的若干思考——以中国科学院电子资源集团采购为例[J]. 图书情报工作, 2018, 62(3): 39-44. (LUO Q S, ZHAI S, ZHANG J. Study on the acquisition decision assessment of electronic resources: a case study of the group purchasing of the National Science Library of CAS[J]. Library and information service, 2018, 62(3): 39-44.)
[21] 朱学军, 罗祺姗, 赵艳. 科研机构引进电子资源科技支撑绩效评价研究与发展——以中国科学院集团引进外文电子期刊为例[J]. 图书情报工作, 2020, 64(24): 57-62. (ZHU X J, LUO Q S, ZHAO Y. Study on scientific outcome assessment of e-resources subscribed by research institutions: a case study on CAS consortium’s foreign E-journals[J]. Library and information service, 2020, 64(24): 57-62.)
[22] 高校图书馆数字资源采购联盟. 引进数据库培训周调查报告[EB/OL]. [2025-06-27]. http://www.libconsortia.edu.cn/Spage/view.action?pagecode=dcbg_1. (DRAA. Introduction of database training week survey report[EB/OL]. [2025-06-27]. http://www.libconsortia.edu.cn/Spage/view.action?pagecode=dcbg_1.)
[23] 高校图书馆数字资源采购联盟.采购方案[EB/OL]. [2025-06-27]. http://www.libconsortia.edu.cn/index.action. (DRAA. Consortium proposal[EB/OL]. [2025-06-27]. http://www.libconsortia.edu.cn/index.action.)
[24] 叶继元. 学术“全评价”体系论[M]. 北京: 社会科学文献出版社, 2021. (YE J Y. On the evaluation of research[M]. Beijing: Social Sciences Academic Press, 2021.)
[25] 晁明娣. 高校图书馆学科馆藏“全评价”体系构建研究[J]. 现代情报, 2014, 34(5): 35-40, 46. (CHAO M D. The evaluation of discipline collection of university library: based on all-around evaluation system[J]. Journal of modern information, 2014, 34(5): 35-40, 46.)
[26] 卢文辉, 叶继元.“全评价”分析框架下的图书馆网站评价研究[J]. 图书馆杂志, 2018, 37(10): 31-42, 60. (LU W H, YE J Y. Evaluation of library websites under the analytical framework of “full evaluation”[J]. Library journal, 2018, 37(10): 31-42, 60.)
[27] 薛丽荣. 高校图书馆阅读推广活动效果“全评价”体系构建研究[J]. 四川图书馆学报, 2020(2): 55-59. (XUE L R. The research on the construction of all-around evaluation system of reading promotion activities in university library[J]. Journal of the Library Science Society of Sichuan, 2020(2): 55-59.)
[28] 叶继元, 袁曦临. 基于核心功能的学术期刊质量评价指标体系框架探讨[J]. 江南大学学报(人文社会科学版), 2021(4): 5-17. (YE J Y, YUAN X L. Discussion on the framework of academic journal quality evaluation index system based on journal core functions[J]. Journal of Jiangnan University (humanities & social sciences), 2021(4): 5-17.)
[29] 马祥涛.“全评价”视角下智慧图书馆建设评价研究[J]. 图书馆理论与实践, 2023(3): 103-109. (MA X T. Research on the evaluation of smart library construction based on the theory of full evaluation[J]. Library theory and practice, 2023(3): 103-109.)
[30] 叶继元.“全评价”体系分析框架及其应用与意义[J]. 云梦学刊, 2013(4): 12-14. (YE J Y. Framework for analyzing ‘all-around evaluation’ systems and their application and implications[J]. Journal of Yunmeng, 2013(4): 12-14.)
[31] DRAA. DRAA集团采购数据库资源综合评价实施办法[EB/OL]. [2025-06-27]. http://www.libconsortia.edu.cn/Infodownload/getAllType.action. (DRAA. DRAA consortium purchasing database resources comprehensive evaluation implementation approach[EB/OL]. [2025-06-27]. http://www.libconsortia.edu.cn/Infodownload/getAllType.action.)
[32] 姚晓霞, 刘娟娟. DRAA集团采购规范化建设及其成效[J]. 大学图书馆学报, 2023, 41(5): 33-40.48. (YAO X X, LIU J J. The efficiency of standardized construction of DRAA cooperative purchasing[J]. Journal of academic libraries, 2023, 41(5): 33-40, 48.)
Outlines

/

〈 〉