RESEARCH PAPERS

Construction of Service Effectiveness Evaluation Indicator System of Preprint Platform and Empirical Research

  • Zhou Yifu ,
  • Tan Chunhui ,
  • Zhou Yang ,
  • Tu Ruide ,
  • Li Yuepeng
Expand
  • 1 School of Information Management, Central China Normal University, Wuhan 430079;
    2 School of Information Management, Wuhan University, Wuhan 430072

Received date: 2024-05-31

  Revised date: 2024-08-22

  Online published: 2025-01-25

Supported by

This work is supported by the National Social Science Fund of China project titled “Research on the Cooperation Mechanism of Philosophical and Social Science Researchers Under the Organized Scientific Research Paradigm”(Grant No.23ATQ007).

Abstract

[Purpose/Significance] Exploring the construction of a set of scientific and feasible evaluation indicator system aims to realize the quantitative evaluation of the service effectiveness of the preprint platform. [Method/Process] Firstly, based on the E-S-QUAL model and combining with the research context, this study explored the construction of the evaluation indicatorsystem of preprint platform service effectiveness. Secondly, this study adopted the hierarchical analysis method to assign weights to the evaluation indexes at each level. Then, it selected arXiv and ChinaXiv as the sample platforms, and used the fuzzy comprehensive evaluation method to carry out empirical evaluation of the platform service effectiveness. Finally, it summarized the evaluation results, and drew relevant research conclusions. [Result/Conclusion] The evaluation indicator system of service effectiveness of the preprint platform constructed in this paper contains five first-level indicators of efficiency, system availability, fulfillment, privacy and empathy and 17 second-level indicators such as review cycle. The fulfillment and system availability in the first-level indicatorsaccount for a higher weighting than the content accuracy and interface friendliness in the second-level indicators. And the evaluation index system has strong scientific, operability and applicability.

Cite this article

Zhou Yifu , Tan Chunhui , Zhou Yang , Tu Ruide , Li Yuepeng . Construction of Service Effectiveness Evaluation Indicator System of Preprint Platform and Empirical Research[J]. Library and Information Service, 2025 , 69(2) : 56 -66 . DOI: 10.13266/j.issn.0252-3116.2025.02.006

References

[1] 刘敬仪, 杨恒, 伊惠芳, 等. 国际预印本平台发展态势研究[J]. 图书情报工作, 2023, 67(5): 15-25. (LIU J Y, YANG H, YI H F, et al. Research on the development trend of international preprint platform[J]. Library and information service, 2023, 67(5): 15-25.)
[2] 中华人民共和国国务院. 中华人民共和国国民经济和社会发展第十四个五年规划和2035年远景目标纲要[EB/OL]. [2024-09-10]. http://gbdy.ndrc.gov.cn/gbdyzcjd/202103/t20210323_1270126.html. (The State Council of the People’s Republic of China. Outline of the 14th five-year plan for national economic and social development of the People's Republic of China and the vision goals for 2035[EB/OL]. [2024-09-10]. http://gbdy.ndrc.gov.cn/gbdyzcjd/202103/t20210323_1270126.html.)
[3] 曾建勋. 国家科研论文和科技信息高端交流平台构建研究 [J]. 中国图书馆学报, 2024, 50(1): 66-78. (ZENG J X. The construction of the high-endcommunication platform for national scientific research papers and scientific and technological information[J]. Journal of library science in China, 2024, 50(1): 66-78.)
[4] 郑昂, 曾建勋. 预印本平台与开放期刊协同发展机制研究[J]. 图书情报工作, 2023, 67(16): 13-21. (ZHENG A, ZENG J X. Research on synergistic development mechanism between preprint platform and open journal [J]. Library and information service, 2023, 67(16): 13-21.)
[5] KAISER J. The preprint dilemma [J]. Science, 2017, 357(6358): 1344-1345.
[6] 刘静羽, 刘敬仪, 杨恒, 等. 我国科研人员对预印本平台的认知与使用研究[J]. 图书情报工作, 2023, 67(5): 26-48. (LIU J Y, LIU J Y, YANG H, et al. Research on cognition and use of preprint servers by Chinese researchers[J]. Library and information service, 2023, 67(5): 26-48.)
[7] FRASER N, MAYR P, PETERS I. Motivations, concerns and selection biases when posting preprints: a survey of biorxiv authors[J]. Plos one, 2022, 17(11): e0274441.
[8] 边晓琳, 董海荣, 吴岳峰, 等. 科技期刊与预印本平台协同发展的典型模式探讨[J]. 中国科技期刊研究, 2023, 34(7): 834-840. (BIAN X L, DONG H R, WU Y F, et al. Typical cooperation models between scientific journals and preprint platforms[J]. Chinese journal of scientific and technical periodicals, 2023, 34(7): 834-840.)
[9] CHOI Y J, CHOI H W, KIM S. Preprint acceptance policies of Asian academic society journals in 2020[J]. Korean council of science editors, 2021(1): 10-17.
[10] 刘敬仪, 杨恒, 肖莉. 期刊预印本政策的作用机制模型构建与建议——基于扎根理论的分析[J]. 中国科技期刊研究, 2024, 35(1): 25-35. (LIU J Y, YANG H, XIAO L. Mechanism model construction and suggestion of journal preprint policy: based on grounded theory [J]. Chinese journal of scientific and technical periodicals, 2024, 35(1): 25-35.)
[11] 孙异凡, 陈一, 蒋子可, 等. 开放科学视域下预印本认可政策研究[J]. 数字图书馆论坛, 2021(6): 2-12. (SUN Y F, CHEN Y, JIANG Z K, et al. Research on the recognition policy of preprints from the perspective of open science [J]. Digital library forum, 2021(6): 2-12.)
[12] 刘敬仪, 杨恒, 祝璐颖. 预印本平台数据开放共享政策的内容构成与特点剖析[J]. 图书情报工作, 2023, 67(5): 49-57. (LIU J Y, YANG H, ZHU L Y. Contentcomposition and characteristic analysis of data open sharing policy of preprint platforms [J]. Library and information service, 2023, 67(5): 49-57.)
[13] ARTEMIS C, ALEXANDROS K. Preprint paper platforms in the academic scholarlycommunication environment [J]. Journal of librarianship and information science 2023, 55(1): 43-56.
[14] 谭春辉, 周一夫, 李玥澎, 等. 基于Kano模型的预印本平台服务功能需求分析及优化[J]. 图书情报工作, 2023, 67(19): 37-47. (TAN C H, ZHOU Y F, LI Y P, et al. Analysis and optimization of service requirements of preprint platform based on kano model [J]. Library and information service, 2023, 67(19): 37-47.)
[15] COURTNEY K SODERBERG, TIMOTHY M ERRINGTON, BRIAN A NOSEK. Credibility of preprints: an interdisciplinary survey of researchers[J]. Royal society open science 2020, 7(10): 20152.
[16] 朱莉. 公共数字文化平台服务效能评价体系构建及提升策略 研究 [J]. 情报 科学, 2023, 41(5): 107-114. (ZHU L. The construction of service efficiency evaluation system of public digital culture platform [J]. Information science, 2023, 41(5): 107-114.)
[17] 刘妃, 曹敏, 左美云. 辟谣平台的评价指标体系构建及实证研究[J]. 情报杂志, 2021, 40(9): 95-100, 94. (LIU F, CAO M, ZUO M Y. Construction and empirical research on evaluation index system of rumor-refuting platforms [J]. Journal of intelligence, 2021, 40(9): 95-100, 94.)
[18] 李万星, 卢全梅, 王琳. 数字化科教评价平台信息服务质量评价体系构建研究[J]. 情报理论与实践, 2022, 45(6): 164-169. (LI W X, LU Q M, WANG L. Research on the construction of information service quality evaluation system of digital science andeducation evaluation platform [J]. Information studies:theory & application, 2022, 45(6): 164-169.)
[19] 李贺, 刘嘉宇, 祝琳琳, 等. 中医古籍数字化平台服务质量评价与提升策略研究[J]. 现代情报, 2023, 43(11): 58-72. (LI H, LIU J Y, ZHU L L, et al. Research on service quality evaluation and promotion strategy of digital platform on tcm ancient literatures [J]. Journal of modern information, 2023, 43(11): 58-72.)
[20] ZHANG C, HU Z, QIN Y, et al. Performance evaluation of technological service platform: a rough z-number-based bwmtodim method[J]. Expert systems with application, 2023, 11(15): 230.
[21] PARASURAMAN A, ZEITHAML VA, BERRY L. SERVQUAL: a multiple-item scale for measuring consumer perceptions of service quality[J]. Journal of retailing, 1988, 64:12-40.
[22] 曾粤亮, 陆欣仪. 基于SERVQUAL模型的高校图书馆创客空间服务质量评价研究[J]. 大学图书馆学报, 2023, 41(3): 51-62. (ZENG Y L, LU X Y. Research on service quality evaluation of academic library makerspace based on SERVQUAL model [J]. Journal of academic libraries, 2023, 41(3): 51-62.)
[23] 徐绪堪, 谭丹, 李一铭, 等. 基于SUB-SERVQUAL模型的高校图书馆嵌入式学科服务质量评价研究[J]. 情报理论与实践, 2022, 45(8): 83-89. (XU X K, TAN D, LI Y M, et al. Research on the evaluation of embedded subject service quality of university library based on SUB-SERVQUAL model [J]. Information studies: theory & application, 2022, 45(8): 83-89.)
[24] 吕万刚, 曾珍. 基于公众感知的大型体育场馆公共体育服务质量评价与实证研究[J]. 体育学刊, 2020, 27(5): 59-67. (LV W G, ZENG Z. Evaluation and empirical study on public sports service quality oflarge stadiums based on public perception [J]. Journal of physicaleducation, 2020, 27(5): 59-67.)
[25] PARASURAMAN A, ZEITHAML V A, MALHOTRA A, et al. E-S-QUAL -a multiple-item scale for assessing electronic service quality[J]. Journal of service research, 2005, 7(3): 213-233.
[26] YAYA L H P, MARIMON F, FA M C, et al. Assessing e-service quality: the current state of E-S-QUAL [J]. Total quality management & business excellence, 2012, 23(11-12): 1363-1378.
[27] 杜宏科. 基于E-S-Qual的政务APP服务效能评价研究[D]. 武汉: 华中科技大学, 2022. (DU H K. Evaluation research of government app service efficiency based on E-S-QUAL [D]. Wuhan: Huazhong University of Science and Technology, 2022.)
[28] 卫善春. 基于数据挖掘的就业需求信息资源采集研究[J]. 情报科学, 2023, 41(9): 130-137. (WEI S C. The collection of employment demand information resources based on data mining [J]. Information science, 2023, 41(9): 130-137.)
[29] MUJINGA M. Online banking service quality: a South African E-S-QUAL analysis[C]//Responsible design, implementation and use of information andcommunication technology. Cham: Springer, 2020: 228-238.
[30] DE MELO F J C, XAVIER L A, DE ALBUQUERQUE A P G, et al. Evaluation of quality of online shopping services in times of COVID-19 based on E-S-QUAL model and fuzzy topsis method[J]. Softcomputing, 2023, 27(11): 7497-7511.
[31] SAATY T L. Modeling unstructured decision problems: the theory of analytical hierarchies. mathematics andcomputers in simulation [J]. Mathematics &computers in simulation, 1978, 20(3): 147-158.
[32] 刘健, 王小菲. 基于层次分析法的高校图书馆网站用户满意度评价指标体系构建研究[J]. 情报科学, 2022, 40(12): 80-87. (LIU J, WANG X F. The construction of evaluation index system of user satisfaction of university library websites based on analytic hierarchy process [J]. Information science, 2022, 40(12): 80-87.)
[33] HAN Y, LIU Q J. Study on evaluation index system of underground space resources development and utilization in abandoned mines[J]. Coal economic research, 2022, 42(5): 53-57.
[34] 郑昂, 曾建勋. 国际预印本平台运行模式研究[J]. 中国科技 期刊 研究, 2023, 34(7): 817-825. (ZHENG A, ZENG J X. Operation mode of international preprint platforms [J]. Chinese journal of scientific and technical periodicals, 2023, 34(7): 817-825.)
[35] 徐拥军, 卢思佳, 傅予, 等. 我国人文社科学者对预印本平台的认知特征、使用情况与主要诉求[J]. 图书与情报, 2023(6): 32-43. (XU Y J, LU S J, FU Y, et al. Cognitive characteristics, usage, main demands of preprint platforms by scholars of humanities and social sciences in China [J]. Library & information, 2023(6): 32-43.)
Outlines

/