［目的/意义］当前公共图书馆服务效能备受关注,以公共图书馆服务项目为对象,探讨公共图书馆服务项目成效评估设计及其应用问题,以期为国内公共图书馆成效评估提供参考。［方法/过程］将变化理论作为公共图书馆服务项目成效评估设计和应用的理论基础与指导,制定成效评估参考框架与评估流程;选择广州图书馆羊城学堂作为应用案例,探究全民终身学习和提高全民素养的成效及其路径。［结果/结论］变化理论为公共图书馆服务项目成效评估提供了方法论指导,要发挥成效评估对于图书馆管理的积极作用,有必要开展成效评估管理行动。
[Purpose/Significance] With increasing emphasis on public library service efficiency, the research takes public library service programs as the object and explores design and application on outcome assessment of public library service programs, offering references for outcome assessment of domestic public libraries. [Method/Process] Using theory of change as theoretical basic and guidance for the design and application of outcome evaluation of public library service programs, it designed a referring framework and the assessment procedure for effectiveness evaluation. In the last part, it chose Classroom in the City of Rams of Guangzhou Library as an application case, and explored the effectiveness and its path of lifelong learning and national literacy improvement. [Result/Conclusion] Above all, theory of change provides methodological instruction for outcome assessment of public library service programs. In order to develop the positive role of outcome assessment towards library management, it is necessary to take action to administrate outcome assessment.
[1] 柯平."后评估时代"公共图书馆的战略重点与发展方向[J].图书馆论坛, 2019, 39(7): 1-12.
[2] 阮孟禹.图书馆评估的意义与缺失[J].图书馆建设, 2006(2): 102-103.
[3] 吴力群.论图书馆的科学发展指数——基于图书馆社会化的视角[J].图书馆理论与实践, 2014(11): 8-12.
[4] 周吉. 公共图书馆社会影响评价研究[D].上海:华东师范大学,2010.
[5] 陈瑞.图书馆阅读推广成效评价体系构建研究——基于扎根理论的读者访谈数据质性分析[J].图书馆界,2018(1): 85-88.
[6] 唐琼,陈思任,吴莉.高校图书馆数字资源的使用成效——对中山大学研究生样本的观察[J].图书馆论坛,2020, 40(6): 90-99.
[7] 张新.图书馆精准信息扶贫的成效评估与长效机制研究[J].图书馆学刊,2020,42(2):25-28.
[8] 付敏君,任慧玲,刘宇薇.图书馆健康信息服务影响力评估框架研究与设计[J].中华医学图书情报杂志, 2018, 27(2):1-5,49.
[9] VAKKARI P, SEROLA S. Perceived outcomes of public libraries[J]. Library & information science research, 2012, 34(1):37-44.
[10] FRIED S, KOCHANOWICZ M, CHIRANOV M. Planning for impact, assessing for sustainability[J]. Performance measurement and metrics, 2010, 11(1):59-60.
[11] New York State Library. Presentation: Outcome-based evaluation[EB/OL]. http://www.nysl.nysed.gov/libdev/obe/webinar/obepresentation.htm, 2019-07-22/2020-10-12.
[12] LOPEZ S. Project outcome results in action[J]. Public library quarterly, 2018, 37(2):150-165.
[13] Project Outcome. Insights for adopting the model[EB/OL]. https://www.projectoutcome.org/ckeditor_assets/attachments/402/pro_out_pages_010719.pdf, 2018-06/2020-10-12
[14] 陈光,邢怀滨. 基于变革理论的科研项目全周期管理研究[J]. 中国科技论坛, 2017(3): 12-18.
[15] VOGEL I. Review of the use of "Theory of Change" in international development[R/OL]. [2022-01-03]. https://assets.publishing.service.gov.uk/media/57a08a5ded915d3cfd00071a/DFID_ToC_Review_VogelV7.pdf, 2012-04/2020-10-12: 9-11.
[16] GERTLER P J, MARTINEZ S, PREMAND P, et al. Impact evaluation in practice[M]. 2nd ed. Washington: World Bank Group, 2016:32.
[17] DEUTSCH L, BELCHER B, CLAUS R, et al. Leading inter- and transdisciplinary research: lessons from applying theories of change to a strategic research program[J]. Environmental science and policy, 2021, 120(120): 29-41.
[18] AMUNDSEN C, D'AMICO L. Using theory of change to evaluate socially-situated, inquiry-based academic professional development[J]. Studies in educational evaluation, 2019(61): 196-208.
[19] Theory of Change Community. TOC origins[EB/OL]. https://www.theoryofchange.org/what-is-theory-of-change/toc-background/toc-origins/, 2020-10-12.
[20] KING J. Expanding theory-based evaluation: Incorporating value creation in a theory of change[J/OL]. [2022-01-03].https://doi.org/10.1016/j.evalprogplan.2021.101963.:1-8.
[21] CHESNIA O M, DRANE D, YOUNG C, et al. Theory of change models deepen online learning evaluation[J]. Evaluation and program planning, 2021(88): 1-8.
[22] Public Library Association. PLA project outcome[R]. ALA Annual Conference. Chicago: ALA Annual Conference, 2015.
[23] STREATFIELD D, MARKLESS S.Impact evaluation and IFLA: Evaluating the impact of three international capacity building initiatives[J]. Performance measurement and metrics, 2019, 20(2): 105-122.
[24] 汤蕾,马静,刘涵等.打开教育政策研究的"黑盒子"——基于理论的影响评估在随机干预实验研究中的应用[J].华东师范大学学报(教育科学版), 2020, 38(8): 92-109.
[25] 刘艺权.新时期公共图书馆全民阅读服务创新实践与思考——以广州图书馆为例[J].图书情报研究, 2017, 10(4): 35-39.
[26] 孙淳,曾素梅.论图书馆讲座品牌的塑造——以"羊城学堂"为例[J].办公室业务, 2018(1): 163-164.
