研究论文

基于知识增强大模型的政策模糊性测度方法研究

  • 冯迅 ,
  • 武楷彪 ,
  • 柳苏洋 ,
  • 董瑜
展开
  • 1 中国科学院文献情报中心 北京 100190;
    2 中国科学院大学经济与管理学院信息资源管理系 北京 100190;
    3 北京大学政府管理学院 北京 100871
冯迅,硕士研究生;武楷彪,博士研究生;柳苏洋,本科生;董瑜,研究馆员,硕士生导师,通信作者,E-mail:dongy@mail.las.ac.cn。
32305.14.CN11-1541.2026.20.006

收稿日期: 2025-08-07

  修回日期: 2025-10-20

  网络出版日期: 2026-10-13

A Study on a Method for Measuring Policy Ambiguity Based on Knowledge-Enhanced Large Models

  • Feng Xun ,
  • Wu Kaibiao ,
  • Liu Suyang ,
  • Dong Yu
Expand
  • 1 National Science Library, Chinese Academy of Sciences, Beijing 100190;
    2 Department of Information Resources Management, School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100190;
    3 School of Government, Peking University, Beijing 100871
Feng Xun, Master’s Candidate; Wu Kaibiao, Doctoral Candidate; Liu Suyang, Undergraduate; Dong Yu, Research Librarian, Master’s Supervisor, Corresponding

Received date: 2025-08-07

  Revised date: 2025-10-20

  Online published: 2026-10-13

摘要

[目的/意义] 政策模糊性是政府在复杂情境下寻求共识与激励创新的重要治理手段,其重要性在全球治理日趋复杂和利益多元化的背景下日益凸显。由于现有方法难以对政策模糊性进行大规模精准测度,开发新的测度方法以把握其整体态势与演变规律,对日益精细化的国家治理需求意义重大。[方法/过程] 融合专家知识和LLM提出一种新的政策模糊性测度方法——ELKDL (Expert-Linguistics-Knowledge-Driven LLM),该方法以语言学解析抽取词汇级模糊性知识单元为起点,通过专家少量标记驱动LLM构建领域知识库,进而利用知识库驱动LLM完成政策指令句的模糊性标记,提升了政策模糊性测度的广度和深度。同时,研究通过知识蒸馏构建了精准的指令识别(95.97%)和模糊性标记模型(92.01%),并与分句、计算模块一同集成为政策模糊性测度模型。[结果/结论] 专家检验表明,ELKDL方法标记准确率超86.50%,远优于LLM直接判断的最佳结果(64.44%)。研究进一步验证了该方法在跨领域、跨层级任务的有效性,证明该方法可实现政策模糊性的大规模、高质量、自动化测度,既为政策研究、制定与执行提供创新方法,也为领域专家知识与LLM的融合提供范例。

本文引用格式

冯迅 , 武楷彪 , 柳苏洋 , 董瑜 . 基于知识增强大模型的政策模糊性测度方法研究[J]. 图书情报工作, 2026 , 70(20) : 69 -83 . DOI: 10.13266/j.issn.0252-3116.2026.20.006

Abstract

[Purpose/Significance] Policy ambiguity serves as a pivotal governance mechanism for governments to forge consensus and catalyze innovation in complex scenarios. Its significance is increasingly prominent against the backdrop of escalating global governance complexity and diversifying social interests. However, existing methods struggle with the large-scale, precise measurement of policy ambiguity. Developing a new measurement method to grasp its overall trends and evolutionary patterns is therefore of great significance for the demands of increasingly sophisticated national governance. [Method/Process] This study integrates expert knowledge with large language models to propose a novel policy ambiguity measurement method—ELKDL(Expert-Linguistics-Knowledge-Driven LLM). The method begins by extracting lexical-level ambiguity knowledge units via linguistic parsing. It then uses minimal expert annotations to drive the LLM in constructing a domain knowledge base. This knowledge base is subsequently used to guide the LLM in completing the ambiguity tagging of policy directive sentences, thereby enhancing the breadth and depth of the measurement. Concurrently, the study employed knowledge distillation to build high-precision models for directive identification(95.97%) and ambiguity tagging(92.01%), which were integrated with sentence segmentation and computational modules to form the complete measurement model. [Result/Conclusion] Expert validation demonstrates that the ELKDL method achieves a tagging accuracy exceeding 86.5%, significantly outperforming the best result from direct LLM judgment(64.44%). The study further verified the method's effectiveness in cross-domain and cross-hierarchical tasks, proving its capability for large-scale, high-quality, and automated measurement of policy ambiguity. This work not only provides an innovative methodology for policy research, formulation, and implementation but also offers a paradigm for integrating domain expert knowledge with large language models.

参考文献

[1] 戴雨桐.政策模糊性在中国政策执行过程中的认知分析--以惠企政策为例[D].长春:吉林大学, 2021.(DAI Y T.Cognitive analysis of policy ambiguity in the process of policy implementation in China--taking preferential enterprise policy as an example[D]. Changchun:Jilin University, 2021.)
[2] 吴少微,杨忠.中国情境下的政策执行问题研究[J].管理世界, 2017(2):85-96.(WU S W, YANG Z. Research on policy implementation issues in the Chinese context[J]. Journal of management world, 2017(2):85-96.)
[3] MATLAND R E. Synthesizing the implementation literature:the ambiguity-conflict model of policy implementation[J]. Journal of public administration research and theory, 1995, 5(2):145-174.
[4] LEONG C, QIAN N. Ambiguity, bureaucracy and certainty:the ABCs of enabling water self-sufficiency[J]. Policy and society,2016, 35(2):165-178.
[5] 姜玲,杜辉煌.执行中的再设计:地方政府落实高模糊性政策的过程与逻辑[J].中国行政管理, 2024, 40(12):105-117.(JIANG L, DU H H. Executing in design:process logic and influencing factors of local government responses to highambiguity policies--a case study of resilient city construction in China[J]. Chinese public administration, 2024, 40(12):105-117.)
[6] 张竞衔,郑思尧,孟天广.政治统领与国家治理--基于对中央全面深化改革委员会的分析[J].社会科学, 2025(10):105-120.(ZHANG J X, ZHENG S Y, MENG T G. Political steering and state governance:a study on central committee for comprehensively deepening reform[J]. Journal of social sciences,2025(10):105-120.)
[7] O'BRIEN K J, LI L. Selective policy implementation in rural China[J]. Comparative politics, 1999, 31(2):167-186.
[8] 胡业飞,崔杨杨.模糊政策的政策执行研究--以中国社会化养老政策为例[J].公共管理学报, 2015, 12(2):93-105, 157.(HU Y F, CUI Y Y. Implementation of ambiguous policy:the case of socialized aged care service policy in China[J]. Journal of public management, 2015, 12(2):93-105, 157.)
[9] 吴宾,齐昕.如何识别政策执行中的政策模糊性与冲突性?——基于政策文献量化方法的探索性研究[J].理论学刊, 2020(3):101-110.(WU B, QI X. How to identify policy ambiguity and conflict in policy implementation?——an exploratory study on the quantitative method of policy documents[J]. Theory journal, 2020(3):101-110.)
[10] 李威璎,徐玲."政策弹性·利益相关者"二维框架下的"双减"政策研究--基于27个省、市、自治区政策文本的分析[J].教育科学研究, 2023(1):22-29.(LI W Y, XU L. Research on "Double Reduction" policy under the two-dimensional framework of "Policy Elasticity and Stakeholders" --based on the policy texts of 27 provinces and autonomous regions[J].Educational science research, 2023(1):22-29.)
[11] HILL M, HUPE P. Implementing public policy:governance in theory and in practice[M]. London:Sage Publications, 2002.
[12] 孙志建."模糊性治理"的理论系谱及其诠释:一种崭新的公共管理叙事[J].甘肃行政学院学报, 2012(3):55-71, 127.(SUN Z J. The theoretic pedigree of ambiguous governing and its interpretation:a new way of narratives for public management[J].Journal of Gansu administration institute, 2012(3):55-71, 127.)
[13] 韩志明.政策执行的模糊性及其治理效应[J].湘潭大学学报(哲学社会科学版), 2018, 42(4):30-35.(HAN Z M. The ambiguity of policy implementation and governance effect[J].Journal of Xiangtan University (philosophy and social sciences),2018, 42(4):30-35.)
[14] BAIER V E, MARCH J G, SAETREN H. Implementation and ambiguity[J]. Scandinavian journal of management studies, 1986,2(3/4):197-212.
[15] ANG Y Y. Ambiguity and clarity in China's adaptive policy communication[J]. The China quarterly, 2024, 257:20-37.
[16] 谢明.公共政策概论[M].北京:中国人民大学出版社, 2014.(XIE M. An introduction to public policy[M]. Beijing:China Renmin University Press, 2014.)
[17] CAPPELLARO G, COMPAGNI A, VAARA E. Ambiguity in organization theory:from intrinsic to strategic perspectives[M].Cambridge:Cambridge University Press, 2022.
[18] MARCH J G. Bounded rationality, ambiguity, and the engineering of choice[J]. The Bell journal of economics, 1978,9(2):587-608.
[19] EISENBERG E M. Ambiguity as strategy in organizational communication[J]. Communication monographs, 1984, 51(3):227-242.
[20] BERMAN P. The study of macro and micro implementation of social policy[J]. Public policy, 1978, 26(2):157-184.
[21] 庄垂生.政策变通的理论:概念、问题与分析框架[J].理论探讨, 2000(6):78-81.(ZHUANG C S. The theory of policy accommodation:concepts, problems and analytical framework[J].Theoretical investigation, 2000(6):78-81.)
[22] 杜其君.政策细化能消解政策模糊吗?——基于中间层政府行动偏差的反思[J].吉首大学学报(社会科学版), 2025,46(2):155-165.(DU Q J. Can policy refinement eliminate policy ambiguity?——reflections based on the action deviation of the intermediate layer[J]. Journal of Jishou University (social sciences), 2025, 46(2):155-165.)
[23] CHUN Y H, RAINEY H G. Goal ambiguity and organizational performance in U.S. federal agencies[J]. Journal of public administration research and theory, 2005, 15(4):529-557.
[24] 武楷彪,黄璜.政策模糊性的测度与演化研究--以中国政府数字化转型政策为例[J].岳麓公共治理, 2025, 4(4):15-32.(WU K B, HUANG H. Measurement and evolution of policy ambiguity:a case study of China government digital transformation policies[J]. Yuelu public governance, 2025, 4(4):15-32.)
[25] 李钢.公共政策内容分析方法:理论与应用[M].重庆:重庆大学出版社, 2007.(LI G. Methods of public policy content analysis:theory and application[M]. Chongqing:Chongqing University Press, 2007.)
[26] HOLLIBAUGH G E, JR. The use of text as data methods in public administration:a review and an application to agency priorities[J]. Journal of public administration research and theory,2019, 29(3):474-490.
[27] GRIMMER J, STEWART B M. Text as data:the promise and pitfalls of automatic content analysis methods for political texts[J]. Political analysis, 2013, 21(3):267-297.
[28] 郑新曼,董瑜.政策文本量化研究的综述与展望[J].现代情报, 2021, 41(2):168-177.(ZHENG X M, DONG Y. Review on quantitative analysis of political texts[J]. Journal of modern information, 2021, 41(2):168-177.)
[29] 冯惠玲,周文泓,文利君,等.政策计量方法在档案政策法规研究中的价值与应用[J].档案学通讯, 2024(1):4-11.(FENG H L, ZHOU W H, WEN L J, et al. The value and application of policy documents quantitative research in archival policy and regulation research[J]. Archives science bulletin, 2024(1):4-11.)
[30] WINDSOR L, DOWELL N, WINDSOR A, et al. Leader language and political survival strategies[J]. International interactions, 2018, 44(2):321-336.
[31] 林西,董瑜,郑新曼.情感分析视角下政府注意力配置量化研究--以国务院政府工作报告为例[J].图书情报工作, 2024,68(11):136-147.(LIN X, DONG Y, ZHENG X M. Quantitative research on government attention allocation from sentiment analysis perspective:based on the government work report[J].Library and information service, 2024, 68(11):136-147.)
[32] ZHANG Y, HUANG B, YUAN W, et al. Expert-level policy style measurement via knowledge distillation with large language model collaboration[J]. Information processing and management,2025, 62(4):104090.
[33] 韩红旗,张均胜,周则旭,等.大模型辅助发现新颖科研问题的方法[J].图书情报工作, 2025, 69(17):72-83.(HAN H Q, ZHANG J S, ZHOU Z X, et al. Discovering novel research problems using text generation technology based on large language model[J]. Library and information service, 2025,69(17):72-83.)
[34] ÜVEGES I, RING O. HunEmBERT:a fine-tuned BERT-model for classifying sentiment and emotion in political communication[J].IEEE access, 2023, 11:60267-60278.
[35] JI Z, LEE N, FRIESKE R, et al. Survey of hallucination in natural language generation[J]. ACM computing surveys, 2023,55(12):38.
[36] 钱明辉,李胡蓉,杨建梁.大语言模型可信:内涵、影响、挑战与对策[J].图书情报工作, 2024, 68(20):69-86.(QIAN M H, LI H R, YANG J L. Large language models trustworthiness:connotation, influence, challenges and strategy[J]. Library and information service, 2024, 68(20):69-86.)
[37] 胡吉明,付文麟,钱玮,等.融合主题模型和注意力机制的政策文本分类模型[J].情报理论与实践, 2021, 44(7):159-165.(HU J M, FU W L, QIAN W, et al. Research on policy text classification model based on topic model and attention mechanism[J]. Information studies:theory&application, 2021,44(7):159-165.)
[38] ZHANG Y, WANG Z, HE Z, et al. BB-GeoGPT:a framework for learning a large language model for geographic information science[J]. Information processing and management, 2024, 61(5):103808.
[39] 滕婕,贺荒兰,胡广伟,等.基于大语言模型的网络问政文本细粒度情感识别方法[J].现代情报, 2025, 45(9):58-70,107.(TENG J, HE H L, HU G W, et al. A fine-grained sentiment recognition method for online government-public interaction texts based on large language models[J]. Journal of modern information, 2025, 45(9):58-70, 107.)
[40] HEYDARI M H, HEMMAT A, NAMAN E, et al. Context awareness gate for retrieval augmented generation[J]. arXiv preprint, 2024:arXiv:2411.16133.
[41] LU J, PANG Z, XIAO M, et al. Merge, ensemble, and cooperate!A survey on collaborative strategies in the era of large language models[J]. arXiv preprint, 2024:arXiv:2407.06089.
[42] ZHENG Z, CHENG Z, SHEN Z, et al. LiveCodeBench Pro:how do Olympiad medalists judge LLMs in competitive programming?[J]. arXiv preprint, 2025:arXiv:2506.11928.
[43] 金立,刘云婷.汉语指令行为的逻辑语义分析[J].浙江社会科学, 2008(10):70-75, 127.(JIN L, LIU Y T. The logical analysis of Chinese directives[J]. Zhejiang social sciences, 2008(10):70-75, 127.)
[44] 赵微.指令行为与汉语祈使句研究[D].上海:复旦大学,2005.(ZHAO W. On directives and Chinese imperatives[D].Shanghai:Fudan University, 2005.)
[45] 陈永莉.汉语动词与相关句法成分的语序研究[D].北京:中央民族大学, 2007.(CHEN Y L. A study on the word order of Chinese verbs and their related syntactic components[D].Beijing:Minzu University of China, 2007.)
[46] 高耀墀.现代汉语语法[M].郑州:中州书画社, 1982.(GAO Y C. Modern Chinese grammar[M]. Zhengzhou:Zhongzhou Calligraphy and Painting Press, 1982.)
[47] BROWN T, MANN B, RYDER N, et al. Language models are few-shot learners[J]. Advances in neural information processing systems, 2020, 33:1877-1901.
[48] 陆伟,刘寅鹏,石湘,等.大模型驱动的学术文本挖掘--推理端指令策略构建及能力评测[J].情报学报, 2024, 43(8):946-959.(LU W, LIU Y P, SHI X, et al. Large language modeldriven academic text mining:construction and evaluation of inference-end prompting strategy[J]. Journal of the China Society for Scientific and Technical Information, 2024, 43(8):946-959.)
[49] KOJIMA T, GU S S, REID M, et al. Large language models are zero-shot reasoners[J]. Advances in neural information processing systems, 2022, 35:22199-22213.
[50] SUZGUN M, SCALES N, SCHÄRLI N, et al. Challenging BIGbench tasks and whether chain-of-thought can solve them[C]//Proceedings of the 61st annual conference of the association for computational linguistics. Stroudsburg:Association for Computational Linguistics, 2023:13003-13051.
[51] SAHOO P, SINGH A K, SAHA S, et al. A systematic survey of prompt engineering in large language models:techniques and applications[J]. arXiv preprint, 2024:arXiv:2402.07927.
文章导航

/

〈 〉