[Purpose/Significance] The burgeoning generative AI technologies and tools have found extensive application in the field of information resource management. However, due to their inherent defects, the security risks of the generated content cannot be avoided, which hinders further promotion and application in this field. Given that there is no fundamental improvement in the security of AI in the short term, it is necessary to rely on management means to carry out risk control. [Method/Process] This study analyzed the trustworthiness of the existing AI-generated content from a cognitive perspective. Focusing on the whole life cycle of information resource management, it introduced the principles and ideas of ISO 27000 series of information security management standards, and determined the information asset attributes of AIGC in each link of information resource management. Finally, it proposed fundamental approaches and framework for risk assessment and control of AIGC. [Result/Conclusion] Risk management and control of AIGC in information resource management can be divided into two stages of risk assessment and control according to the principles of ISO 27000. Through systematic and standardized risk management and control methods, the application risk of generative AI can be effectively reduced, and the efficiency and quality of information resource management activities can be improved.
Song Xiaoxuan
,
Liu Liu
,
Huang Shuiqing
. Fundamental Approaches and Framework for Risk Management and Control of AI-Generated Content in Information Resource Management[J]. Library and Information Service, 2025
, 69(20)
: 30
-38
.
DOI: 10.13266/j.issn.0252-3116.2025.20.003
[1] 冯志伟, 张灯柯, 饶高琦. 从图灵测试到ChatGPT——人机对话的里程碑及启示[J]. 语言战略研究, 2023, 8(2): 20-24. (FENG Z W, ZHANG D K, RAO G Q. From Turing test to ChatGPT: a milestone of man-machine interaction and its enlightenment[J]. Chinese journal of language policy and planning, 2023, 8(2): 20-24.)
[2] 令小雄, 王鼎民, 袁健. ChatGPT爆火后关于科技伦理及学术伦理的冷思考[J]. 新疆师范大学学报(哲学社会科学版), 2023, 44(4): 123-136. (LING X X, WANG D M, YUAN J. Reflection on technology ethics and academic ethics in the context of ChatGPT craze[J]. Journal of Xinjiang Normal University (edition of philosophy and social sciences), 2023, 44(4): 123-136.)
[3] 陆小华. ChatGPT等智能内容生成与新闻出版业面临的智能变革[J]. 中国出版, 2023(5): 8-15. (LU X H. Intelligent content generation by ChatGPT and the intelligent transformation facing the news and publishing industry[J]. China publishing journal, 2023(5): 8-15.)
[4] 周洪宇, 李宇阳. ChatGPT对教育生态的冲击及应对策略[J]. 新疆师范大学学报(哲学社会科学版), 2023, 44(4): 102-112. (ZHOU H Y, LI Y Y. The impact of ChatGPT on education ecology and strategies to cope with it[J]. Journal of Xinjiang Normal University (edition of philosophy and social sciences), 2023, 44(4): 102-112.)
[5] 孔祥维, 王子明, 王明征, 等.人工智能使能系统的可信决策：进展与挑战[J].管理工程学报, 2022, 36(6): 1-14. (KONG X W, WANG Z M, WANG M Z, et al. Trustworthy decision-making in artificial intelligence-enabled systems: progress and challenges[J]. Journal of industrial engineering and engineering management, 2022, 36(6): 1-14.)
[6] 何丽.人工智能可以作为置信对象吗?——为可信人工智能辩护[J].科学学研究, 2023, 41(10): 1729-1736. (HE L. Can artificial intelligence serve as trustee? A defense of trustworthy AI[J]. Studies in science of science, 2023, 41(10): 1729-1736.)
[7] 黄水清. 数字图书馆信息安全管理[M]. 南京：南京大学出版社, 2011. (HUANG S Q. Information security management of digital libraries[M]. Nanjing: Nanjing University Press, 2011.)
[8] MINSKY M L. Semantic information processing[M]. Cambridge: The MIT Press, 1968.
[9] Center for AI safety. Statement on AI risk[EB/OL]. [2025-06-10]. https://www.safe.ai/statement-on-ai-risk#open-letter.
[10] CHOMSKY N, ROBERTS I, WATUMULL J. Noam Chomsky: the false promise of ChatGPT[N]. The New York times, 2023-03-08.
[11] 于剑.图灵测试的明与暗[J].计算机研究与发展, 2020, 57(5): 906-911. (YU J. Brilliance and darkness: Turing test [J]. Journal of computer research and development, 2020, 57(5): 906-911.)
[12] GARDNER H E. Frames of mind: the theory of multiple intelligences[M]. New York: Basic Books, 2011.
[13] NILSSON N J. The quest for artificial intelligence: a history of ideas and achievements[M]. Cambridge: Cambridge University Press, 2009.
[14] 全国标准化技术委员会. 术语工作词汇第1部分: 理论与应用: GB/T 15237.1-2000[S]. 北京: 中国标准出版社, 2000. (National Standardization Administration of the People’s Republic of China. Terminology work-Vocabulary-Part 1: Theory and application: GB/T 15237.1-2000[S]. Beijing: China Standards Press, 2000.)
[15] 于剑.语言与图灵测试[J].自动化学报, 2016, 42(5): 668-669. (YU J. Language and Turing test[J]. Acta automatica sinica, 2016, 42(5): 668-669.)
[16] ISO/IEC 27000:2018. Information technology—Security techniques—Information security management systems—Overview and vocabulary[S]. Geneva: International Organization for Standardization, 2018.
[17] 国家信息安全标准化技术委员会. 生成式人工智能服务安全基本要求（征求意见稿）[EB/OL]. [2025-06-10]. https://www.cls.cn/detail/1483839. (National Information Security Standardization Technical Committee. Basic security requirements for generative artificial intelligence services (draft for comments) [EB/OL]. [2025-06-10]. https://www.cls.cn/detail/1483839.)
[18] 曹茹烨, 曹树金. ChatGPT完成知识组织任务的效果及启示[J].情报资料工作, 2023, 44(5): 18-27. (CAO R Y, CAO S J. The effect and enlightenment of ChatGPT in completing knowledge organization tasks[J]. Information and documentation services, 2023, 44(5): 18-27.)
[19] 赵浜, 曹树金.国内外生成式AI大模型执行情报领域典型任务的测试分析[J].情报资料工作, 2023, 44(5): 6-17. (ZHAO B, CAO S J. Test analysis of typical tasks in the information field performed by generative AI large models at home and abroad [J]. Information and documentation services, 2023, 44(5): 6-17.)
[20] 王雅琪, 曹树金. ChatGPT用于论文创新性评价的效果及可行性分析[J].情报资料工作, 2023, 44(5): 28-38. (WANG Y Q, CAO S J. The effect and feasibility analysis of ChatGPT used in paper innovativeness evaluation[J]. Information and documentation services, 2023, 44(5): 28-38.)
[21] 曹树金, 曹茹烨. 从ChatGPT看生成式AI对情报学研究与实践的影响[J].现代情报, 2023, 43(4): 3-10. (CAO S J, CAO R Y. Influence of generative AI on the research and practice of information science from the perspective of ChatGPT [J]. Journal of modern information, 2023, 43(4): 3-10.)
[22] VECTARA. Hughes Hallucination Evaluation Model (HHEM) leaderboard [EB/OL]. [2025-06-10]. https://huggingface.co/spaces/vectara/leaderboard.
[23] ISO/IEC 27005:2018. Information technology—security techniques—information security risk management[S]. Geneva: International Organization for Standardization, 2018.
[24] ISO/IEC 27002:2013. Information technology—security techniques—code of practice for information security controls[S]. Geneva: International Organization for Standardization, 2013.
[25] ISO/IEC 27002:2022. Information security, cybersecurity and privacy protection—Information security controls[S]. Geneva: International Organization for Standardization, 2022.
