专家视点

人工智能语料图书馆:内涵、功能需求与建设路径

  • 刘细文 ,
  • 钱力 ,
  • 涂志芳
展开
  • 1 中国科学院文献情报中心 北京 100190;
    2 中国科学院大学经济与管理学院信息资源管理系 北京 100190
刘细文,研究员,博士,博士生导师,E-mail:liuxw@mail.las.ac.cn;钱力,正高级工程师,博士;涂志芳,副研究馆员,博士。

收稿日期: 2025-12-27

  修回日期: 2026-01-13

  网络出版日期: 2026-02-12

基金资助

本文系国家自然科学基金重点项目“数智赋能的科技信息资源与知识管理理论变革”(项目编号:72234005)研究成果之一。

Artificial Intelligence Corpus Library: Connotations, Functional Requirement, and Construction Pathways

  • Liu Xiwen ,
  • Qian Li ,
  • Tu Zhifang
Expand
  • 1 National Science Library, Chinese Academy of Sciences, Beijing 100190;
    2 Department of Information Resource Management, School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100190

Received date: 2025-12-27

  Revised date: 2026-01-13

  Online published: 2026-02-12

Supported by

This work is supported by the Key Project of the National Natural Science Foundation of China, titled “Theoretical Transformation of Scientific and Technological Information Resources and Knowledge Management Empowered by Digital Intelligence” (Grant No. 72234005).

摘要

[目的/意义]在AI4S加速发展和国家“人工智能+科学技术”战略背景下,高质量、可计算的语料资源已成为支撑大模型预训练与智能科学发现的核心要素。图书馆作为社会基础设施,其功能正面临向人工智能语料建设与服务转型的现实要求。界定“人工智能语料图书馆”的内涵和核心功能,为相关理论研究与建设实践提供参考。[方法/过程]通过概念辨析与演进分析,厘清人工智能语料图书馆的本质特征,将其阐释为“数据库×语料库×数字图书馆”的深度融合与功能重构。从技术演进、社会应用及监管治理3个维度剖析其功能需求,并结合美国HathiTrust的“文本即数据”模式与英国国家图书馆的“数字学术”实践,总结数字图书馆向语料图书馆的转型逻辑。[结果/结论]研究认为,人工智能语料图书馆是以多模态、可计算语料为核心对象的新型知识基础设施,支撑智能设施的高效稳定运行,是实现人工智能治理的有效途径之一。其建设应遵循以数据驱动为顶层逻辑、以知识组织为中间机制、以智能体应用为功能创新的架构体系。通过既有馆藏数据的语料化升级,语料图书馆构建“非消耗式利用”增值服务模式,嵌入数字学术流程,实现功能拓展与智能升级。

本文引用格式

刘细文 , 钱力 , 涂志芳 . 人工智能语料图书馆:内涵、功能需求与建设路径[J]. 图书情报工作, 2026 , 70(4) : 3 -12 . DOI: 10.13266/j.issn.0252-3116.2026.04.001

Abstract

[Purpose/Significance] Under the backdrop of the accelerated development of AI for Science (AI4S) and national strategies on “AI + Science and Technology”, high-quality, computable corpus resources have become a critical factor for large-model pretraining and intelligent scientific discovery. As the social infrastructures, libraries are facing growing demands to transform toward the construction and provision of AI-oriented corpus resources and services. The article aims to clarify the annotation of the “AI corpus library” and to provide a reference framework for related theoretical research and practical implementation. [Method/Process] By employing conceptual and evolutionary analysis, the article clarifies the essential characteristics of the AI corpus library, interpreting it as a deep integration and functional reconstruction of “Database × Corpus × Digital Library”. It analyzes functional requirements from three dimensions: technological evolution, social application, and regulatory governance. Furthermore, by synthesizing the “text-as-data” model of HathiTrust and the “digital scholarship” practice of the British Library, the paper systematically summarizes the evolutionary logic of the transition from digital libraries to AI corpus libraries. [Result/Conclusion] The study shows that the AI corpus library is a new type of knowledge infrastructure oriented toward “human-machine agent” entities, with multi-modal and computable corpora as its core organizational objects. Its construction should follow an architectural system characterized by data-driven top-level logic, knowledge organization as the intermediate mechanism, and agent-based applications as the functional innovation. The corpusization of existing library collections, the establishment of “non-consumptive use” governance mechanisms, and the embedding of corpus services into digital scholarship workflows represent effective paths for libraries to achieve functional expansion and intelligent upgrading.

参考文献

[1] 国务院. 国务院关于深入实施“人工智能+”行动的意见[EB/OL]. [2025-10-20]. https://www.gov.cn/zhengce/content/202508/content_7037861.htm. (China State Council. Opinions on deepening the implementation of the “AI+” action[EB/OL]. [2025-10-20]. https://www.gov.cn/zhengce/content/202508/content_7037861.htm.)
[2] UK Government. AI for science strategy[EB/OL]. [2025-12-08]. https://www.gov.uk/government/publications/ai-for-science-strategy/ai-for-science-strategy.
[3] The White House. Launching the genesis mission[EB/OL]. [2025-12-08]. https://www.whitehouse.gov/presidential-actions/2025/11/launching-the-genesis-mission/.
[4] US Department of Energy. Genesis mission: a national mission to accelerate science through artificial intelligence [EB/OL]. [2025-12-08]. https://genesis.energy.gov/.
[5] 李国杰. 智能化科研(AI4R):第五科研范式[J]. 中国科学院院刊, 2024, 39(1): 1-9. (LI G J. AI4R: the fifth scientific research paradigm[J]. Bulletin of Chinese Academy of Sciences, 2024, 39(1): 1-9.)
[6] 邱宝华. 人工智能大模型需牵住语料“牛鼻子”[N]. 学习时报, 2025-11-28(3). (QIU B H. AI large models must grasp the key of training data[N]. Study times, 2025-11-28(3).)
[7] LAION-5B[EB/OL]. [2025-12-09]. https://laion.ai/blog/laion-5b/.
[8] Common Crawl[EB/OL]. [2025-12-09]. https://commoncrawl.org/.
[9] ImageNet[EB/OL]. [2025-12-09]. https://www.image-net.org/.
[10] QIU P C, WU C Y, ZHANG X M, et al. Towards building multilingual language model for medicine[J]. Nature communication, 2024, 15: 8384.
[11] Food and agriculture organization of the United Nations. AGROVOC[EB/OL]. [2025-12-09]. https://www.fao.org/agrovoc/.
[12] The materials project[EB/OL]. [2025-12-09]. https://next-gen.materialsproject.org/.
[13] 陈强, 邢窈窈. 面向生成式人工智能的语料库建设:现状、挑战与未来策略[J]. 社会科学, 2025(6): 177-192. (CHEN Q, XING Q Q. Corpus development for generative AI: current landscape, challenges, and strategic pathways[J]. Journal of social sciences, 2025(6): 177-192.)
[14] 蔡琳. 生成式人工智能语料来源可追溯义务的法律构造[J]. 江苏社会科学, 2025(2): 161-169, 243-244. (CAI L. The legal framework for the obligation of traceability of corpus sources in generative artificial intelligence[J]. Jiangsu social sciences, 2025(2): 161-169, 243-244.)
[15] 王立梅, 王迁, 陶乾, 等. 人工智能语料库建设的法律问题[J]. 数字法治, 2024(5): 28-46. (WANG L M, WANG Q, TAO Q, et al. Legal issues in the development of corpus for artificial intelligence[J]. Digital law, 2024(5): 28-46.)
[16] 张晓林. “人工智能+”背景下的高质量数据集建设:图书馆的机遇与挑战[J]. 中国图书馆学报, 2025, 51(6): 4-17. (ZHANG X L. High-quality dataset construction in Al + environment: library’s opportunities and challenges[J]. Journal of library science in China, 2025, 51(6): 4-17.)
[17] 阮冈纳赞. 图书馆学五定律[M]. 夏云, 王先林,郑挺, 等译. 北京: 书目文献出版社, 1988: 308-337. (RANGANATHAN S R. The five laws of library science[M]. XIA Y, WANG X L, ZHENG T, et al, trans. Beijing: Bibliography and Document Publishing House, 1988: 308-337.)
[18] 金胜勇, 张吻秋. 关于图书馆社会功能的再认识[J]. 图书馆, 2014(6): 38-41. (JIN S Y, ZHANG W Q. Recognition of library social function[J]. Library, 2014(6): 38-41.)
[19] 王世伟. 对公共图书馆“传承文明、服务社会”三大功能的再认识[J]. 图书馆杂志, 2019, 38(10): 24-28. (WANG S W. Recognition of the three functions of public library in inheriting civilization and serving society[J]. Library journal, 2019, 38(10): 24-28.)
[20] 蒋永福. 图书馆与知识组织——从知识组织的角度理解图书馆学[J]. 中国图书馆学报, 1999(5): 19-23. (JIANG Y F. Library and knowledge organisation: understanding library science from the point of view of knowledge organisation[J]. Journal of library science in China, 1999(5): 19-23.)
[21] 贾君枝. 从编目到元数据管理:图书馆知识组织的发展路径[J]. 中国图书馆学报, 2023, 49(2): 121-131. (JIA J Z. From cataloging to metadata management: the development of library knowledge organization[J]. Journal of library science in China, 2023, 49(2): 121-131.)
[22] 程焕文, 钟远薪. 智慧图书馆的三维解析[J]. 图书馆论坛, 2021, 41(6): 43-55. (CHENG H W. Three dimensional analysis of smart library[J]. Library tribune, 2021, 41(6): 43-55.)
[23] 黄宗忠. 试谈图书馆的藏与用[J]. 武汉大学学报(人文科学), 1962(2): 91-98. (HUANG Z Z. On the collection and utilization of libraries[J]. Journal of Wuhan University (humanities science), 1962(2): 91-98.)
[24] 彭俊婷. 对图书馆“藏”与“用”的思考[J]. 北京师范学院学报(社会科学版), 1991(3): 105-109, 57. (PENG J T. Reflections on the “collection” and “utilization” of libraries[J]. Journal of Beijing Normal College (social sciences edition), 1991(3): 105-109, 57.)
[25] FOX E A, AKSCYN R M, FURUTA R K, et al. Digital libraries[J]. Communications of the ACM, 1995, 38(4): 22-28.
[26] 赵洗尘. 数字图书馆及其建设[J]. 现代图书情报技术, 1999(1): 28-31, 43. (ZHAO X C. Research and Construction of the Digital Library[J]. Modern library and information technology, 1999(1): 28-31, 43.)
[27] 王世伟. 论智慧图书馆的三大特点[J]. 中国图书馆学报, 2012, 38(6): 22-28. (WANG S W. On Three main features of the smart library[J]. Journal of library science in China, 2012, 38(6): 22-28.)
[28] 吕婷钰, 李晓瑛, 张颖, 等. 中文医学知识大模型问答语料数据集构建研究[J]. 医学信息学杂志, 2024, 45(5): 20-25. (LÜ T Y, LI X Y, ZHANG Y, et al. Study on the construction of a question-answer corpus dataset for Chinese medical knowledge large language models[J]. Journal of medical informatics, 2024, 45(5): 20-25.)
[29] 张晓林, 梁娜. 知识的智慧化、智慧的场景化、智能的泛在化——探索智慧知识服务的逻辑框架[J]. 中国图书馆学报, 2023, 49(3): 4-18. (ZHANG X L, LIANG N. Knowledge is towards being wisdom, wisdom needs to be scenario-based, and intelligence can be ubiquitously embedded exploration of the logical framework of intelligent knowledge services[J]. Journal of library science in China, 2023, 49(3): 4-18.)
[30] JOHNSON R, REFSUM C. Governing in the age of AI: building Britain’s national data library[R/OL]. [2025-10-30]. https://institute.global/insights/tech-and-digitalisation/governing-in-the-age-of-ai-building-britains-national-data-library.
[31] 刘细文, 付芸. 数智赋能背景下情报学研究进展——数据驱动、模型驱动与知识发现[J]. 情报学进展, 2024, 15(12): 131-171. (LIU X W, FU Y. The research advancements in information science amidst data & Al empowerment: data-driven, model-driven and knowledge discovery[J]. Advances in information science, 2024, 15(12): 131-171.)
[32] 陈昱成, 韩涛, 胡正银. 科技文献文本知识抽取的提示框架研究[J/OL]. [2025-12-18]. https://link.cnki.net/urlid/22.1182.G3.20250923.1636.006. (CHEN Y C, HAN T, HU Z Y. Research on the hint framework for knowledge extraction from scientific and technological literature text[J/OL]. [2025-12-18]. https://link.cnki.net/urlid/22.1182.G3.20250923.1636.006.)
[33] 赵晨阳, 王德胜, 张峻, 等. 异构资源组织与关联发现技术的应用[J]. 计算机与网络, 2019, 45(11): 69-71. (ZHAO C Y, WANG D S, ZHANG J, et al. Application of heterogeneous resource organization and association discovery technology[J]. Computer and network, 2019, 45(11): 69-71.)
[34] 刘细文, 孙蒙鸽, 付芸. 从管理信息系统到情报智能体:重塑科技情报工作范式[J]. 图书情报工作, 2025, 69(17): 3-15. (LIU X W, SUN M G, FU Y. From MIS to DIS agent: reshaping the paradigm of S&T documentation and information service[J]. Library and information service, 2025, 69(17): 3-15.)
[35] 郭利敏, 刘悦如, 付雅明. 面向生成式智能体的图书馆系统架构与转型研究[J]. 农业图书情报学报, 2025, 37(12): 36-47. (GUO L M, LIU Y R, FU Y M. Design and transformation pathways of library systems driven by generative agents[J]. Journal of library and information science in agriculture, 2025, 37(12): 36-47.)
[36] HathiTrust[EB/OL]. [2025-12-19]. https://www.hathitrust.org/.
[37] HathiTrust research center[EB/OL]. [2025-12-19]. https://www.hathitrust.org/about/research-center/.
[38] HathiTrust. Research center analytics[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/.
[39] HathiTrust. Derived datasets[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/deriveddatasets.
[40] HathiTrust. Non-consumptive use policy[EB/OL]. [2025-12-19]. https://www.hathitrust.org/the-collection/terms-conditions/non-consumptive-use-policy/.
[41] HathiTrust. Worksets[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/staticworksets.
[42] HathiTrust. Bookworm[EB/OL]. [2026-01-08]. https://bookworm.htrc.illinois.edu/develop/.
[43] HathiTrust. Algorithms[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/statisticalalgorithms
[44] HathiTrust. Data capsules[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/staticcapsules.
[45] British Library. AI and machine learning with British Library collections[EB/OL]. [2025-12-19]. https://www.bl.uk/stories/blogs/posts/ai-and-machine-learning-with-british-library-collections.
[46] CANDELA G. Collections as Data: Getting Started[EB/OL]. [2026-01-08]. https://bl.iro.bl.uk/concern/generic_works/dbc38f7b-664c-42ec-8c7d-c6db095ddefd.
[47] British Library. British Library Labs: Projects[EB/OL]. [2025-12-19]. https://bl.iro.bl.uk/collections/36116aa1-7037-40f3-9b91-ecb1be15e226?locale=it&view=gallery.
[48] British Library. Digital scholarship & data science topic guides[EB/OL]. [2025-12-19]. https://bl.iro.bl.uk/collections/a4e0122e-c4c9-47e4-b5c9-7921baedea5b?locale=en.
[49] British Library. Living with machines[EB/OL]. [2026-01-08]. https://livingwithmachines.ac.uk/.
文章导航

/

〈 〉