[Purpose/Significance] Under the backdrop of the accelerated development of AI for Science (AI4S) and national strategies on “AI + Science and Technology”, high-quality, computable corpus resources have become a critical factor for large-model pretraining and intelligent scientific discovery. As the social infrastructures, libraries are facing growing demands to transform toward the construction and provision of AI-oriented corpus resources and services. The article aims to clarify the annotation of the “AI corpus library” and to provide a reference framework for related theoretical research and practical implementation. [Method/Process] By employing conceptual and evolutionary analysis, the article clarifies the essential characteristics of the AI corpus library, interpreting it as a deep integration and functional reconstruction of “Database × Corpus × Digital Library”. It analyzes functional requirements from three dimensions: technological evolution, social application, and regulatory governance. Furthermore, by synthesizing the “text-as-data” model of HathiTrust and the “digital scholarship” practice of the British Library, the paper systematically summarizes the evolutionary logic of the transition from digital libraries to AI corpus libraries. [Result/Conclusion] The study shows that the AI corpus library is a new type of knowledge infrastructure oriented toward “human-machine agent” entities, with multi-modal and computable corpora as its core organizational objects. Its construction should follow an architectural system characterized by data-driven top-level logic, knowledge organization as the intermediate mechanism, and agent-based applications as the functional innovation. The corpusization of existing library collections, the establishment of “non-consumptive use” governance mechanisms, and the embedding of corpus services into digital scholarship workflows represent effective paths for libraries to achieve functional expansion and intelligent upgrading.
[1] 国务院. 国务院关于深入实施“人工智能+”行动的意见[EB/OL]. [2025-10-20]. https://www.gov.cn/zhengce/content/202508/content_7037861.htm. (China State Council. Opinions on deepening the implementation of the “AI+” action[EB/OL]. [2025-10-20]. https://www.gov.cn/zhengce/content/202508/content_7037861.htm.)
[2] UK Government. AI for science strategy[EB/OL]. [2025-12-08]. https://www.gov.uk/government/publications/ai-for-science-strategy/ai-for-science-strategy.
[3] The White House. Launching the genesis mission[EB/OL]. [2025-12-08]. https://www.whitehouse.gov/presidential-actions/2025/11/launching-the-genesis-mission/.
[4] US Department of Energy. Genesis mission: a national mission to accelerate science through artificial intelligence [EB/OL]. [2025-12-08]. https://genesis.energy.gov/.
[5] 李国杰. 智能化科研(AI4R):第五科研范式[J]. 中国科学院院刊, 2024, 39(1): 1-9. (LI G J. AI4R: the fifth scientific research paradigm[J]. Bulletin of Chinese Academy of Sciences, 2024, 39(1): 1-9.)
[6] 邱宝华. 人工智能大模型需牵住语料“牛鼻子”[N]. 学习时报, 2025-11-28(3). (QIU B H. AI large models must grasp the key of training data[N]. Study times, 2025-11-28(3).)
[7] LAION-5B[EB/OL]. [2025-12-09]. https://laion.ai/blog/laion-5b/.
[8] Common Crawl[EB/OL]. [2025-12-09]. https://commoncrawl.org/.
[9] ImageNet[EB/OL]. [2025-12-09]. https://www.image-net.org/.
[10] QIU P C, WU C Y, ZHANG X M, et al. Towards building multilingual language model for medicine[J]. Nature communication, 2024, 15: 8384.
[11] Food and agriculture organization of the United Nations. AGROVOC[EB/OL]. [2025-12-09]. https://www.fao.org/agrovoc/.
[12] The materials project[EB/OL]. [2025-12-09]. https://next-gen.materialsproject.org/.
[13] 陈强, 邢窈窈. 面向生成式人工智能的语料库建设:现状、挑战与未来策略[J]. 社会科学, 2025(6): 177-192. (CHEN Q, XING Q Q. Corpus development for generative AI: current landscape, challenges, and strategic pathways[J]. Journal of social sciences, 2025(6): 177-192.)
[14] 蔡琳. 生成式人工智能语料来源可追溯义务的法律构造[J]. 江苏社会科学, 2025(2): 161-169, 243-244. (CAI L. The legal framework for the obligation of traceability of corpus sources in generative artificial intelligence[J]. Jiangsu social sciences, 2025(2): 161-169, 243-244.)
[15] 王立梅, 王迁, 陶乾, 等. 人工智能语料库建设的法律问题[J]. 数字法治, 2024(5): 28-46. (WANG L M, WANG Q, TAO Q, et al. Legal issues in the development of corpus for artificial intelligence[J]. Digital law, 2024(5): 28-46.)
[16] 张晓林. “人工智能+”背景下的高质量数据集建设:图书馆的机遇与挑战[J]. 中国图书馆学报, 2025, 51(6): 4-17. (ZHANG X L. High-quality dataset construction in Al + environment: library’s opportunities and challenges[J]. Journal of library science in China, 2025, 51(6): 4-17.)
[17] 阮冈纳赞. 图书馆学五定律[M]. 夏云, 王先林,郑挺, 等译. 北京: 书目文献出版社, 1988: 308-337. (RANGANATHAN S R. The five laws of library science[M]. XIA Y, WANG X L, ZHENG T, et al, trans. Beijing: Bibliography and Document Publishing House, 1988: 308-337.)
[18] 金胜勇, 张吻秋. 关于图书馆社会功能的再认识[J]. 图书馆, 2014(6): 38-41. (JIN S Y, ZHANG W Q. Recognition of library social function[J]. Library, 2014(6): 38-41.)
[19] 王世伟. 对公共图书馆“传承文明、服务社会”三大功能的再认识[J]. 图书馆杂志, 2019, 38(10): 24-28. (WANG S W. Recognition of the three functions of public library in inheriting civilization and serving society[J]. Library journal, 2019, 38(10): 24-28.)
[20] 蒋永福. 图书馆与知识组织——从知识组织的角度理解图书馆学[J]. 中国图书馆学报, 1999(5): 19-23. (JIANG Y F. Library and knowledge organisation: understanding library science from the point of view of knowledge organisation[J]. Journal of library science in China, 1999(5): 19-23.)
[21] 贾君枝. 从编目到元数据管理:图书馆知识组织的发展路径[J]. 中国图书馆学报, 2023, 49(2): 121-131. (JIA J Z. From cataloging to metadata management: the development of library knowledge organization[J]. Journal of library science in China, 2023, 49(2): 121-131.)
[22] 程焕文, 钟远薪. 智慧图书馆的三维解析[J]. 图书馆论坛, 2021, 41(6): 43-55. (CHENG H W. Three dimensional analysis of smart library[J]. Library tribune, 2021, 41(6): 43-55.)
[23] 黄宗忠. 试谈图书馆的藏与用[J]. 武汉大学学报(人文科学), 1962(2): 91-98. (HUANG Z Z. On the collection and utilization of libraries[J]. Journal of Wuhan University (humanities science), 1962(2): 91-98.)
[24] 彭俊婷. 对图书馆“藏”与“用”的思考[J]. 北京师范学院学报(社会科学版), 1991(3): 105-109, 57. (PENG J T. Reflections on the “collection” and “utilization” of libraries[J]. Journal of Beijing Normal College (social sciences edition), 1991(3): 105-109, 57.)
[25] FOX E A, AKSCYN R M, FURUTA R K, et al. Digital libraries[J]. Communications of the ACM, 1995, 38(4): 22-28.
[26] 赵洗尘. 数字图书馆及其建设[J]. 现代图书情报技术, 1999(1): 28-31, 43. (ZHAO X C. Research and Construction of the Digital Library[J]. Modern library and information technology, 1999(1): 28-31, 43.)
[27] 王世伟. 论智慧图书馆的三大特点[J]. 中国图书馆学报, 2012, 38(6): 22-28. (WANG S W. On Three main features of the smart library[J]. Journal of library science in China, 2012, 38(6): 22-28.)
[28] 吕婷钰, 李晓瑛, 张颖, 等. 中文医学知识大模型问答语料数据集构建研究[J]. 医学信息学杂志, 2024, 45(5): 20-25. (LÜ T Y, LI X Y, ZHANG Y, et al. Study on the construction of a question-answer corpus dataset for Chinese medical knowledge large language models[J]. Journal of medical informatics, 2024, 45(5): 20-25.)
[29] 张晓林, 梁娜. 知识的智慧化、智慧的场景化、智能的泛在化——探索智慧知识服务的逻辑框架[J]. 中国图书馆学报, 2023, 49(3): 4-18. (ZHANG X L, LIANG N. Knowledge is towards being wisdom, wisdom needs to be scenario-based, and intelligence can be ubiquitously embedded exploration of the logical framework of intelligent knowledge services[J]. Journal of library science in China, 2023, 49(3): 4-18.)
[30] JOHNSON R, REFSUM C. Governing in the age of AI: building Britain’s national data library[R/OL]. [2025-10-30]. https://institute.global/insights/tech-and-digitalisation/governing-in-the-age-of-ai-building-britains-national-data-library.
[31] 刘细文, 付芸. 数智赋能背景下情报学研究进展——数据驱动、模型驱动与知识发现[J]. 情报学进展, 2024, 15(12): 131-171. (LIU X W, FU Y. The research advancements in information science amidst data & Al empowerment: data-driven, model-driven and knowledge discovery[J]. Advances in information science, 2024, 15(12): 131-171.)
[32] 陈昱成, 韩涛, 胡正银. 科技文献文本知识抽取的提示框架研究[J/OL]. [2025-12-18]. https://link.cnki.net/urlid/22.1182.G3.20250923.1636.006. (CHEN Y C, HAN T, HU Z Y. Research on the hint framework for knowledge extraction from scientific and technological literature text[J/OL]. [2025-12-18]. https://link.cnki.net/urlid/22.1182.G3.20250923.1636.006.)
[33] 赵晨阳, 王德胜, 张峻, 等. 异构资源组织与关联发现技术的应用[J]. 计算机与网络, 2019, 45(11): 69-71. (ZHAO C Y, WANG D S, ZHANG J, et al. Application of heterogeneous resource organization and association discovery technology[J]. Computer and network, 2019, 45(11): 69-71.)
[34] 刘细文, 孙蒙鸽, 付芸. 从管理信息系统到情报智能体:重塑科技情报工作范式[J]. 图书情报工作, 2025, 69(17): 3-15. (LIU X W, SUN M G, FU Y. From MIS to DIS agent: reshaping the paradigm of S&T documentation and information service[J]. Library and information service, 2025, 69(17): 3-15.)
[35] 郭利敏, 刘悦如, 付雅明. 面向生成式智能体的图书馆系统架构与转型研究[J]. 农业图书情报学报, 2025, 37(12): 36-47. (GUO L M, LIU Y R, FU Y M. Design and transformation pathways of library systems driven by generative agents[J]. Journal of library and information science in agriculture, 2025, 37(12): 36-47.)
[36] HathiTrust[EB/OL]. [2025-12-19]. https://www.hathitrust.org/.
[37] HathiTrust research center[EB/OL]. [2025-12-19]. https://www.hathitrust.org/about/research-center/.
[38] HathiTrust. Research center analytics[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/.
[39] HathiTrust. Derived datasets[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/deriveddatasets.
[40] HathiTrust. Non-consumptive use policy[EB/OL]. [2025-12-19]. https://www.hathitrust.org/the-collection/terms-conditions/non-consumptive-use-policy/.
[41] HathiTrust. Worksets[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/staticworksets.
[42] HathiTrust. Bookworm[EB/OL]. [2026-01-08]. https://bookworm.htrc.illinois.edu/develop/.
[43] HathiTrust. Algorithms[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/statisticalalgorithms
[44] HathiTrust. Data capsules[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/staticcapsules.
[45] British Library. AI and machine learning with British Library collections[EB/OL]. [2025-12-19]. https://www.bl.uk/stories/blogs/posts/ai-and-machine-learning-with-british-library-collections.
[46] CANDELA G. Collections as Data: Getting Started[EB/OL]. [2026-01-08]. https://bl.iro.bl.uk/concern/generic_works/dbc38f7b-664c-42ec-8c7d-c6db095ddefd.
[47] British Library. British Library Labs: Projects[EB/OL]. [2025-12-19]. https://bl.iro.bl.uk/collections/36116aa1-7037-40f3-9b91-ecb1be15e226?locale=it&view=gallery.
[48] British Library. Digital scholarship & data science topic guides[EB/OL]. [2025-12-19]. https://bl.iro.bl.uk/collections/a4e0122e-c4c9-47e4-b5c9-7921baedea5b?locale=en.
[49] British Library. Living with machines[EB/OL]. [2026-01-08]. https://livingwithmachines.ac.uk/.