EXPERT PERSPECTIVE

Artificial Intelligence Corpus Library: Connotations, Functional Requirement, and Construction Pathways

  • Liu Xiwen ,
  • Qian Li ,
  • Tu Zhifang
Expand
  • 1 National Science Library, Chinese Academy of Sciences, Beijing 100190;
    2 Department of Information Resource Management, School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100190

Received date: 2025-12-27

  Revised date: 2026-01-13

  Online published: 2026-02-12

Supported by

This work is supported by the Key Project of the National Natural Science Foundation of China, titled “Theoretical Transformation of Scientific and Technological Information Resources and Knowledge Management Empowered by Digital Intelligence” (Grant No. 72234005).

Abstract

[Purpose/Significance] Under the backdrop of the accelerated development of AI for Science (AI4S) and national strategies on “AI + Science and Technology”, high-quality, computable corpus resources have become a critical factor for large-model pretraining and intelligent scientific discovery. As the social infrastructures, libraries are facing growing demands to transform toward the construction and provision of AI-oriented corpus resources and services. The article aims to clarify the annotation of the “AI corpus library” and to provide a reference framework for related theoretical research and practical implementation. [Method/Process] By employing conceptual and evolutionary analysis, the article clarifies the essential characteristics of the AI corpus library, interpreting it as a deep integration and functional reconstruction of “Database × Corpus × Digital Library”. It analyzes functional requirements from three dimensions: technological evolution, social application, and regulatory governance. Furthermore, by synthesizing the “text-as-data” model of HathiTrust and the “digital scholarship” practice of the British Library, the paper systematically summarizes the evolutionary logic of the transition from digital libraries to AI corpus libraries. [Result/Conclusion] The study shows that the AI corpus library is a new type of knowledge infrastructure oriented toward “human-machine agent” entities, with multi-modal and computable corpora as its core organizational objects. Its construction should follow an architectural system characterized by data-driven top-level logic, knowledge organization as the intermediate mechanism, and agent-based applications as the functional innovation. The corpusization of existing library collections, the establishment of “non-consumptive use” governance mechanisms, and the embedding of corpus services into digital scholarship workflows represent effective paths for libraries to achieve functional expansion and intelligent upgrading.

Cite this article

Liu Xiwen , Qian Li , Tu Zhifang . Artificial Intelligence Corpus Library: Connotations, Functional Requirement, and Construction Pathways[J]. Library and Information Service, 2026 , 70(4) : 3 -12 . DOI: 10.13266/j.issn.0252-3116.2026.04.001

References

[1] 国务院. 国务院关于深入实施“人工智能+”行动的意见[EB/OL]. [2025-10-20]. https://www.gov.cn/zhengce/content/202508/content_7037861.htm. (China State Council. Opinions on deepening the implementation of the “AI+” action[EB/OL]. [2025-10-20]. https://www.gov.cn/zhengce/content/202508/content_7037861.htm.)
[2] UK Government. AI for science strategy[EB/OL]. [2025-12-08]. https://www.gov.uk/government/publications/ai-for-science-strategy/ai-for-science-strategy.
[3] The White House. Launching the genesis mission[EB/OL]. [2025-12-08]. https://www.whitehouse.gov/presidential-actions/2025/11/launching-the-genesis-mission/.
[4] US Department of Energy. Genesis mission: a national mission to accelerate science through artificial intelligence [EB/OL]. [2025-12-08]. https://genesis.energy.gov/.
[5] 李国杰. 智能化科研(AI4R):第五科研范式[J]. 中国科学院院刊, 2024, 39(1): 1-9. (LI G J. AI4R: the fifth scientific research paradigm[J]. Bulletin of Chinese Academy of Sciences, 2024, 39(1): 1-9.)
[6] 邱宝华. 人工智能大模型需牵住语料“牛鼻子”[N]. 学习时报, 2025-11-28(3). (QIU B H. AI large models must grasp the key of training data[N]. Study times, 2025-11-28(3).)
[7] LAION-5B[EB/OL]. [2025-12-09]. https://laion.ai/blog/laion-5b/.
[8] Common Crawl[EB/OL]. [2025-12-09]. https://commoncrawl.org/.
[9] ImageNet[EB/OL]. [2025-12-09]. https://www.image-net.org/.
[10] QIU P C, WU C Y, ZHANG X M, et al. Towards building multilingual language model for medicine[J]. Nature communication, 2024, 15: 8384.
[11] Food and agriculture organization of the United Nations. AGROVOC[EB/OL]. [2025-12-09]. https://www.fao.org/agrovoc/.
[12] The materials project[EB/OL]. [2025-12-09]. https://next-gen.materialsproject.org/.
[13] 陈强, 邢窈窈. 面向生成式人工智能的语料库建设:现状、挑战与未来策略[J]. 社会科学, 2025(6): 177-192. (CHEN Q, XING Q Q. Corpus development for generative AI: current landscape, challenges, and strategic pathways[J]. Journal of social sciences, 2025(6): 177-192.)
[14] 蔡琳. 生成式人工智能语料来源可追溯义务的法律构造[J]. 江苏社会科学, 2025(2): 161-169, 243-244. (CAI L. The legal framework for the obligation of traceability of corpus sources in generative artificial intelligence[J]. Jiangsu social sciences, 2025(2): 161-169, 243-244.)
[15] 王立梅, 王迁, 陶乾, 等. 人工智能语料库建设的法律问题[J]. 数字法治, 2024(5): 28-46. (WANG L M, WANG Q, TAO Q, et al. Legal issues in the development of corpus for artificial intelligence[J]. Digital law, 2024(5): 28-46.)
[16] 张晓林. “人工智能+”背景下的高质量数据集建设:图书馆的机遇与挑战[J]. 中国图书馆学报, 2025, 51(6): 4-17. (ZHANG X L. High-quality dataset construction in Al + environment: library’s opportunities and challenges[J]. Journal of library science in China, 2025, 51(6): 4-17.)
[17] 阮冈纳赞. 图书馆学五定律[M]. 夏云, 王先林,郑挺, 等译. 北京: 书目文献出版社, 1988: 308-337. (RANGANATHAN S R. The five laws of library science[M]. XIA Y, WANG X L, ZHENG T, et al, trans. Beijing: Bibliography and Document Publishing House, 1988: 308-337.)
[18] 金胜勇, 张吻秋. 关于图书馆社会功能的再认识[J]. 图书馆, 2014(6): 38-41. (JIN S Y, ZHANG W Q. Recognition of library social function[J]. Library, 2014(6): 38-41.)
[19] 王世伟. 对公共图书馆“传承文明、服务社会”三大功能的再认识[J]. 图书馆杂志, 2019, 38(10): 24-28. (WANG S W. Recognition of the three functions of public library in inheriting civilization and serving society[J]. Library journal, 2019, 38(10): 24-28.)
[20] 蒋永福. 图书馆与知识组织——从知识组织的角度理解图书馆学[J]. 中国图书馆学报, 1999(5): 19-23. (JIANG Y F. Library and knowledge organisation: understanding library science from the point of view of knowledge organisation[J]. Journal of library science in China, 1999(5): 19-23.)
[21] 贾君枝. 从编目到元数据管理:图书馆知识组织的发展路径[J]. 中国图书馆学报, 2023, 49(2): 121-131. (JIA J Z. From cataloging to metadata management: the development of library knowledge organization[J]. Journal of library science in China, 2023, 49(2): 121-131.)
[22] 程焕文, 钟远薪. 智慧图书馆的三维解析[J]. 图书馆论坛, 2021, 41(6): 43-55. (CHENG H W. Three dimensional analysis of smart library[J]. Library tribune, 2021, 41(6): 43-55.)
[23] 黄宗忠. 试谈图书馆的藏与用[J]. 武汉大学学报(人文科学), 1962(2): 91-98. (HUANG Z Z. On the collection and utilization of libraries[J]. Journal of Wuhan University (humanities science), 1962(2): 91-98.)
[24] 彭俊婷. 对图书馆“藏”与“用”的思考[J]. 北京师范学院学报(社会科学版), 1991(3): 105-109, 57. (PENG J T. Reflections on the “collection” and “utilization” of libraries[J]. Journal of Beijing Normal College (social sciences edition), 1991(3): 105-109, 57.)
[25] FOX E A, AKSCYN R M, FURUTA R K, et al. Digital libraries[J]. Communications of the ACM, 1995, 38(4): 22-28.
[26] 赵洗尘. 数字图书馆及其建设[J]. 现代图书情报技术, 1999(1): 28-31, 43. (ZHAO X C. Research and Construction of the Digital Library[J]. Modern library and information technology, 1999(1): 28-31, 43.)
[27] 王世伟. 论智慧图书馆的三大特点[J]. 中国图书馆学报, 2012, 38(6): 22-28. (WANG S W. On Three main features of the smart library[J]. Journal of library science in China, 2012, 38(6): 22-28.)
[28] 吕婷钰, 李晓瑛, 张颖, 等. 中文医学知识大模型问答语料数据集构建研究[J]. 医学信息学杂志, 2024, 45(5): 20-25. (LÜ T Y, LI X Y, ZHANG Y, et al. Study on the construction of a question-answer corpus dataset for Chinese medical knowledge large language models[J]. Journal of medical informatics, 2024, 45(5): 20-25.)
[29] 张晓林, 梁娜. 知识的智慧化、智慧的场景化、智能的泛在化——探索智慧知识服务的逻辑框架[J]. 中国图书馆学报, 2023, 49(3): 4-18. (ZHANG X L, LIANG N. Knowledge is towards being wisdom, wisdom needs to be scenario-based, and intelligence can be ubiquitously embedded exploration of the logical framework of intelligent knowledge services[J]. Journal of library science in China, 2023, 49(3): 4-18.)
[30] JOHNSON R, REFSUM C. Governing in the age of AI: building Britain’s national data library[R/OL]. [2025-10-30]. https://institute.global/insights/tech-and-digitalisation/governing-in-the-age-of-ai-building-britains-national-data-library.
[31] 刘细文, 付芸. 数智赋能背景下情报学研究进展——数据驱动、模型驱动与知识发现[J]. 情报学进展, 2024, 15(12): 131-171. (LIU X W, FU Y. The research advancements in information science amidst data & Al empowerment: data-driven, model-driven and knowledge discovery[J]. Advances in information science, 2024, 15(12): 131-171.)
[32] 陈昱成, 韩涛, 胡正银. 科技文献文本知识抽取的提示框架研究[J/OL]. [2025-12-18]. https://link.cnki.net/urlid/22.1182.G3.20250923.1636.006. (CHEN Y C, HAN T, HU Z Y. Research on the hint framework for knowledge extraction from scientific and technological literature text[J/OL]. [2025-12-18]. https://link.cnki.net/urlid/22.1182.G3.20250923.1636.006.)
[33] 赵晨阳, 王德胜, 张峻, 等. 异构资源组织与关联发现技术的应用[J]. 计算机与网络, 2019, 45(11): 69-71. (ZHAO C Y, WANG D S, ZHANG J, et al. Application of heterogeneous resource organization and association discovery technology[J]. Computer and network, 2019, 45(11): 69-71.)
[34] 刘细文, 孙蒙鸽, 付芸. 从管理信息系统到情报智能体:重塑科技情报工作范式[J]. 图书情报工作, 2025, 69(17): 3-15. (LIU X W, SUN M G, FU Y. From MIS to DIS agent: reshaping the paradigm of S&T documentation and information service[J]. Library and information service, 2025, 69(17): 3-15.)
[35] 郭利敏, 刘悦如, 付雅明. 面向生成式智能体的图书馆系统架构与转型研究[J]. 农业图书情报学报, 2025, 37(12): 36-47. (GUO L M, LIU Y R, FU Y M. Design and transformation pathways of library systems driven by generative agents[J]. Journal of library and information science in agriculture, 2025, 37(12): 36-47.)
[36] HathiTrust[EB/OL]. [2025-12-19]. https://www.hathitrust.org/.
[37] HathiTrust research center[EB/OL]. [2025-12-19]. https://www.hathitrust.org/about/research-center/.
[38] HathiTrust. Research center analytics[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/.
[39] HathiTrust. Derived datasets[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/deriveddatasets.
[40] HathiTrust. Non-consumptive use policy[EB/OL]. [2025-12-19]. https://www.hathitrust.org/the-collection/terms-conditions/non-consumptive-use-policy/.
[41] HathiTrust. Worksets[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/staticworksets.
[42] HathiTrust. Bookworm[EB/OL]. [2026-01-08]. https://bookworm.htrc.illinois.edu/develop/.
[43] HathiTrust. Algorithms[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/statisticalalgorithms
[44] HathiTrust. Data capsules[EB/OL]. [2026-01-08]. https://analytics.hathitrust.org/staticcapsules.
[45] British Library. AI and machine learning with British Library collections[EB/OL]. [2025-12-19]. https://www.bl.uk/stories/blogs/posts/ai-and-machine-learning-with-british-library-collections.
[46] CANDELA G. Collections as Data: Getting Started[EB/OL]. [2026-01-08]. https://bl.iro.bl.uk/concern/generic_works/dbc38f7b-664c-42ec-8c7d-c6db095ddefd.
[47] British Library. British Library Labs: Projects[EB/OL]. [2025-12-19]. https://bl.iro.bl.uk/collections/36116aa1-7037-40f3-9b91-ecb1be15e226?locale=it&view=gallery.
[48] British Library. Digital scholarship & data science topic guides[EB/OL]. [2025-12-19]. https://bl.iro.bl.uk/collections/a4e0122e-c4c9-47e4-b5c9-7921baedea5b?locale=en.
[49] British Library. Living with machines[EB/OL]. [2026-01-08]. https://livingwithmachines.ac.uk/.
Outlines

/

〈 〉