Library and Information Service

Library and Information Service >

2026 , Vol. 70 >Issue 12: 28 - 42

DOI: https://doi.org/10.13266/j.issn.0252-3116.2026.12.003

RESEARCH PAPERS

An Experimental Study on Users’ Cognitive Characteristics in AIGC Multi-Modal Information Search

  • Cui Xu ,
  • Wang Zihan ,
  • Tang Jiping ,
  • Ren Xuning ,
  • Gao Pan ,
  • Quan Jiale
Expand
  • School of Public Management, Northwest University, Xi'an 710127
Cui Xu, Professor, Doctoral Supervisor; Wang Zihan, Master’s Candidate, Corresponding Author, E-mail: wangzihan_nwu@163.com; Tang Jiping, Master’s Candidate; Ren Xuning, Master’s Candidate; Gao Pan, Master’s Candidate; Quan Jiale, Master’s Candidate.

Received date: 2025-04-01

  Revised date: 2025-08-20

  Online published: 2026-06-09

Supported by

This work is supported by the National Social Science Fund of China Project titled “Research on the Evolution Mechanism of Users’ Multimodal Information Search Cognitive Structure in the Field of Artificial Intelligence Generated Content” (Grant No. 24BTQ051).

Fold

Abstract

[Purpose/Significance] This study explores the cognitive characteristics of users in AIGC multi-modal information search, aiming to provide references for optimizing AIGC multi-modal search tools and enhancing users’ search capabilities. [Method/Process] Based on the Revised Bloom’s Taxonomy, this study collected data through experimental methods. Empirical analyses were conducted using two-way analysis of variance, one-way analysis of variance, paired-samples t-test, Kruskal-Wallis test, Spearman correlation analysis, and multiple linear regression. Focusing on user cognition in the process of multi-modal information search under the AIGC context, the study proceeded along two lines of inquiry.First, it examined the effects of perceived task difficulty, task type, task context, and familiarity on cognition. Second, it investigated the influence of cognition on multi-modal search behavior and outcome satisfaction. Drawing on cognitive psychology theories, the study further analyzed the underlying generative mechanisms and constructed a cognitive process model linking multimodal information stimuli to outcome satisfaction. [Results/Conclusion] First, the perceived difficulty of image tasks is lower than that of video and music tasks. In image search tasks, the cognitive dimensions of remembering, applying, and analyzing are significantly higher than those in video and music tasks. Task context has no significant effect on cognition, while familiarity with image and music tasks is positively correlated with users’ cognition. Second, applying and evaluating positively affect the number of searches, while creating is more associated with long-term search behavior. In addition, understanding, applying, and analyzing positively affect outcome satisfaction.

Key words： artificial intelligence generated content; multi-modal information search; revised bloom’s taxonomy; user cognition

Cite this article

Cui Xu , Wang Zihan , Tang Jiping , Ren Xuning , Gao Pan , Quan Jiale . An Experimental Study on Users’ Cognitive Characteristics in AIGC Multi-Modal Information Search[J]. Library and Information Service, 2026 , 70(12) : 28 -42 . DOI: 10.13266/j.issn.0252-3116.2026.12.003

References

[1] FOO L G, RAHMANI H, LIU J. AI-generated content (AIGC) for various data modalities: a survey[J]. ACM Computing Surveys, 2025, 57(9): 1-66.
[2] HEARST M A. Search user interfaces[M]. Cambridge: Cambridge University Press, 2009.
[3] TIBAU M, SIQUEIRA S W M, NUNES B P. ChatGPT for chatting and searching: repurposing search behavior[J]. Library & Information science research, 2024, 46(4): 101331.
[4] KAUR P, PANNU H S, MALHI A K. Comparative analysis on cross-modal information retrieval: a review [J]. Computer science review, 2021, 39:100336.
[5] LI Z Y, ZHU J Y, LI X L. Factors influencing the behavior of multi-modal information search [J]. Library hi tech, 2022, 40(5): 1459-1482.
[6] GAGE N, BERLINER D. Educational psychology[M]. 5th ed. Boston: Houghton Mifflin, 1992.
[7] CROPLEY A J. Creativity and cognition: producing effective novelty[J]. Roeper review, 1999, 21(4): 253-260.
[8] EVANS J S B T. Dual-processing accounts of reasoning, judgment, and social cognition[J]. Annual review of psychology, 2008, 59: 255-278.
[9] 方清华. 信息检索过程模型的认知分析[J]. 情报杂志, 2007(1): 54-56. (FANG Q H. A cognitive model for information retrieval process[J]. Journal of intelligence, 2007(1): 54-56.)
[10] ANDERSON L W, KRATHWOHL D R, AIRASIAN P W, et al. Taxonomy for learning, teaching, and assessing: a revision of bloom’s taxonomy of educational objectives[M]. London: Pearson, 2000.
[11] 孙晓宁, 姚青. 信息搜索用户学习行为投入影响研究：基于认知风格与自我效能[J]. 情报理论与实践, 2020, 43(10): 99-107. (SUN X N, YAO Q. An exploration of factors related to learning behavioral engagement on information search users: based on cognitive style and self-efficacy[J]. Information studies: theory & application, 2020, 43(10): 99-107.)
[12] 曹芬芳, 程静, 叶顺强, 等. 认知负荷视角下数字图书馆用户从众信息使用行为研究[J]. 图书情报工作, 2023, 67(2): 52-63. (CAO F F, CHENG J, YE S Q, et al. Research on user herd information use behavior in the context of digital library from the perspective of cognitive load[J]. Library and information service, 2023, 67(2): 52-63.)
[13] 陈忆金, 蔡亚芳, 牛庆萱. 不同认知能力对用户信息搜索行为与认知路径的影响研究[J]. 图书情报工作, 2024, 68(5): 97-109. (CHEN Y J, CAI Y F, NIU Q X. Research on the influence of different cognitive abilities on user information search behavior and cognitive paths[J]. Library and information service, 2024, 68(5): 97-109.)
[14] WILDEMUTH B M, KELLY D, BOETTCHER E, et al. Examining the impact of domain and cognitive complexity on query formulation and reformulation[J]. Information processing & management, 2018, 54(3): 433-450.
[15] GHOSH S, RATH M, SHAH C. Searching as learning: exploring search behavior and learning outcomes in learning-related tasks[C]//Proceedings of the 2018 Conference on Human Information Interaction & Retrieval. New York: ACM, 2018:22-31.
[16] 韩正彪, 戚景琳, 王云辉. 网络信息搜寻对农村老年人认知能力的影响及作用机制研究[J]. 情报科学, 2025, 43(2): 76-84. (HAN Z B, QI J L, WANG Y H. Enhanced study on the impact and mechanisms of online information-seeking on rural elderly cognitive abilities[J]. Information science, 2025, 43(2): 76-84.)
[17] 赵一鸣, 余馨婕, 陈忆金. 真实工作场景下“搜索即学习”任务集的构建与分析[J]. 图书与情报, 2024(1): 121-133. (ZHAO Y M, YU X J, CHEN Y J. “Searching as learning” task library construction and analysis in real work contexts[J]. Library & information, 2024(1): 121-133.)
[18] URGO K, ARGUELLO J. Understanding the “pathway” towards a searcher’s learning objective[J]. ACM transactions on information systems, 2022, 40(4): 1-43.
[19] 戎军涛. 用户认知导向的动态信息检索模型构建[J]. 图书馆, 2022(1): 69-76. (RONG J T. Construction of dynamic information retrieval model on user cognitive orientation[J]. Library, 2022(1): 69-76.)
[20] 刘萍, 叶方倩, 杨志伟. 认知建构视角下交互式信息检索模型研究[J]. 图书情报知识, 2020(2): 93-101, 122. (LIU P, YE F Q, YANG Z W. Research on the model of interactive information retrieval from the perspective of cognitive construction[J]. Documentation, information & knowledge, 2020(2): 93-101, 122.)
[21] DERVIN B. From the mind’s eye of the user: the sense making qualitative-quantitative methodology [J]. Qualitative research in information management, 1992(9): 61-84.
[22] DU J T, SPINK A. Toward a Web search model: integrating multitasking, cognitive coordination, and cognitive shifts[J]. Journal of the American Society for Information Science & Technology, 2011, 62(8): 1446-1472.
[23] 詹希旎, 李白杨. 生成式人工智能（GAI）背景下的数智可供性与认知带宽调节研究[J]. 图书与情报, 2024(1): 110-120. (ZHAN X N, LI B Y. Research on data intelligence affordance and cognitive bandwidth adjustment in the context of Generative Artificial Intelligence(GAI)[J]. Library & information, 2024(1): 110-120.)
[24] 王若佳, 范科鸣, 刘智锋, 等. 生成式人工智能环境下用户信息检索式行为研究[J]. 数据分析与知识发现, 2024, 8(Z1): 20-30. (WANG R J, FAN K M, LIU Z F, et al. A study on user querying behavior in generative artificial intelligence environment[J]. Data analysis and knowledge discovery, 2024, 8(Z1): 20-30.)
[25] ZHOU T, LU H L. The effect of trust on user adoption of AI-generated content[J]. The electronic library, 2025, 43(1): 61-76.
[26] SUN H J, HE Y. The application and user acceptance of AIGC in network audiovisual field: based on the perspective of social cognitive Theory[C]//Proceedings of the 7th International Conference on Computer Science and Application Engineering (CSAE’23). New York: Association for Computing Machinery, 2023:1-5.
[27] 王俊, 谢青伶, 刘畅. 日常生活情境下用户与生成式人工智能交互行为分析[J]. 图书情报知识, 2025, 42(2): 60-69, 93. (WANG J, XIE Q L, LIU C. User’s interaction behavior with Generative Artificial Intelligence in daily life contexts[J]. Documentation, information & knowledge, 2025, 42(2): 60-69, 93.)
[28] 李雨佳, 冉晓雅, 刘畅. 任务认知层次对用户与生成式人工智能交互行为与系统评价的影响研究[J]. 情报资料工作, 2025, 46(2): 51-60. (LI Y J, RAN X Y, LIU C. Research on the impact of task cognitive level on user-generative artificial intelligence interaction behavior and system evaluation[J]. Information and documentation services, 2025, 46(2): 51-60.)
[29] LIU X, YANG B, CHENG H, et al. Investigating the impact of AIGC features on the users’ perception of the persuasiveness of AIGC: a perspective of two-dimensional awe emotions[C]//Proceedings of the International Conference on E-Business (ICEB 2023). Chiayi: AlS Electronic Library, 2023:41.
[30] WANG P, WANG J Y, LIU C F, et al. The products and multi-disciplinarity of data-centric tasks: Influences on data searchers’ behaviors and cognition[J]. Library & information science research, 2024, 46(2): 101302.
[31] LI Z Y, ZHU J Y, LI X L. Factors influencing the behavior of multi-modal information search[J]. Library Hi Tech, 2022, 40(5): 1459-1482.
[32] MICHAEL C, SAMUEL N. K. ChatGPT and CLT: investigating differences in multimodal processing[J]. Journal of economy and technology, 2025, 3: 10-21.
[33] PEI Y Y, WANG L L, XUE C Q. Human-AI co-drawing: studying creative efficacy and eye tracking in observation and cooperation[J]. Applied sciences, 2024, 14(18): 8203.
[34] TAO W, GAO S, YUAN Y. Boundary crossing: an experimental study of individual perceptions toward AIGC[J]. Frontiers in psychology, 2023, 14: 1185880.
[35] 金帆, 张鹏翼. 社交媒体中用户对人工智能生成图片的识别与认知研究——识别准确度、依据与态度探析[J]. 情报理论与实践, 2025, 48(6): 12-19. (JIN F, ZHANG P Y. Research on users’ identification and cognition of AI-Generated images in social media: an exploration of identification accuracy, basis and attitude[J]. Information studies: theory & application, 2025, 48(6): 12-19.)
[36] NGUYEN-PHUOC L, GABORIAU R, DELACROIX D, et al. M&M: multimodal-multitask model integrating audiovisual cues in cognitive load assessment[C]//Proceedings of the 19th international joint conference on computer vision, imaging and computer graphics theory and applications (VISIGRAPP)-volume 2: VISAPP. Rome: SciTePress, 2024: 869-876.
[37] 郭海玲, 宋佳琳. 社会认知视角下移动端视频用户学习型搜索行为的影响研究[J]. 情报资料工作, 2022, 43(3): 75-83. (GUO H L, SONG J L. Research on the influence of mobile video users’ learning search behavior from the perspective of social cognition[J]. Information and documentation services, 2022, 43(3): 75-83.)
[38] 方舟, 洪采菲, 秦姝言, 等. 自我调节学习情境下任务类型和学习认知策略对视频类搜索行为的影响[J]. 图书情报工作, 2021, 65(21): 84-96. (FANG Z, HONG C F, QIN S Y, et al. The effects of task type and learning cognitive strategies on video-type search behavior in a self-regulated learning context[J]. Library and information service, 2021, 65(21): 84-96.)
[39] 薛耀锋, 王坤, 邱奕盛, 等. 基于多模态数据的在线学习认知负荷评估[J]. 现代教育技术, 2024, 34(3): 79-88. (XUE Y F, WANG K, QIU Y S, et al. Cognitive load assessment of online learning based on multimodal data[J]. Modern educational technology, 2024, 34(3): 79-88.)
[40] KRUGER J L, DOHERTY S. Measuring cognitive load in the presence of educational video: towards a multimodal methodology[J]. Australasian journal of educational technology, 2016, 32(6): 19-31.
[41] CHEN F, RUIZ N, CHOI E, et al. Multimodal behavior and interaction as indicators of cognitive load[J]. ACM transactions on interactive intelligent systems, 2013, 2(4): 1-36.
[42] HUI L. Construction of user multimedia fusion cognition theory in digital culture driven by multimodal data[C]//Proceedings of the 24th ACM/IEEE Joint Conference on Digital Libraries. New York: Association for Computing Machinery, 2025:1-3.
[43] BHATTI A, ANGKAN P, BEHINAEIN B, et al. CLARE: cognitive load assessment in real-time with multimodal data[J]. IEEE transactions on cognitive and developmental systems, 2025, 17(6): 1337-1349.
[44] ANDERSON L W, KRATHWOHL D R, AIRASIAN P W, et al. A taxonomy for learning, teaching, and assessing: arevision of Bloom’s taxonomy of educational objectives[M]. New York: Longman, 2001.
[45] MARCHIONINI G. Exploratory search: from finding to understanding[J]. Communications of the ACM, 2006, 49(4): 41-46.
[46] BORLUND P. A study of the use of simulated work task situations in interactive information retrieval evaluations: a meta-evaluation[J]. Journal of documentation, 2016, 72(3): 394-413.
[47] BORLUND P. The IIR evaluation model: a framework for evaluation of interactive information retrieval systems[J]. Information research, 2003, 8(3): 152.
[48] 董焕晴, 曹高辉, 庹沛. 生成式AI工具用户信息搜寻行为形成路径——以数字素养与人工智能素养为视角[J]. 图书馆论坛, 2025, 45(10): 152-160. (DONG H Q, CAO G H, TUO P. Information search behavior pathway of users of generative AI tools: a perspective on digital and artificial intelligence literacies[J]. Library tribune, 2025, 45(10): 152-160.)
[49] KATZ E, HAAS H, GUREVITCH M. On the use of the mass media for important things[J]. American sociological review, 1973, 38(2): 164-181.
[50] 卫旭华，张亮花. 单题项测量：质疑、回应及建议[J]. 心理科学进展, 2019, 27(7): 1194-1204. (WEI X H, ZHANG L H. Single-item measures: queries, responses and suggestions[J]. Advances in psychological science, 2019, 27(7): 1194-1204.)
[51] BANDURA A. Social fundations of thought and action: a social cognitive theory[M]. Englewood Cliffs: Prentice-Hall, 1986.
[52] STROOP J R. Studies of interference in serial verbal reactions[J]. Journal of experimental psychology, 1935, 18(6): 643-662.
[53] KAHNEMAN D. Attention and effort[M]. Englewood Cliffs: Prentice Hall, 1973.
[54] SWELLER J. Cognitive load during problem solving: effects on learning[J]. CognSci, 1988, 12(2): 257-285.
[55] EPLEY N, WAYTZ A, CACIOPPO J T. On seeing human: a three-factor theory of anthropomorphism[J]. Psychological review, 2007, 114(4): 864-886.
[56] YIN S K, FU C Y, ZHAO S R, et al. A survey on multimodal large language models[J]. National science review, 2024, 11(12): nwae403.
Options
Outlines

/

〈 〉

    Copyrights © LIS Press Co., Ltd. Reproduction is prohibited without permission.