SPECIAL TOPIC: Research on Security Situation Awareness Driven by Multimodal Data

Building a Security Situation Awareness Framework Driven by Multimodal Data

  • Guo Yu ,
  • Li Changfei ,
  • Zhang Chuanyang ,
  • Liu Fangyu
Expand
  • 1 School of Business and Management, Jilin University, Changchun 130015;
    2 Information Resources Research Center, Jilin University, Changchun 130015;
    3 Institute of National Development and Security Studies, Jilin University, Changchun 130015
Guo Yu, associate professor, PhD, doctoral supervisor;Li Changfei, master’s candidate, corresponding author, E-mail:414044070@ qq.com;Zhang Chuanyang, doctoral candidate;Liu Fangyu, master’s candidate.

Received date: 2024-06-21

  Revised date: 2024-09-06

  Online published: 2024-12-23

Supported by

This work is supported by the general project of the National Social Science Fund of China titled “Research on Multimodal Network Data Security Situation Awareness and Risk Collaborative Governance Mechanism” (Grant No. 23BTQ076).

Abstract

[Purpose/Significance] From the perspective of multimodal data-driven, this article clarifies the connotation of multimodal data and security situational awareness, and constructs a multimodal data-driven security situational awareness framework, aiming to timely and accurately perceive, understand, predict, and make decisions on network data security threats, and implement precise policies based on scientific decision-making. [Method/Process] Based on the security intelligence theory, the WSR system methodology, and literature review, this article constructed a multimodal data-driven security situational awareness framework according to the logical hierarchy of “physical-rational-humanistic”. [Result/Conclusion] The framework starts from the physical level of information technology and hardware facilities, and emphasizes on the multimodal data-driven situational awareness process and mechanism of situation crisis detection, situation element extraction, situation understanding, and situation prediction at the rational level. Ultimately, it focuses on the sound multimodal data situational awareness collaborative governance mechanism and intelligent decision-making empowerment science application at the humanistic level.

Cite this article

Guo Yu , Li Changfei , Zhang Chuanyang , Liu Fangyu . Building a Security Situation Awareness Framework Driven by Multimodal Data[J]. Library and Information Service, 2024 , 68(24) : 4 -14 . DOI: 10.13266/j.issn.0252-3116.2024.24.001

References

[1] GANDHE A J, HILL D L, STUDHOLME C, et al. Combined and 3-dimensional rendered multimodal data for planning cranial base surgery: a prospective evaluation[J]. Neurosurgery, 1994, 35(3): 463-471.
[2] HARDING C, KAKADIARIS I, LOFTIN R B. A multimodal user interface for geoscientific data investigation[C]//3rd international conference on multimodal interfaces. Beijing: Springer, 2000: 615-623.
[3] EISELE W L, RILETT L R, MHOON K B, et al. Using intelligent transportation systems travel-time data for multimodal analyses and system monitoring[J]. Transportation data and information technology: planning and administration, 2001, 1(1): 148-156.
[4] HAMMER B, STRICKERT M, VILLMANN T. Learning vector quantization for multimodal data[C]//12th international conference on artifical neural networks. Madrid: Springer, 2002: 370-376.
[5] MOLFESE P J, BONEBRIGHT T L, HERMAN T M, et al. A multimodal data collection tool using REALbasic and Mac OS X[J]. Behavior research methods, instruments, & computers, 2002, 34(2): 227-230.
[6] LAHAT D, ADALI T, JUTTEN C. Multimodal data fusion: an overview of methods, challenges, and prospects[J]. Proceedings of the IEEE, 2015, 103(9): 1449-1477.
[7] MAITINIYAZI M, VASIT S, PAHEDING S, et al. Soybean yield prediction from UAV using multimodal data fusion and deep learning[J]. Remote sensing of environment, 2020, 237: 111599.
[8] ZHANG Y D, DONG Z, WANG S H, et al. Advances in multimodal data fusion in neuroimaging: overview, challenges, and novel orientation[J]. Information fusion, 2020, 12(64): 149-187.
[9] WU X, HONG D, CHANUSSOT J. Convolutional neural networks for multimodal remote sensing data classification[J]. IEEE transactions on geoscience and remote sensing, 2022(60): 1-10.
[10] 钟薇, 李若晨, 马晓玲, 等.学习分析技术发展趋向——多模态数据环境下的研究与探索[J]. 中国远程教育, 2018(11): 41-49, 79-80. (ZHONG W, LI R C, MA X L, et al. The learning quality and design of open education: the opened framework[J]. Chinese journal of distance education, 2018(11): 41-49, 79-80.)
[11] 张琪, 王红梅.学习投入的多模态数据表征: 支撑理论、研究框架与关键技术[J]. 电化教育研究, 2019, 40(12): 21-28. (ZHANG Q, WANG H M. Analysis on the structure of ontology of informational education[J]. E-education research, 2019, 40(12): 21-28.)
[12] 张琪, 武法提, 许文静.多模态数据支持的学习投入评测: 现状、启示与研究趋向[J]. 远程教育杂志, 2020, 38(1): 76-86. (ZHANG Q, WU F T, XU W J. Learning engagement evaluation supported by multimodal data: status, implications and research trends[J]. Journal of distance education, 2020, 38(1): 76-86.)
[13] 熊回香, 杨滋荣, 蒋武轩.跨媒体知识图谱构建中多模态数据语义相关性研究[J]. 情报理论与实践, 2019, 42(2): 13-18, 24. (XIONG H X, YANG Z R, JIANG W X. Semantic correlation of multimodal data in the construction of cross-media knowledge graph[J]. Information studies: theory & application, 2019, 42(2): 13-18, 24.)
[14] 马超, 李纲, 陈思菁, 等.基于多模态数据语义融合的旅游在线评论有用性识别研究[J]. 情报学报, 2020, 39(2): 199-207. (MA C, LI G, CHEN S J, et al. Research on usefulness recognition of tourism online reviews based on multimodal data semantic fusion[J]. Journal of the China Society for Scientific and Technical Information, 2020, 39(2): 199-207.)
[15] 李纲, 张霁, 毛进.面向突发事件画像的社交媒体图像分类研究[J]. 数据分析与知识发现, 2022, 6(Z1): 67-79. (LI G, ZHANG J, MAO J. Social media image classification for emergency portrait[J]. Data analysis and knowledge discovery, 2022, 6(Z1): 67-79.)
[16] ENDSLEY M R. Design and evaluation for situation awareness enhancement[J]. Proceedings of the human factors society annual meeting, 1988, 32(2): 97-101.
[17] BASS T. Intrusion detection systems and multisensory data fusion[J]. Communications of the ACM, 2000, 43(4): 99-105.
[18] PORTO V W, FOGEL L J, FOGEL D B. Using evolutionary computation for seismic signal detection: a homeland security application[C]//Proceedings of the 2004 IEEE international conference on computational intelligence for homeland security and personal safety. Venice: IEEE, 2004(7): 62-66.
[19] 尚雅玲, 胡昌振.战场感知与认知:网络空间安全态势感知的建立方法[J]. 科技导报, 2004(7): 37-38, 7. (SHANG Y L, HU C Z. Dominant battlespace awareness & knowledgethe approach to cyberspace situation awareness[J]. Science & technology review, 2004(7): 37-38, 7.)
[20] 王世伟.论信息安全、网络安全、网络空间安全[J]. 中国图书馆学报, 2015, 41(2): 72-84. (WANG S W. On information security, network security and cyberspace security[J]. Journal of library science in China, 2015, 41(2): 72-84.)
[21] MARÍA M R, MARÍADEL C P F, JUAN C R R. Twitter as a tool for the management and analysis of emergency situations: a systematic literature review[J]. International journal of information management, 2018, 43: 196-208.
[22] 谢小东, 吴洁, 盛永祥, 等.基于多模态特征融合的相似专利识别方法研究[J]. 图书情报工作, 2024, 68(18): 112-122. (XIE X D, WU H, SHENG Y X, et al. Research on similar patent identification based on multimodal feature fusion[J]. Library and information service, 2024, 68(18): 112-122)
[23] 王秉, 史志勇.安全情报视域下的安全态势感知研究: 一个理论框架[J]. 情报理论与实践, 2022, 45(9): 15-21, 5. (WANG B, SHI Z Y. Research on the theory of safety & security situation awareness from a perspective of safety & security intelligence: a theoretical framework[J]. Information studies: theory & application, 2022, 45(9): 15-21, 5.)
[24] 林子铭, 李牧衡, 赖美娟.人情智能对群体决策支持系统的影响[J]. 管理学报, 2017, 14(3): 425-432. (LIN Z M, LI M H, LAI M J. The impact of personal intelligence on GDSS success[J]. Chinese journal of management, 2017, 14(3): 425-432.)
[25] 赵星, 乔利利, 叶鹰.面向数据智能和知识发现的图书情报学跨界拓展——数据—学术—创造整合论[J]. 中国图书馆学报, 2020, 46(6): 16-25. (ZHAO X, QIAO L L, YE Y. An interdisciplinary extension of library and information science facing data intelligence and knowledge discovery: integration of data-academy-creativity[J]. Journal of library science in China, 2020, 46(6): 16-25.)
[26] 丁遒劲, 苏静.面向生成式人工智能(AIGC)的图书馆信息资源建设优化策略研究[J]. 图书情报工作, 2024, 68(18): 23-31. (DING Q J, SU J. Research on the optimization strategies for library information resources construction oriented to the development of AIGC[J]. Library and information service, 2024, 68(18): 23-31.)
[27] 蒋超, 朱学芳.基于GPT-4数据增强与对比学习的多模态谣言检测研究[J/OL]. 图书情报工作, 1-12[2024-10-29]. http://kns.cnki.net/kcms/detail/11.1541.G2.20241009.1037.004.html. (JI ANG C, ZHU X F. Research on multimodal rumor detection based on GPT-4 text augmentation and contrastive learning[J/OL]. Library and information service, 1-12[2024-10-29]. http://kns.cnki. net/kcms/detail/11.1541.G2.20241009.1037.004.html.)
[28] 石进, 李益婷, 刘千里.企业竞争情报态势感知系统研究[J]. 情报杂志, 2019, 38(4): 43-51. (SHI J, LI Y T, LIU Q L. Research on enterprise competitive intelligence situation awareness system[J]. Journal of intelligence, 2019, 38(4): 43-51.)
[29] NICOLAI P, EDGAR M. Didn’t roger that: social media message complexity and situational awareness of emergency responders[J]. International journal of information management, 2018, 44: 166-174.
[30] 董青岭.大数据安全态势感知与冲突预测[J]. 中国社会科学, 2018(6): 172-182. (DONG Q L. Big data security situational awareness and conflict prediction[J]. Social sciences in China, 2018(6): 172-182.)
[31] 张海涛, 周红磊, 李佳玮, 等.信息不完全状态下重大突发事件态势感知研究[J]. 情报学报, 2021, 40(9): 903-913. (ZHANG H T, ZHOU H L, LI J W, et al. Research on the situational awareness of a major emergency under incomplete information[J]. Journal of the China Society for Scientific and Technical Information, 2021, 40(9): 903-913.)
[32] 刘莉, 邵波.国外多语言公共数字文化服务平台的特点与思考[J]. 图书情报工作, 2023, 67(21): 124-135. (LIU L, SHAO B. Characteristics and reflections on foreign multilingual public digital cultural service platforms[J]. Library and information service, 2023, 67(21): 124-135.)
[33] DEBORAH B. Who do you trust? The digital destruction of shared situational awareness and the COVID-19 infodemic[J]. International journal of information management, 2020, 55: 102201.
[34] 马海群, 邹纯龙, 王今.总体国家安全观视域下高新技术产业竞争态势评价体系研究[J]. 现代情报, 2022, 42(12): 43-52. (MA H Q, ZOU C L, WANG J. Research on the evaluation system of competitive situation of high-tech industry from the perspective of overall national security[J]. Journal of modern information, 2022, 42(12): 43-52.)
[35] 李纲, 王施运, 毛进, 等.面向态势感知的国家安全事件图谱构建研究[J]. 情报学报, 2021, 40(11): 1164-1175. (LI G, WANG S Y, MAO J, et al. Construction of national security event map and its application for situation awareness[J]. Journal of the China Society for Scientific and Technical Information, 2021, 40(11): 1164-1175.)
[36] 谢晓专, 周晓英.国家安全情报理论的本土探索(1999—2019): 功能范式主导的情报学[J]. 中国图书馆学报, 2021, 47(3): 67-83. (XIE X Z, ZHOU X Y. Domestic exploration of national security intelligence theory(1999-2019): intelligence studies dominated by functional paradigm[J]. Journal of library science in China, 2021, 47(3): 67-83.)
[37] 王秉, 吴超.安全情报学导论[M]. 北京: 科学出版社, 2022. (WANG B, WU C. Introduction to security information science[M]. Beijing: Science Publishing Company, 2022.)
[38] 张连峰.情报科学与安全科学的联袂——《安全情报学导论》荐读[J]. 情报科学, 2022, 40(12): 190-192. (ZHANG L F. The combination of information science and security science: a recommendation to An Introduction to Safety & Security Intelligence Science[J]. Information science, 2022, 40(12): 190-192.)
[39] 王秉, 吴超.大安全观指导下的安全情报学若干基本问题思辨[J]. 情报杂志, 2019, 38(3): 7-14. (WANG B, WU C. Study on some basic issues of safety & security-related intelligence science under the guidance of the big safety & security concept[J]. Journal of intelligence, 2019, 38(3): 7-14.)
[40] 汤辉, 马海群.生物安全情报治理碎片化困境及破解路径: 整体性治理理论视角[J]. 情报理论与实践, 2024, 47(2): 77-83. (TANG H, MA H Q. The dilemma of fragmentation of biosecurity information governance and its solution: a holistic governance theory perspective[J]. Information studies: theory & application, 2024, 47(2): 77-83.)
[41] 迟玉琢, 马海群.国家情报工作制度创新的基本逻辑研究[J]. 情报杂志, 2023, 42(12): 63-68. (CHI Y Z, MA H Q. Research on basic logic about innovation of national intelligence work system[J]. Journal of intelligence, 2023, 42(12): 63-68.)
[42] 王明程, 李勇男.面向国家安全风险的情报感知理论模型构建研究[J]. 情报杂志, 2024, 43(1): 106-113, 76. (WANG M C, LI Y N. Research on the construction of theoretical model of intelligence awareness for national security risk[J]. Journal of intelligence, 2024, 43(1): 106-113, 76.)
[43] 王秉, 周佳胜.系统安全视阈下的安全情报态势感知理论模型研究[J]. 现代情报, 2022, 42(8): 12-19. (WANG B, ZHOU J S. Study on the theoretical model of intelligence-based safety & security situation awareness from the perspective of system safety & security[J]. Journal of modern information, 2022, 42(8): 12-19.)
[44] 钱学森, 许国志, 王寿云.组织管理的技术——系统工程[J]. 上海理工大学学报, 2011, 33(6): 520-525. (QIAN X S, XV G Z, WANG S Y. Technology of organization and management: system engineering[J]. Journal of University of Shanghai for Science and Technology, 2011, 33(6): 520-525.)
[45] 顾基发.钱学森对中国系统科学的贡献[J]. 西安交通大学学报(社会科学版), 2019, 39(6): 1-5. (GU J F. Qian Xuesen’s contributions to Chinese system science[J]. Journal of Xi’an Jiaotong University(social sciences), 2019, 39(6): 1-5.)
[46] 许国志.论事理[C]//系统工程论文集. 北京: 科学出版社, 1981: 12-17. (XV G Z. Discuss Shili[C]//Proceedings of systems engineering. Beijing: Science Publishing Company, 1981: 12-17.)
[47] 顾基发.领导与系统科学[M]. 北京: 中共中央党校出版社, 1988: 111-137. (GU J F. Leadership and systems science[M]. Beijing: CPC Central Party School Press, 1988: 111-137.)
[48] 顾基发, 唐锡晋.物理事理人理系统方法论——理论与应用[M]. 上海: 上海科技教育出版社, 2006. (GU J F, TANG X J. Theory and application of the methodology of Wuli, Shili and Renli systems[M]. Shanghai: Shanghai Science and Technology Education Press, 2006.)
[49] 李爱华, 续维佳, 石勇.基于“物理—事理—人理”的多源异构大数据融合探究[J]. 中国科学院院刊, 2023, 38(8): 1225-1233. (LI A H, XV W J, SHI Y. Research on multi-source heterogeneous big data fusion based on WSR[J]. Bulletin of Chinese Academy of Sciences, 2023, 38(8): 1225-1233.)
[50] 张铭, 王冬玲, 曾娜, 等.如何成为疾风中的劲草?——基于WSR的创业生态系统韧性的前因组态研究[J]. 管理评论, 2023, 35(5): 89-102. (ZHANG M, WANG D L, ZENG N, et al. How to become a sturdy grass withstanding strong wind? A study on the antecedent configurations of entrepreneurial ecosystem resilience based on WSR methodology[J]. Management review, 2023, 35(5): 89-102.)
[51] 狄鹤, 张海涛, 张连峰.WSR三元定位视角下突发公共事件的政府多主体信息协同机制研究[J]. 情报杂志, 2021, 40(7): 189-194, 188. (DI H, ZHANG H T, ZHANG L F. Research on government multi-agent information coordination mechanism in public emergencies from the perspective of WSR ternary positioning[J]. Journal of intelligence, 2021, 40(7): 189-194, 188.)
[52] 曹蓉蓉.大数据环境下网络安全态势感知研究[J]. 数字图书馆论坛, 2014(2): 11-15. (CAO R R. Research of network security situation awareness under big data environment[J]. Digital library forum, 2014(2): 11-15.)
[53] 郭宇, 张传洋, 于文倩, 等.元宇宙视域下数智化医疗信息应用服务模式研究[J]. 现代情报, 2022, 42(12): 117-126. (GUO Y, ZHANG C Y, YU W Q, et al. Research on application and service mode of digital intelligent medical information from the perspective of metaverse[J]. Journal of modern information, 2022, 42(12): 117-126.)
[54] 郭宇, 张传洋, 张海涛, 等.危机管理视角下突发事件舆情主题演化与治理分析[J]. 图书情报工作, 2022, 66(8): 113-121. (GUO Y, ZHANG C Y, ZHANG H T, et al. Analysis on the topic evolution and governance of public opinion in emergencies from the perspective of crisis management[J]. Library and information service, 2022, 66(8): 113-121.)
[55] 张传洋, 郭宇, 庞宇飞, 等.数智化医疗信息利用与服务模式框架构建[J]. 图书情报工作, 2023, 67(13): 49-58. (ZHANG C Y, GUO Y, PANG Y F, et al. Construction of medical information utilization and service framework for digital and intellectual transformation[J]. Library and information service, 2023, 67(13): 49-58.)
Outlines

/

〈 〉