图书情报工作 ›› 2022, Vol. 66 ›› Issue (5): 93-104.DOI: 10.13266/j.issn.0252-3116.2022.05.010

• 情报研究 • 上一篇    下一篇

探索式搜索中基于面部表情识别的用户情绪及影响因素研究

黄崑, 郑明煊, 罗士超, 靳健   

  1. 北京师范大学政府管理学院 北京 100875
  • 收稿日期:2021-07-22 修回日期:2021-11-27 出版日期:2022-03-05 发布日期:2022-03-21
  • 作者简介:黄崑,教授,博士,E-mail:huangkun@bnu.edu.cn;郑明煊,本科生;罗士超,硕士研究生;靳健,副教授,博士。
  • 基金资助:
    本文系国家自然科学基金项目“探索式检索过程中用户的情感体验及其影响机理研究”(项目编号:71974015)研究成果之一。

Research on Users' Emotions and Impact Factors Based on Facial Expression Recognition in Exploratory Search

Huang Kun, Zheng Mingxuan, Luo Shichao, Jin Jian   

  1. School of Government, Beijing Normal University, Beijing 100875
  • Received:2021-07-22 Revised:2021-11-27 Online:2022-03-05 Published:2022-03-21

摘要: [目的/意义] 结合面部表情识别技术,关注搜索过程的情绪与相关因素的关系,探讨搜索过程的情绪与搜索交互行为、体验的关系,为基于搜索交互行为的用户情绪识别与预测提供参考,为用户搜索交互过程的体验提升提供借鉴。[方法/过程] 通过实验研究,招募48名被试分为两组,分别在有时间限制和无时间限制情况下完成三个指定任务,收集用户的表情数据、行为数据和相关自评数据。[结果/结论] 研究结果表明:搜索过程中,用户表现的中性情绪占比最高(58.03%),其次是消极情绪(29.88%),积极情绪出现比例最少(12.10%);用户的非中性情绪出现占比越高,搜索后体验越差,反之,中性情绪出现占比越高,用户搜索后体验越好。有时间限制组的用户表现的悲伤、厌恶、惊讶、高兴比例都显著高于无时间限制组;同时,中性情绪出现比例显著低于无时间限制组。高任务难度感知组用户表现出更多厌恶、愤怒情绪,更少中性情绪。页面切换场景下更容易出现非中性情绪。搜索过程中的中性情绪越多,用户在搜索后的体验越好,而消极情绪和积极情绪的占比都与搜索后体验呈现负相关。

关键词: 情绪, 表情识别, 探索式搜索, 影响因素

Abstract: [Purpose/significance] Combined with facial expression recognition technology, this study focuses on the relationship between emotions and related factors in the search process, and explores the relationship among emotions, search interaction behaviors, as well as user experience in the search process, so as to provide references for automatic recognition and prediction of users’ emotional state based on search interaction behaviors, and serve for the optimization of the search interaction process. [Method/process] Through experimental research, 48 subjects were recruited and divided into two groups. They completed three designated tasks with or without time constraints respectively, and their expression data, behavior data and related self-evaluation data were collected. [Result/conclusion] The results show that: in the search process, users’ neutral emotions account for the highest proportion (58.03%), followed by negative emotions (29.88%), and positive emotions account for the least proportion (12.10%). The higher the proportion of users’ non-neutral emotions, the worse the post-search experience, and conversely, the higher the proportion of neutral emotions, the better the users’ post-search experience. The proportion of sadness, disgust, surprise and happiness in the time limited group is significantly higher than that in the non-time limited group; at the same time, the proportion of neutral emotions in the time limited group is significantly lower than that of the non-time limit group. The high task difficulty perception group shows more disgust, anger and less neutral emotions. Non-neutral emotions are more likely to occur in page switching scenarios. The more neutral emotions in the search process, the better the user’s experience after the search, while the proportion of negative emotions and positive emotions is negatively correlated with the experience after the search.

Key words: emotion, facial expression recognition, exploratory search, impact factor

中图分类号: