Automatic Image Emotion Categorization and Annotation Based on Social Tags

  • Lu Quan ,
  • Chen Jing ,
  • Ding Heng
Expand
  • 1. School of Information Management, Wuhan University, Wuhan 430072;
    2. School of Information Management, Central China Normal University, Wuhan 430079

Received date: 2014-04-16

  Revised date: 2014-05-26

  Online published: 2014-06-20

Abstract

This paper, based on the existing massive social tagged images, designs an automatic image emotion categorization and annotation model based on these social tags, introduces three factors and their calculation methods, including weight to emotion, discrimination to emotion and contribution to emotion of a social tag, which can categorize images into five basic emotions and annotate each image with the corresponding emotion. Finally experiments are designed, and detailed data analysis is presented on a real social tagging website.

Cite this article

Lu Quan , Chen Jing , Ding Heng . Automatic Image Emotion Categorization and Annotation Based on Social Tags[J]. Library and Information Service, 2014 , 58(12) : 118 -123 . DOI: 10.13266/j.issn.0252-3116.2014.12.018

References

[1] 王上飞,王煦法.图像情感检索研究的进展与展望[J].电路与系统学报,2005,10(4):102-110.

[2] Stefanie S,Wolfgang G S.Collective indexing of emotions in images:A study in emotional information retrieval[J].Journal of the American Society for Information Science and Technology,2009,60(5):863-876.

[3] Russell J A.A circumplex model of affect[J].Journal of Personality and Social Psychology,1980,39(6):1161-1178.

[4] 王上飞,王煦法.基于"维量"思想的人工情感模型(英文)[J].中国科学技术大学学报,2004(1):83-91.

[5] Eakins J P. Automatic image content retrieval-Are we getting anywhere?[C] //Proceedings of the Third International Conference on Electronic Library and Visual Information Research.Milton Keynes:Aslib,1996:123-135.

[6] Hayashi T,Hagiwara M.Image query by impression words-The IQI System[J].IEEE Trans On Consumer Electronics,1998,44(2):347-352.

[7] Dai Ying.Intention-based image retrieval with or without a query image[C]//Proceedings of the 10th International Multimedia Modeling Conference. Washington,DC:IEEE Computer Society, 2004:26-32.

[8] 王上飞,陈恩红,汪祖媛,等.基于支持向量机的图像情感语义注释和检索算法的研究[J].模式识别与人工智能,2004(1):28-31.

[9] Dellagiacoma M,Zontone P, Boato G.Emotion based classification of natural images[C] // Proceedings of the International Workshop on Detecting and Exploiting Cultural diversity on the Social Web.New York:ACM,2011:17-22.

[10] 刘增容,余雪丽,李志.基于特征融合的图像情感语义识别研究[J].太原理工大学学报,2012,43(5):553-557.

[11] 赵娟娟,陈俊杰,李国庆.图像情感语义规则简化学习算法[J].计算机科学,2009,36(10):240-243.

[12] Colombo C,Bimbo D,Pala P.Semantics in visual information retrieval[J].IEEE Multimedia,1999,6(3):38-53.

[13] Cho S B. Emotional image and musical information retrieval with interactive genetic algorithm[J]. Proceedings of the IEEE,2004,92(4):702-711.

[14] Cho S B,Lee J Y.Advanced signal processing technology by soft computing[M].World Scientific Pub Co. Inc.,2001:225-239.

[15] Datta R,Li Jia,Wang J Z.Algorithmic inferencing of aesthetics and emotion in natural images:An exposition[C] // Proceedings of 15th IEEE International Conference.San Diego:IEEE,2008:105-108.

[16] Duygulu P,Barnard K,Freitas J,et al. Object recognition as machine translation: Learning a lexicon for a fixed Image vocabulary[C]//Proceedings of the 7th European Conference on Computer Vision.London: Lecture Notes in Computer Science, 2002:97-112.

[17] Jeon J,Lavrenko V,Manmatha R. Automatic image annotation and retrieval using cross-media relevance model[C]//Proceedings of the 26th annual international ACM SIGIR. New York: ACM, 2003:119-126.

[18] Lavrenko V,Manmatha R,Jeon J. A model for learning the semantics of pictures[EB/OL].[2014-02-16].http://ciir.cs.umass.edu/pubfiles/mm-46.pdf.

[19] Duygulu P,Barnard K,Freitas J,et al. Object recognition as machine translation: Learning a lexicon for a fixed Image vocabulary[C] //Proceedings of the 7th European Conference on Computer Vision. London: Lecture Notes in Computer Science, 2002:97-112.

[20] Liu Jing, Wang Bin, Li Mingjing, et al. Dual cross-media relevance model for image annotation[C]//Proceedings of the 15th International Conference on Multimedia. New York:ACM,2007: 605-614.

[21] Enser P G B, Sandom C J, Hare J S, et al. Facing the reality of semantic image retrieval[J].Journal of Documentation, 2007,63(4): 465-481.

[22] 张志武,阚德涛.基于语义学习的自动图像标注技术研究述评[J].情报学报,2013,32(10):1112-1120.

[23] 余传明,周丹.情感词汇共现网络的复杂网络特性分析[J].情报学报,2010,25(5):906-914.

[24] 李纲,程明结,寇广增.基于情感倾向识别的汽车评论挖掘系统构建[J].情报学报,2011,30(2):204-211.

[25] Schuller B, Reiter S, Muller R, et al. Speaker independent speech emotion recognition by ensemble classification[C]//2005 IEEE International Conference on Multimedia and Expo. Amsterdam: IEEE, 2005: 864-867.

[26] 杨立公,朱俭,汤世平.文本情感分析综述[J].计算机应用,2013,33(6):1574-1578.

Outlines

/