Automatic Identification of News Intent Based on Analyzing Query Features

  • Zhang Xiaojuan ,
  • Lu Wei ,
  • Lei Shengwei
Expand
  • 1. School of Computer and Information Science, Southwest University, Chongqing 400715;
    2. Centre for Studies of Information Resources, Wuhan University, Wuhan 430072

Received date: 2014-07-10

  Revised date: 2014-09-05

  Online published: 2014-10-30

Abstract

This paper selects sample queries from Sogou query log, and makes these queries labeled by humans. Based on the analysis of the labeled news queries, we propose three novel features for news intent prediction, including query expression, a query distribution over time and clicked results. Finally, we apply the decision tree method to perform the task of automatic identification of news queries. Finally, experimental results show that: (1) Goals of news query are supposed to obtain information for a particular topic or some entertainment information, and search topics of news queries tend to be entertainment, economy, politics and sports. (2)Compared with non-news queries, new queries are likely to have named entities, larger fluctuation in the query distribution over time, and higher degree of similarity among clicked results. (3) Encouraging results of news identification are achieved, and the precision, recall, F-score for the query classification are 0.76、0.73 and 0.74, respectively.

Cite this article

Zhang Xiaojuan , Lu Wei , Lei Shengwei . Automatic Identification of News Intent Based on Analyzing Query Features[J]. Library and Information Service, 2014 , 58(20) : 82 -90 . DOI: 10.13266/j.issn.0252-3116.2014.20.013

References

[1] Leibowitz J. “Creative destruction” or just “destruction”, how will journalism survive the Internet age?[EB/OL].[2014-09-02].http://ftc.gov/speeches/leibowitz/091201newsmedia.pdf.

[2] Diaz F. Integration of news content into Web results[C]//Proceedings of the Second ACM International Conference on Web Search and Data Mining.New York: ACM Press, 2009:182-191.

[3] Diaz F, Arguello J. Adaptation offline vertical selection predictions in the presence of user feedback[C]//Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM Press,2009:323-330.

[4] Konig A F, Gamon M, Wu Qiang. Click-through prediction for news queries[C]//Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval.New York:ACM Press, 2009:347-354.

[5] A Louis, E Crestan, Y Billawala, et al. Use of query similarity for improving presentation of news verticals[C]//Proceedings of Very Large Data Search.New York:ACM Press,2011.

[6] Beitzel S M, Jensen E C, Chowdhury A, et al. Hourly analysis of a very large topically categorized Web query log[C]//Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.New York: ACM Press,2004:321-328.

[7] Jansen B J, Pooch U. A review of Web searching studies and a framework for future research[J]. Journal of the American Society for Information Science and Technology,2001,52(3):235-246.

[8] Gan Qingqing, Attenberg J, Markowetz A, et al. Analysis of geographic queries in a search engine log[C]//Proceedings of the First International Workshop on Location and the Webpages. New York:ACM Press, 2008:49-56.

[9] Gonzalez-Caro C, Calderon-Benavides L, Baeza-Yates R.Web queries: The tip of the iceberg of the user's intent[C]//Proceedings of the 2011 the International Conference on Web Search and Web Data Mining. New York: ACM Press, 2011:282-291.

[10] Broder A. A taxonomy of Web search[J]. SIGIR Forum, 2002, 36(2): 3-10.

[11] 陆伟, 周红霞, 张晓娟. 查询意图研究综述[J].中国图书馆学报,2013,39(1):100-111.

[12] Bernard J, Jansen D, Amanda S. Determining the user intent of Web search engine queries[C]//Proceedings of the 16th International Conference on World Wide Web.New York:ACM Press, 2004: 1149-1150.

[13] 伍大勇, 赵世奇, 刘挺,等. 融合多类特征的Web查询意图识别[J]. 模式识别与人工智能, 2012,25(3):500-504.

[14] Yuan Xiaojie, Dou Zhicheng, Zhang Lu. Automatic user goals identification based on anchor text and click-through data[J]. Wuhan University Journal of Natural Sciences, 2008, 13(4): 495-502.

[15] Liu Yiqun, Zhang Min, Ru Liyun, et al. Automatic query type identification based on click through information[J]. Lecture Notes in Computer Science, 2006(4182):593-600.

[16] 陈肿, 刘晓兵, 徐谷子,等. 一种搜索引擎的查询意图发现的新方法[J]. 情报学报,2012,31(3): 242-249.

[17] Brenes D J, Gayo-Avello D. Automatic detection of navigational queries according to behavioural characteristics[EB/OL].[2014-09-01].http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.156.1720.

[18] Brenes D J, Gayo-Avello D, Pérez-González K. Survey and evaluation of query intent detection methods[C]//Proceedings of the 2009 Workshop on Web Search Click Data.New York: ACM Press,2009:1-7.

[19] Wang Lee, Wang Chuang, Xie Xing, et al. Detecting dominant locations from search queries[C]//Proceedings of The 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM Press,2005:424-431.

[20] Dai Honghua, Nie Zaiqiang, Wang Lee. Detecting online commercial intention[C]//Proceedings of the 15th International Conference on World Wide Web.New York: ACM Press,2006:829-837.

[21] Kanhabua N, Nørvag K. Improving temporal language models for determining time of non-time stamped documents[J].Research and Advanced Technology for Digital Libraries Lecture Notes in Computer Science,2008(5173):358-370.

[22] Kulkarni A, Teevan J, Svore K M, et al.Understanding temporal query dynamics[C]//Proceedings of the Fourth ACM International Conference on Web Search and Data Mining. New York: ACM Press, 2011:167-176.

[23] Metzler D, Jones R, Peng Fuchun, et al. Improving search relevance for implicitly temporal queries[C]//Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval.New York:ACM Press, 2009:700-701.

[24] McCreadie R, Macdonald C, Ounis I. Insights on the horizons of news search[EB/OL].[2014-09-02].http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.156.3630.

[25] Louis A, Crestan E, Billawala Y,et al. Use of query similarity for improving presentation of news verticals[EB/OL].[2014-09-01]. http://pubzone.org/dblp/conf/vlds/LouisCBSDC11.

[26] McCreadie R M C, Macdonald C, Ounis I. Crowdsourcing a news query classification dataset[EB/OL].[2014-09-01].http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.178.3236.

[27] Hassan A, Jones R, Diaz F. A case study of using geographic cues to predict query news intent[C]//Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems.New York:ACM Press, 2009: 33-41.

[28] Sogou查询日志主页[EB/OL].[2014-09-01].http://www.sogou.com/labs/dl/q.html.

[29] Rose D E, Levinson D. Understanding user goals in Web search[C]//Proceedings of the 13th International Conference on World Wide Web. New York: ACM Press, 2004: 13-19.

[30] Bar-Ilan J, Zhu Zheng, Levene M. Topic-specific analysis of search queries[C]//Proceedings of the 2009 Workshop on Web Search Click Data.New York: ACM Press, 2009: 35-42.

[31] Vlachos M,Meek C, Vagena Z.Identifying similarities, periodicities and bursts for online search queries[C]//SIGMOD.Proceedings of 2004 Special Interest Group on Management of Data.New York: ACM Press,2004:131-142.

[32] Gaugazl J, Siehndel P, DemartiniG, et al. Predicting the future impact of news events[J].Lecture Notes in Computer Science, 2012,(7224):50-62.

[33] Quinlan R. C4.5: Programs for machine learning[M]. San Francisco:Morgan Kaufmann Publishers, 1993:23-26.

Outlines

/