基于深度学习算法的学术查询意图分类器构建

doi:10.13266/j.issn.0252-3116.2021.03.012

图书情报工作 ›› 2021, Vol. 65 ›› Issue (3): 93-99.DOI: 10.13266/j.issn.0252-3116.2021.03.012

基于深度学习算法的学术查询意图分类器构建

王瑞雪¹, 方婧¹, 桂思思², 陆伟^1,3, 张显⁴

1. 武汉大学信息管理学院武汉 430072;
2. 南京农业大学信息管理系南京 210095;
3. 武汉大学信息检索与知识挖掘研究所武汉 430072;
4. 百度时代网络技术(北京)有限公司北京 100085

收稿日期:2020-06-17 修回日期:2020-10-14 出版日期:2021-02-05 发布日期:2021-02-05
作者简介:王瑞雪(ORCID:0000-0001-5932-9036),博士研究生,E-mail:ruixue_wang@whu.edu.cn;方婧(ORCID:0000-0002-9538-7812),硕士研究生;桂思思(ORCID:0000-0001-7562-7447),讲师,博士;陆伟(ORCID:0000-0002-0929-7416),院长,教授,博士;张显(ORCID:0000-0002-8274-9523),硕士研究生。
基金资助:
本文系国家社会科学基金青年项目"面向学术搜索的查询意图研究"（项目编号：19CTQ023）研究成果之一。

Based on Deep Learning Algorithm to Construct the Classifier of Academic Query Intent

Wang Ruixue¹, Fang Jing¹, Gui Sisi², Lu Wei^1,3, Zhang Xian⁴

1 School of Information Management, Wuhan University, Wuhan 430072;
2 College of Information Science&Technology, Nanjing Agricultural University, Nanjing 210095;
3 Institute for Information Retrieval and Knowledge Mining, Wuhan University, Wuhan 430072;
4 Baidu Times Network Technology(Beijing) Co., Ltd. Beijing 100085

Received:2020-06-17 Revised:2020-10-14 Online:2021-02-05 Published:2021-02-05
Supported by:

摘要/Abstract

摘要： [目的/意义] 实现学术查询意图的自动识别，提高学术搜索引擎的效率。[方法/过程] 结合已有查询意图特征和学术搜索特点，从基本信息、特定关键词、实体和出现频率4个层面对查询表达式进行特征构造，运用Naive Bayes、Logistic回归、SVM、Random Forest四种分类算法进行查询意图自动识别的预实验，计算不同方法的准确率、召回率和F值。提出了一种将Logistic回归算法所预测的识别结果扩展到大规模数据集、提取“关键词类”特征的方法构建学术查询意图识别的深度学习两层分类器。[结果/结论] 两层分类器的宏平均F1值为0.651，优于其他算法，能够有效平衡不同学术查询意图的类别准确率与召回率效果。两层分类器在学术探索类的效果最好，F1值为0.783。

关键词: 学术查询意图, 自动识别, 两层分类器

Abstract: [Purpose/significance] To find the solutions of automatically identifying search query intent and improve the efficiency of academic search engines. [Method/process] Combining the features of query intent and academic search, we constructed the feature from four aspects, which are the basic descriptive statistics, the special keywords, entity information and the frequency. For the experiments, we examined four types of classifiers which are the Naive Bayes, Logistic regression, SVM, Random Forest and calculated precision, recall and F-measure. A method which is extending the recognition results of academic query intent predicted by Logistic regression algorithm to large-scale data sets and extracting "keyword type" features is proposed to construct a two-layer classifier based on deep learning algorithm for academic query intent recognition. [Result/conclusion] The macro-average F1 value of the two-layer classifier is 0.651, which is superior to other algorithms. This method can effectively balance the precision and recall rate of different academic query intentions. The final second-layer prediction model receives the best classification performance, the score of F1 is 0.783.

Key words: academic query intent, automatic identification, two-layer classification

中图分类号:

G250.2

王瑞雪, 方婧, 桂思思, 陆伟, 张显. 基于深度学习算法的学术查询意图分类器构建[J]. 图书情报工作, 2021, 65(3): 93-99.

Wang Ruixue, Fang Jing, Gui Sisi, Lu Wei, Zhang Xian. Based on Deep Learning Algorithm to Construct the Classifier of Academic Query Intent[J]. Library and Information Service, 2021, 65(3): 93-99.

参考文献

[1] BORNMANN L, RVDIGER M. Growth rates of modern science:a bibliometric analysis based on the number of publications and cited references[J]. Journal of the Association for Information Science and Technology, 2015, 66(11):2215-2222.
[2] 周剑, 王艳, XIE I. 世代特征,信息环境变迁与大学生信息素养教育创新[J]. 中国图书馆学报, 2015, 41(4):25-39.
[3] DONG X, GABRILOVICH E, GEREMY H, et al. Knowledge vault:a web-scale approach to probabilistic knowledge fusion[C]//Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining. New York:ACM, 2014:601-610.
[4] 赵蓉英, 陈烨. 学术搜索引擎Google scholar和Microsoft academic search的比较研究[J]. 情报科学, 2014, 32(2):3-6,15.
[5] 胡伶霞. 图书馆OPAC检索中基于词典的查询意图自动识别[J]. 图书馆学研究, 2016(23):72-76.
[6] 李兵. 基于查询意图识别的自适应图书分面检索研究[J]. 图书馆学研究, 2017(15):57-64.
[7] BRODER A. A taxonomy of web search[C]//Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval. Tampere:ACM, 2002:3-10.
[8] ROSE D,LEVINSON D. Understanding user goals in web search[C]//Proceedings of the 13th international conference on World Wide Web. New York:ACM, 2004:13-19.
[9] BEITZEL S, JENSEN E, FRIEDER O,et al. Automatic web query classification using labeled and unlabeled training data[C]//Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval.Salvador:ACM, 2005:581-582.
[10] BRENES D, GAYO-AVELLO D, PÉREZ-GONZÁLEZ K. Survey and evaluation of query intent detection methods[C]//Proceedings of the 2009 workshop on web search click data. Barcelona:ACM, 2009:1-7.
[11] LIU Y, ZHANG M, RU L, et al. Automatic query type identification based on click through information[C]//Asia information retrieval symposium. Singapore:Springer, 2006:593-600.
[12] BELKIN N, KELLY D, KIM G, et al. Query length in interactive information retrieval[C]//Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval. Toronto:ACM, 2003:205-212.
[13] JANSEN B, BOOTH D, SPINK A. Determining the user intent of web search engine queries[C]//Proceedings of the 16th international conference on World Wide Web. Banff:ACM, 2007:1149-1150.
[14] HERRERA M.R, MOURA E.S, CRISTO M, et al. Exploring features for the automatic identification of user goals in web search[J]. Information processing & management, 2010, 46(2):131-142.
[15] 张晓娟. 查询意图自动分类与分析[D]. 武汉:武汉大学, 2014.
[16] KHABSA M, WU Z, C. GILES L. Towards better understanding of academic search[C]//Joint conference on digital libraries 2016. Newark:ACM, 2016:111-114.
[17] CHANG Y, HE K, YU S, et al. Identifying user goals from Web search results[C]//International conference on Web intelligence Hong Kong:ACM, 2006:1038-1041.
[18] MENDOZA M, ZAMORA J. Identifying the intent of a user query using support vector machines[C]//International symposium on string processing and information Retrieval. Berlin:Springer, 2009:131-142.
[19] GUO J, XU G, CHENG X, et al. Named entity recognition in query[C]//Proceedings of the 32nd international ACM SIGIR conference on research and development in information retrieval. Boston:ACM, 2009:267-274.

基于深度学习算法的学术查询意图分类器构建

Based on Deep Learning Algorithm to Construct the Classifier of Academic Query Intent

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 2

编辑推荐

Metrics

[1]	李娜, 姜恩波, 朱一真, 刘婷. 政策工具自动识别方法与实证研究[J]. 图书情报工作, 2021, 65(7): 115-122.
[2]	张必兰吴诗贤. ColorBit标签技术及其在高校图书馆书库管理中的应用研究[J]. 图书情报工作, 2011, 55(13): 96-99.