利用引文构建的主题模型研究进展

doi:10.13266/j.issn.0252-3116.2019.23.015

图书情报工作 ›› 2019, Vol. 63 ›› Issue (23): 131-138.DOI: 10.13266/j.issn.0252-3116.2019.23.015

利用引文构建的主题模型研究进展

邹丽雪^1,2, 王丽^1,2, 刘细文^1,2

1. 中国科学院文献情报中心北京 100190;
2. 中国科学院大学经济与管理学院图书情报与档案管理系北京 100190

收稿日期:2019-01-28 修回日期:2019-06-25 出版日期:2019-12-05 发布日期:2019-12-05
通讯作者: 刘细文(ORCID:0000-0003-0820-3622),研究员,博士生导师,通讯作者,E-mail:liuxw@mail.las.ac.cn
作者简介:邹丽雪(ORCID:0000-0002-2617-4151),馆员,博士研究生;王丽(ORCID:0000-0002-9513-6159),副研究馆员,博士研究生。
基金资助:
本文系中国科学院文献情报中心青年人才领域前沿项目"基于引用内容关联的多维主题演化研究"（项目编号：G1726）研究成果之一。

Research Advances of Citation Based Topic Models

Zou Lixue^1,2, Wang Li^1,2, Liu Xiwen^1,2

1. National Science Library, Chinese Academy of Sciences, Beijing 100190;
2. Department of Library, Information and Archives Management, School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100190

Received:2019-01-28 Revised:2019-06-25 Online:2019-12-05 Published:2019-12-05

摘要/Abstract

摘要： [目的/意义] 概率主题模型算法在不断得到改进与扩展，本文对国内外已有的利用引文构建的主题模型进行研究，分析和对比不同模型的生成过程与算法，并探讨利用引文构建的主题模型在科技文本分析中的应用与可扩展的研究方向。[方法/过程] 通过Web of Science数据库和CNKI数据库获取国内外利用引文构建主题模型的相关文献，经人工判读后筛选出具有代表性的文献，对这些文献中利用引文构建的主题模型，从建模思想、生成过程、参数估计与推断算法等方面进行对比与分析。[结果/结论] 目前国内外利用引文构建的主题模型主要包括研究主题与引文分布的主题模型、研究被引与施引主题间关系的主题模型，以及基于引用内容的引用主题模型；主题模型中引入引文信息后，能够获得更完整的主题内容和特定主题下的重要文献，并可识别施引文献和被引文献之间主题间的关系及影响；已有的模型多集中在概率潜在语义分析（Probabilistic Latent Semantic Analysis，PLSA）和潜在狄利克雷分配（Latent Dirichlet Allocation，LDA）主题模型基础上进行扩展。未来可扩展研究引入引用内容的主题模型、模型的性能优化和评价方法、模型的应用研究等。

关键词: 主题模型, 引文, 主题识别, 引用内容

Abstract: [Purpose/significance] A wide variety of topic models has been developed with improved algorithm. This paper aims to study the research advances, generation process and algorithm of citation based topic models. Additionally, we discuss the application in the text of academic articles and research areas in the future.[Method/process] Based on the data of Web of Science and CNKI database, we collected articles of citation based topic models. In these articles, we selected several representative articles after manual interpretation to analyze the generative process, parameter estimation and inference methods in these citation based topic models.[Result/conclusion] Currently, there are mainly three types of citation based topic models. This includes the topic models which focus on the topic-citation distribution, while other topic models mainly study the relationship between the citing documents and the cited documents. Besides, citation context based topic models are also available. Additionally, more complete topic content can be detected after introducing citation information into the topic models. Moreover, most of the models are the variants of LDA and PLSA. In future, incorporating citation context information into topic models, improving the inference methods and applying the models are some of the future directions.

Key words: topic model, citation, topic detection, citation context

中图分类号:

G202

邹丽雪, 王丽, 刘细文. 利用引文构建的主题模型研究进展[J]. 图书情报工作, 2019, 63(23): 131-138.

Zou Lixue, Wang Li, Liu Xiwen. Research Advances of Citation Based Topic Models[J]. LIS, 2019, 63(23): 131-138.

参考文献

[1] BLEI D M, NG A Y, JORDAN M I. Latent dirichlet allocation[J]. Journal of machine learning research, 2003, 3(Jan):993-1022.
[2] 张金松. 基于引文上下文分析的文献检索技术研究[D].大连:大连海事大学, 2013.
[3] HOFMANN T. Probabilistic latent semantic analysis[C]//Association for Uncertainty in Artificial Intelligence. Fifteenth conference on uncertainty in artificial intelligence. Stockholm:Morgan Kaufmann, 1999:289-296.
[4] 范云满, 马建霞. 利用LDA的领域新兴主题探测技术综述[J]. 现代图书情报技术, 2012, 28(12):58-65.
[5] KAWAMAE N. Trend analysis model:trend consists of temporal words, topics, and timestamps[C]//International conference on web search and data mining. Heng Kong:Association for Computing Machinery, 2011:317-326.
[6] ROSEN-ZVI M, GRIFFITHS T, STEYVERS M, et al. The author-topic model for authors and documents[C]//Association for Uncertainty in Artificial Intelligence. Proceedings of the 20th conference on uncertainty in artificial intelligence. Banff:Association for Uncertainty in Artificial Intelligence Press, 2012:487-494.
[7] COHN D, CHANG H. Learning to probabilistically identify authoritative documents[C]//Association for Computing Machinery. Proceedings of the seventeenth international conference on machine learning. San Francisco:Morgan Kaufmann Publishers, 2000:167-174.
[8] COHN D, HOFMANN T. The missing link:a probabilistic model of document content and hypertext connectivity[C]//Neural Information Processing Systems Foundation. Advances in neural information processing systems 13. Cambridge:NIPS, 2000:430-436.
[9] EROSHEVA E, FIENBERG S, LAFFERTY J. Mixed-membership models of scientific publications[J]. Proceedings of the National Academy of Sciences of the United States of America, 2004, 101(1):5220-5227.
[10] NGUYEN T, DO P. CitationLDA plus:an extension of LDA for discovering topics in document network[C]//Association for Computing Machinery. International symposium on information and communication technology. Danang City:Association for Computing Machinery, 2018:31-37.
[11] LI Y, HE J, LIU H. Topic analysis and influential paper discovery on scientific publications[C]//14th web information systems and applications conference. Liuzhou:IEEE, 2017:68-73.
[12] TU Y, JOHRI N, ROTH D, et al. Citation author topic model in expert search[C]//Association for Computational Linguistics. International conference on computational linguistics:posters. Beijing:Association for Computational Linguistics, 2010:1265-1273.
[13] LU Z, MAMOULIS N, CHEUNG D. A collective topic model for milestone paper discovery[C]//Association for Computing Machinery. Proceedings of the 37th international ACM SIGIR conference on research & development in information retrieval. Queensland:Association for Computing Machinery, 2014:1019-1022.
[14] GUO Z, ZHU S, CHI Y, et al. A latent topic model for linked documents[C]//Association for Computing Machinery. Proceedings of the 32nd international ACM SIGIR conference on research and development in information retrieval. Boston:Association for Computing Machinery, 2009:720-721.
[15] HUANG X, CHEN C, PENG C, et al. Topic-sensitive influential paper discovery in citation network[C]//PacificAsia conference on knowledge discovery & data mining. Melbourne:Springer, 2018:16-28.
[16] ZHOU H, HUIMIN Y, ROLAND H. Topic discovery and evolution in scientific literature based on content and citations[J]. Frontiers of information technology & electronic engineering, 2017, 18(10):1511-1532.
[17] LIM K W, BUNTINE W. Bibliographic analysis on research publications using authors, categorical labels and the citation network[J]. Machine learning, 2016, 103(2):185-213.
[18] LIM K W, BUNTINE W. Bibliographic analysis with the citation network topic model[C]//Asian conference on machine learning. JMLR Workshop and conference proceedings. Nha Trang City:Springer, 2014, 39:142-158.
[19] ZHU Y, YAN X, GETOOR L, et al. Scalable text and link analysis with mixed-topic link models[C]//Association for Computing Machinery. Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining. Chicago:Association for Computing Machinery, 2013, 47:473-481.
[20] YAN L, NICULESCU-MIZIL A, GRYC W. Topic-link LDA:joint models of topic and author community[C]//Association for Computing Machinery. Proceedings of the 26th annual international conference on machine learning. Montreal:Association for Computing Machinery, 2009:665-672.
[21] BAI H, CHEN Z, LYU M. Neural relational topic models for scientific article analysis[C]//Association for Computing Machinery. Proceedings of the 27th ACM international conference on information and knowledge management. Torino:Association for Computing Machinery, 2018:27-36.
[22] DIETZ L, BICKEL S, SCHEFFER T. Unsupervised prediction of citation influences[C]//Association for Computing Machinery. Proceedings of the 24th international conference on Machine learning. Corvalis:Association for Computing Machinery, 2007:233-240.
[23] KIM M, BAEK I, SONG M. Topic diffusion analysis of a weighted citation network in biomedical literature[J]. Journal of the Association for Information Science and Technology, 2018, 69(2):329-342.
[24] GUO Z, ZHANG Z M, ZHU S, et al. A two-level topic model towards knowledge discovery from citation networks[J]. IEEE transactions on knowledge & data engineering, 2014, 26(4):780-794.
[25] MASADA T, TAKASU A. Extraction of topic evolutions from references in scientific articles and its GPU acceleration[C]//Association for Computing Machinery. International conference on information and knowledge management. Maui:Association for Computing Machinery, 2012:1522-1526.
[26] NALLAPATI R M, AHMED A, XING E P, et al. Joint latent topic models for text and citations[C]//Association for Computing Machinery. Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining. Las Vegas:Association for Computing Machinery, 2008:542-550.
[27] CHANG J, BLEI D M. Hierarchical relational models for document networks[J]. Annals of applied statistics, 2010, 4(1):124-150.
[28] TAN L S L, HUI C A, TIAN Z. Topic-adjusted visibility metric for scientific articles[J]. The annals of applied statistics, 2016, 10(1):1-31.
[29] HE Q, CHEN B, PEI J, et al. Detecting topic evolution in scientific literature:how can citations help?[C]//Association for Computing Machinery. Proceedings of the 18th ACM conference on information and knowledge management. Hong Kong:Association for Computing Machinery, 2009:957-966.
[30] SHEN J, SONG Z, LI S, et al. Modeling topic-level academic influence in scientific literatures[C]//Association for the Advancement of Artificial Intelligence. The workshops of the thirtieth AAAI conference on artificial Intelligence. Phoenix:Association for the Advancement of Artificial Intelligence, 2016:1-7.
[31] HUANG L, LIU H, HE J, et al. Finding latest influential research papers through modeling two views of citation links[C]//Asia-pacific web conference, Web technologies and applications. Suzhou:Springer, 2016:555-566.
[32] KIM J, KIM D, OH A. Joint modeling of topics, citations, and topical authority in academic corpora[J]. Transactions of the association for computational linguistics, 2017, 5(1):191-204.
[33] DAI T, ZHU L, CAI X, et al. Explore semantic topics and author communities for citation recommendation in bipartite bibliographic network[J]. Journal of ambient intelligence and humanized computing, 2018, 9(5):957-975.
[34] SMALL H. Citation context analysis[J]. Progress in communication sciences, 1982, 3(9):287-310.
[35] ALJABER B, STOKES N, BAILEY J, et al. Document clustering of scientific texts using citation contexts[J]. Information retrieval, 2010, 13(2):101-131.
[36] BORNMANN L, HAUNSCHILD R, HUG S E. Visualizing the context of citations referencing papers published by Eugene Garfield:a new type of keyword co-occurrence analysis[J]. Scientometrics, 2018, 114(2):427-437.
[37] DOSLU M, BIGNOL H O. Context sensitive article ranking with citation context analysis[J]. Scientometrics, 2016, 108(2):653-671.
[38] LIU S, CHEN C. The differences between latent topics in abstracts and citation contexts of citing papers[J]. Journal of the American Society for Information Science and Technology, 2013, 64(3):627-639.
[39] 杨春艳, 潘有能, 赵莉. 基于语义和引用加权的文献主题提取研究[J]. 图书情报工作, 2016, 60(9):131-138.
[40] LIU X, ZHANG J, GUO C. Full-text citation analysis:a new method to enhance scholarly networks[J]. Journal of the American Society for Information Science and Technology banner, 2013, 64(9):1852-1863.
[41] KATARIA S, MITRA P, BHATIA S. Utilizing context in generative bayesian models for linked corpus[C]//Association for Computing Machinery. Twenty-fourth AAAI conference on artificial intelligence. Atlanta:Association for Computing Machinery, 2010:1340-1345.

利用引文构建的主题模型研究进展

Research Advances of Citation Based Topic Models

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	韩旭, 闵超, 张靖雯. 基于多维特征的引文扩散模式预测研究[J]. 图书情报工作, 2022, 66(9): 82-92.
[2]	何婕君, 闵超. 引文持续增长型论文特征和影响因素研究[J]. 图书情报工作, 2022, 66(7): 110-119.
[3]	苏辀恒, 张敏, 王锦. 图书情报领域情感研究现状述评[J]. 图书情报工作, 2022, 66(6): 137-147.
[4]	王兴, 张志辉. TWCNCI:一种考虑加权引文时间窗口的学科标准化新指标研究[J]. 图书情报工作, 2022, 66(5): 116-124.
[5]	王伟, 梁继文, 杨建林. 基于引文网络的领域主题层次结构识别方法研究[J]. 图书情报工作, 2022, 66(17): 81-92.
[6]	欧石燕, 凌洪飞. 引用文本自动分类及其应用研究[J]. 图书情报工作, 2022, 66(16): 125-136.
[7]	梁爽, 刘小平. 基于文本挖掘的科技文献主题演化研究进展[J]. 图书情报工作, 2022, 66(13): 138-149.
[8]	张雪, 张志强, 曹玲静, 阮伟南, 任晓亚, 冯志刚. 学科领域研究前沿识别方法研究进展[J]. 图书情报工作, 2022, 66(12): 139-151.
[9]	翟姗姗, 王左戎, 陈欢, 潘港辉. 会话分析视角下的突发公共事件主题演化研究——以"新冠肺炎疫情"为例[J]. 图书情报工作, 2022, 66(11): 87-99.
[10]	顾佳云, 熊回香, 肖兵. 虚拟学术社区中融合用户动态兴趣与社交关系的学者推荐研究[J]. 图书情报工作, 2022, 66(11): 110-120.
[11]	陈虹枢, 宋亚慧, 金茜茜, 汪雪锋. 动态主题网络视角下的突破性创新主题识别:以区块链领域为例[J]. 图书情报工作, 2022, 66(10): 45-58.
[12]	唐洁, 曾静静. 应用变异系数识别睡美人文献研究[J]. 图书情报工作, 2021, 65(6): 93-101.
[13]	任元秋, 王兴, 郑钦钦. 不同学科分类方案下不同学科标准化方法效果的比较研究[J]. 图书情报工作, 2021, 65(3): 84-92.
[14]	盛小平, 唐筠杰. 开放获取期刊视角下的开放共享合作研究——以Plos One施引文献为例[J]. 图书情报工作, 2021, 65(23): 31-40.
[15]	刘云婷, 翟冉冉, 韩正彪. 用户信息行为理论模型的扩散与影响研究——以Wilson信息行为模型为例[J]. 图书情报工作, 2021, 65(22): 96-105.