[Purpose/significance]Taking topical phrase identifying as the research object, this paper provides a method for topical phrase mining based on the Phrase LDA model to understand text content quickly and extract text topic accurately.[Method/process]This paper provides a quantitative definition of the high frequency words and puts forward a reasonable formula of the phrase importance. We reason out the topical phrases combining the PhraseLDA model finally.[Result/conclusion]Experimental result shows that the quality of phrases extracted from a variety of data sets is higher and the topical consistency is stronger.
Zhang Qin
,
Zhang Zhixiong
. Topical Phrase Mining Based on the PhraseLDA Model[J]. Library and Information Service, 2017
, 61(8)
: 120
-125
.
DOI: 10.13266/j.issn.0252-3116.2017.08.015
[1] BLEI D M, NG A Y, JORDAN M I. Latent dirichletallocation[J]. Journal of machine learning research, 2003(3):993-1022.
[2] WALLACH H M. Topic modeling:beyond bag-of-words[C]//ICML '06 Proceedings of the 23rd international conference on machine learning. New York:ACM, 2006:977-984.
[3] WANG X R, MCCALLUM A, XING W. Topical N-Grams:phrase and topic discovery, with an application to information retrieval[C]//Seventh IEEE International Conference on Data Mining. Los Alamitos:IEEE, 2007:697-702.
[4] LINDSEY R V, HEADDEN W P, STIPICEVIC M J. A phrase-discovering topic model using hierarchical Pitman-Yor processes[C]//EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. Stroudsburg:Association for Computational Linguistics, 2012:214-222.
[5] MACKAY D J C, PETOY L C B. A hierarchical Dirichletlanguage model[J]. Natural Language Engineering, 1995, 1(3):289-308.
[6] PITMAN J, YOR M. The two-parameter Poisson-Dirichletdistribution derived from a stable subordinator[J]. Annals of probability, 1997, 25(2):855-900.
[7] BLEI D M, LAFFERTY J D. Visualizing topics with multi-word expressions[J]. ArXiv e-prints, arXiv:0907.1013v1[stat.ML], 2009.
[8] DANILEVSKY M, WANG C, DESAI N, et al. Automaticconstruction and ranking of topical keyphrases on collections of short documents[C]//Proceedings of the 2014 SIAM International Conference on Data Mining. Philadelphia:Society for Industrial and Applied Mathematics Publications, 2014:398-406.
[9] SCHONE P, JURAFSKY D. Is knowledge-free induction of multiword unit dictionary headwords a solved problem?[C]//Empirical Methods in Natural Language Processing. Pittsburgh:ACM 2001:1-9.
[10] ELKISHKY A, SONG Y, WANG C, et al. Scalable topical phrase mining from text corpora[J]. VLDB Endowment, 2014, 8(3):305-316.
[11] LI B, WANG B, ZHOU R, et al. CITPM:acluster-based iterative topical phrase mining framework[C]//21st International Conference on Database Systems for Advanced Applications.Dallas:Springer International Publishing, 2016:197-213.
[12] AGRAWAL R, SRIKANT R. Fast algorithms for mining association rules in large databases[C]//Proceeding of the 20th International Conference on Very Large Data Bases. San Francisco:Morgan Kaufmann Publishers Inc, 1994:487-499.
[13] MIHALCEA R, TARAU P. TextRank:bringing order into texts[C]//Empirical Methods in Natural Language Processing. Stroudsburg:Association for Computational Linguistics, 2004:404-411.
[14] LIU Z, LI P, ZHENG Y, et al. Clustering to find exemplar terms for keyphrase extraction[C]//Conference on Empirical Methods in Natural Language Processing.Stroudsburg:Association for Computational Linguistics, 2009:257-266.
[15] MICHAEL L. DBLP[EB/OL].[2016-05-01]. http://dblp.uni-trier.de/.
[16] MCCALLUM A K. MALLET:amachine learning for language toolkit[EB/OL].[2016-05-01]. http://mallet.cs.umass.edu. 2002.
[17] MARTIN P. Snowball[EB/OL].[2016-05-01]. http://snowballstem.org/.
[18] CHANG J, BOYD-GRABER J, GERRISH S, et al. Reading tea leaves:how humans interpret topic models[C]//Proceeding of the 22nd International Conference on Neural Information Processing Systems. USA:Curran Associates Inc, 2009:288-296.
