This article is cited in 1 scientific paper (total in 1 paper)
Topic models: adding bigrams and taking account of the similarity between unigrams and bigrams
M. A. Nokela, N. V. Lukashevichb
a Lomonosov Moscow State University, Faculty of Computational Mathematics and Cybernetics
b Lomonosov Moscow State University, Research Computing Center
The results of experimental study of adding bigrams and taking account of the similarity between them and unigrams are discussed. A novel PLSA-SIM algorithm based on a modification of the original PLSA (Probabilistic Latent Semantic Analysis) algorithm is proposed. The proposed algorithm incorporates bigrams and takes into account the similarity between them and unigram components. Various word association measures are analyzed to integrate top-ranked bigrams into topic models. As target text collections, articles from various Russian electronic banking magazines, English parts of parallel corpora Europarl and JRC-Acquiz, and the English digital archive of research papers in computational linguistics (ACL Anthology) are chosen. The computational experiments show that there exists a subgroup of tested measures that produce top-ranked bigrams in such a way that their inclusion into the PLSA-SIM algorithm significantly improves the quality of topic models for all collections. A novel unsupervised iterative algorithm named PLSA-ITER is also proposed for adding the most relevant bigrams. The computational experiments show a further improvement in the quality of topic models compared to the PLSA algorithm.
PLSA (Probabilistic Latent Semantic Analysis), topic models, PLSA (Probabilistic Latent Semantic Analysis), word association measures, bigrams, topic coherence, perplexity.
PDF file (331 kB)
M. A. Nokel, N. V. Lukashevich, “Topic models: adding bigrams and taking account of the similarity between unigrams and bigrams”, Num. Meth. Prog., 16:2 (2015), 215–234
Citation in format AMSBIB
\by M.~A.~Nokel, N.~V.~Lukashevich
\paper Topic models: adding bigrams and taking account of the similarity between unigrams and bigrams
\jour Num. Meth. Prog.
Citing articles on Google Scholar:
Related articles on Google Scholar:
This publication is cited in the following articles:
I. S. Pavlovskii, P. P. Parkhomenko, “Indicators, models and methods for analysis and estimation of structures of conceptually connected texts”, Autom. Remote Control, 79:9 (2018), 1630–1642
|Number of views:|