高斯的层次隐藏的迪里克莱分配:把多项性回来
Takahiro Yoshida1, Ryohei Hisano2, Takaaki Ohnishi3
1The Canon Institute for Global Studies, Tokyo, Japan.
PloS one
|July 12, 2023
概括
高斯的层次隐藏的迪里克莱特分配通过捕捉单词多语法和主题结构来增强主题模型. 这种新模型比现有的基于高斯的方法提高了主题连贯性和预测准确性.
科学领域:
- 自然语言处理自然语言处理.
- 机器学习 机器学习
- 计算语言学 计算语言学
背景情况:
- 像潜伏的迪里克莱特分配 (LDA) 和高斯的LDA (GLDA) 这样的话题模型揭示了潜伏的文档表示.
- GLDA使用了词嵌入,但与LDA不同,它在词多重学上扎.
- 现有的模型缺乏同时学习主题层次和单词多义词的能力.
研究的目的:
- 介绍一个新的主题模型,高斯层次隐性迪里克莱特分配 (GH-LDA),它解决了GLDA的局限性.
- 为了增强在主题建模中对单词多义词的捕获.
- 提高主题连贯性和文档表示准确性.
主要方法:
- 在高斯隐藏的迪里克莱特分配中开发了一个等级结构.
- 引入了一种能够使用主题层次表达文档的模型.
- 在各种体和词嵌入方面进行了广泛的定量实验.
主要成果:
- 与基于高斯的模型相比,GH-LDA显著改善了多种细胞的检测.
- 拟议的模型提供了比层次的LDA更节的主题表示.
- 与GLDA和CGTM相比,实现了优越的主题连贯性和持久的文档预测准确性.
结论:
- 高斯的层次隐藏的迪里克莱特分配有效地同时捕捉了单词多语和主题层次.
- 该模型为GLDA等现有方法提供了有竞争力的替代方案,时间复杂度相似.
- GH-LDA提供了一种更全面的方法来理解文档结构和单词含义.
更多相关视频
06:48Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
Published on: June 25, 2019
9.2K
12:27Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations
Published on: February 15, 2017
7.0K
相关概念视频
Gauss's Law
7.4K
If a closed surface does not have any charge inside where an electric field line can terminate, then the electric field line entering the surface at one point must necessarily exit at some other point of the surface. Therefore, if a closed surface does not have any charges inside the enclosed volume, then the electric flux through the surface is zero. What happens to the electric flux if there are some charges inside the enclosed volume? Gauss's law gives a quantitative answer to this question.
7.4K
Distributions to Estimate Population Parameter
4.1K
The accurate values of population parameters such as population proportion, population mean, and population standard deviation (or variance) are usually unknown. These are fixed values that can only be estimated from the data collected from the samples. The estimates of each of these parameters are sample proportion, the sample mean, and sample standard deviation (or variance). To obtain the values of these sample statistics, data are required that have particular distribution and central...
4.1K
Binomial Probability Distribution
11.1K
A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
11.1K
Poisson Probability Distribution
8.3K
A Poisson probability distribution is a discrete probability distribution. It gives the probability of a number of events occurring in a fixed interval of time or space if these events happen at a known average rate and independently of the time since the last event. For example, a book editor might be interested in the number of words spelled incorrectly in a particular book. It might be that, on average, there are five words spelled incorrectly in 100 pages. The interval is 100 pages.
The...
The...
8.3K
Gauss's Law: Problem-Solving
1.8K
Gauss's law helps determine electric fields even though the law is not directly about electric fields but electric flux. In situations with certain symmetries (spherical, cylindrical, or planar) in the charge distribution, the electric field can be deduced based on the knowledge of the electric flux. In these systems, we can find a Gaussian surface S over which the electric field has a constant magnitude. Furthermore, suppose the electric field is parallel (or antiparallel) to the area...
1.8K
Probability Distributions
7.3K
The probability of a random variable x is the likelihood of its occurrence. A probability distribution represents the probabilities of a random variable using a formula, graph, or table. There are two types of probability distribution– discrete probability distribution and continuous probability distribution.
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
7.3K
