评估未经监督的静态主题模型的出现检测能力.
Xue Li1, Ciro D Esposito2, Paul Groth1
1Informatics Institute, University of Amsterdam, Amsterdam, Netherlands.
PeerJ. Computer science
|June 26, 2025
概括
这项研究引入了一个新的指标来评估主题模型如何检测新兴研究趋势. 隐性迪里克莱特分配 (LDA) 在识别新主题方面表现最好,表现优于BERTopic.
科学领域:
- 计算语言学 计算语言学
- 数据科学数据科学数据科学
- 图书统计学 图书统计学
背景情况:
- 识别新兴主题对于跟踪研究,技术和公共话语转变至关重要.
- 无监督主题建模 (LDA,BERTopic,CoWords) 是主题提取的常见方法,但缺乏系统的比较,以追溯检测出现.
- 缺少一个专门的指标来评估主题模型中的新兴检测.
研究的目的:
- 引入一个定量评估指标来评估主题模型在检测新兴主题方面的有效性.
- 系统地比较潜在的迪里克莱特分配 (LDA),BERTopic和CoWords,以检测新兴主题的能力.
主要方法:
- 开发一种新的定量评估指标,用于新出现的检测.
- 对主题模型输出的定性分析.
- 使用新指标对LDA,BERTopic和CoWords进行定量评估.
主要成果:
- 定性分析表明,CoWords比LDA和BERTopic更早地确定新兴主题.
- 定量评估显示,LDA在新出现检测方面获得了80.6%的F1得分.
- 在突发事件检测准确度方面,LDA的表现比BERTopic高24.0%.
结论:
- 拟议的指标提供了一个强大的框架,用于对突发事件检测中的主题模型性能进行基准测试.
- 在发现新兴主题方面,LDA表现出强的定量表现,超过了BERTopic.
- 不同的主题模型在识别新兴研究趋势方面表现出不同的优势和局限性.
相关概念视频
01:10Detection of Black Holes
2.3K
Although black holes were theoretically postulated in the 1920s, they remained outside the domain of observational astronomy until the 1970s.
Their closest cousins are neutron stars, which are composed almost entirely of neutrons packed against each other, making them extremely dense. A neutron star has the same mass as the Sun but its diameter is only a few kilometers. Therefore, the escape velocity from their surface is close to the speed of light.
Not until the 1960s, when the first neutron...
Their closest cousins are neutron stars, which are composed almost entirely of neutrons packed against each other, making them extremely dense. A neutron star has the same mass as the Sun but its diameter is only a few kilometers. Therefore, the escape velocity from their surface is close to the speed of light.
Not until the 1960s, when the first neutron...
2.3K
01:19Survival Tree
166
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
166
01:30Classification of Signals
925
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
925
01:18Steps in Outbreak Investigation
215
In the ever-evolving field of public health, statistical analysis serves as a cornerstone for understanding and managing disease outbreaks. By leveraging various statistical tools, health professionals can predict potential outbreaks, analyze ongoing situations, and devise effective responses to mitigate impact. For that to happen, there are a few possible stages of the analysis:
215