人类可解释的短文集群使用大型语言模型
Justin K Miller1, Tristram J Alexander1
1School of Physics, The University of Sydney, Sydney, Australia.
Royal Society open science
|January 23, 2025
概括
大型语言模型 (LLM) 通过生成细微的嵌入来有效地集群短文本. 这种方法超越了传统方法,提供了更易于解释和独特的集群,得到了人类和生成LLM的验证.
科学领域:
- 自然语言处理自然语言处理.
- 机器学习 机器学习
- 数据挖掘 数据挖掘
背景情况:
- 聚类短文本是具有挑战性的,因为词汇的共同发生率很低.
- 像doc2vec和潜伏的迪里克莱特分配这样的传统方法在捕捉语义意义方面存在局限性.
研究的目的:
- 为了证明大型语言模型 (LLM) 在聚类短文本中的有效性.
- 以LLM为基础的集群与传统方法进行比较.
- 探索LLM用于集群验证.
主要方法:
- 使用大型语言模型 (LLM) 生成文本嵌入.
- 将高斯混合模型应用于集群嵌入.
- 将LLM生成的集群与doc2vec和潜在的迪里克莱特分配输出进行比较.
- 使用人类审查员和生成的LLM量化集群质量.
主要成果:
- 基于LLM的嵌入式捕捉语义细微差别,克服传统方法的局限性.
- 使用LLM和高斯混合模型生成的集群更具特色和人类可解释性.
- 一个生成的LLM在集群验证中表现出与人类审稿人的强烈一致.
- 对比揭示了LLM和人类编码的偏见,质疑人类编码是唯一的验证标准.
结论:
- 大型语言模型为短文本集群提供了强大的解决方案.
- 通过提供可靠的解释,LLM可以弥合集群中的验证差距.
- 该研究挑战了对集群验证人类编码的传统依赖,突出了LLM的潜力.
更多相关视频
12:27Large-scale Reconstructions and Independent, Unbiased Clustering Based on Morphological Metrics to Classify Neurons in Selective Populations
Published on: February 15, 2017
6.9K
03:37Author Spotlight: Impact of Intergenic Interactions on Disease-Identifying Dark Biomarkers
Published on: March 1, 2024
630
相关概念视频
Cluster Sampling Method
11.6K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.6K
RNA-seq
9.8K
RNA sequencing, or RNA-Seq, is a high-throughput sequencing technology used to study the transcriptome of a cell. Transcriptomics helps to interpret the functional elements of a genome and identify the molecular constituents of an organism. Additionally, it also helps in understanding the development of an organism and the occurrence of diseases.
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
9.8K
Vesicular Tubular Clusters
2.4K
After budding out from the ER membrane, some COPII vesicles lose their coat and fuse with one another to form larger vesicles and interconnected tubules called vesicular tubular clusters or VTCs. These clusters constitute a compartment at the ER-Golgi interface known as ERGIC (Endoplasmic Reticulum Golgi Intermediate Compartment). The ERGIC is a mobile membrane-bound cargo transport system that sorts proteins secreted from ER and delivers them to the Golgi.
With the help of motor proteins such...
With the help of motor proteins such...
2.4K
lncRNA - Long Non-coding RNAs
8.5K
In humans, more than 80% of the genome gets transcribed. However, only around 2% of the genome codes for proteins. The remaining part produces non-coding RNAs which includes ribosomal RNAs, transfer RNAs, telomerase RNAs, and regulatory RNAs, among other types. A large number of regulatory non-coding RNAs have been classified into two groups depending upon their length – small non-coding RNAs, such as microRNA, which are less than 200 nucleotides in length, and long non-coding RNA...
8.5K
Classification of Signals
383
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
383
Genetic Lingo
100.5K
Overview
100.5K
