IRIS:长时间间隔的文档序列的可解释检索增强分类
Fengnan Li1, Elliot D Hill1, Shu Jiang1
1Duke University / Durham, NC, USA.
概括
我们介绍了IRIS (长间隔文档序列的可解释检索增强分类),这是一个轻量级的框架,用于高效地分类长文件. 在医疗保健任务中,IRIS 卓越,为复杂的数据集提供可比性能和增强的解释性.
科学领域:
- 自然语言处理自然语言处理.
- 机器学习 机器学习
- 计算语言学 计算语言学
背景情况:
- 变压器模型在文档分类方面表现出色,但在长文本方面面临着计算挑战.
- 现有的长文本处理方法提供了部分解决方案,但对于异常长的序列是不够的.
研究的目的:
- 提出IRIS (长间隔文档序列的可解释检索增强分类),这是一个新的,轻量级的框架,用于高效和可解释的长文件分类.
- 为了能够处理任意长的文档而无需增加计算成本,适合单个GPU培训.
主要方法:
- IRIS将文档分成部分,并将嵌入内容存储在矢量数据库中.
- 可学习的查询向量检索相关的块,和线性注意力机制集成嵌入用于分类.
- 该框架旨在提高效率和可解释性,特别是对于稀疏,长序列数据.
主要成果:
- 在标准基准上,IRIS的性能与基线模型相美.
- 该框架在临床记录疾病风险预测任务中表现出卓越的表现,其文件非常长且稀疏.
- 通过总结模型中识别的关键风险因素,IRIS提供了全球的解释性.
结论:
- 对于长文件的分类,IRIS提供了一个高效和可解释的解决方案.
- 该框架显示了医疗保健应用程序的巨大潜力,这些应用程序需要高性能和可解释性.
- IRIS解决了当前模型在处理冗长和复杂的文本数据方面的局限性.
相关概念视频
Non-LTR Retrotransposons
11.9K
As the name suggests, non-LTR retrotransposons lack the long terminal repeats characteristic of the LTR retrotransposons. Additionally, both LTR and non-LTR retrotransposons use distinct mechanisms of mobilization. Non-LTR retrotransposons are further divided into two classes - Long interspersed nuclear elements (LINEs) and short interspersed nuclear elements (SINEs), both of which occur abundantly in most mammals, including humans. Some of the active non-LTR retrotransposons in humans are L1...
11.9K
RNA-seq
10.4K
RNA sequencing, or RNA-Seq, is a high-throughput sequencing technology used to study the transcriptome of a cell. Transcriptomics helps to interpret the functional elements of a genome and identify the molecular constituents of an organism. Additionally, it also helps in understanding the development of an organism and the occurrence of diseases.
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
Before the discovery of RNA-seq, microarray-based methods and Sanger sequencing were used for transcriptome analysis. However, while...
10.4K
LTR Retrotransposons
17.9K
LTR retrotransposons are class I transposable elements with long terminal repeats flanking an internal coding region. These elements are less abundant in mammals compared to other class I transposable elements. About 8 percent of human genomic DNA comprises LTR retrotransposons. Some of the common examples of LTR retrotransposons are Ty elements in yeast and Copia elements in Drosophila.
The internal coding region of LTR retrotransposons and their mechanism of transposition closely resembles a...
The internal coding region of LTR retrotransposons and their mechanism of transposition closely resembles a...
17.9K
RNA Interference
26.4K
RNA interference (RNAi) is a process in which a small non-coding RNA molecule blocks the post-transcriptional expression of a gene by binding to its messenger RNA (mRNA) and preventing the protein from being translated.
This process occurs naturally in cells, often through the activity of genomically-encoded microRNAs. Researchers can take advantage of this mechanism by introducing synthetic RNAs to deactivate specific genes for research or therapeutic purposes. For example, RNAi could be used...
This process occurs naturally in cells, often through the activity of genomically-encoded microRNAs. Researchers can take advantage of this mechanism by introducing synthetic RNAs to deactivate specific genes for research or therapeutic purposes. For example, RNAi could be used...
26.4K
Experimental RNAi
6.2K
RNA interference (RNAi) is a cellular mechanism that inhibits gene expression by suppressing its transcription or activating the RNA degradation process. The mechanism was discovered by Andrew Fire and Craig Mello in 1998 in plants. Today, it is observed in almost all eukaryotes, including protozoa, flies, nematodes, insects, parasites, and mammals. This precise cellular mechanism of gene silencing has been developed into a technique that provides an efficient way to identify and determine the...
6.2K
ER Retrieval Pathway
3.9K
In the secretory pathway, vesicles transport proteins from one cellular compartment to another in forward transport to deliver the protein to its correct location. Occasionally, misfolded proteins and incorrect proteins escape their original compartments, and a retrieval pathway is used to return the escaped proteins to their original compartment.
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
3.9K


