积极学习算法的比较,用于分类头部计算机断层扫描报告,使用来自变压器的双向编码器表示.
Tomohiro Wataya1,2, Azusa Miura3, Takahisa Sakisuka4
1Department of Radiology, Osaka University Graduate School of Medicine, 2-2, Yamadaoka, Suita, Osaka, 565-0871, Japan. wataya-tomo@radiol.med.osaka-u.ac.jp.
International journal of computer assisted radiology and surgery
|January 8, 2025
概括
积极学习 (AL) 使用不确定性抽样 (US) 方法,特别是信心比率 (RC) 和边际抽样 (MS),显著改善了头部CT报告的自然语言处理 (NLP). 这种方法减少了对标记数据的需求,并提高了模型的准确性.
科学领域:
- 医疗信息学 医疗信息学
- 放射学 放射学是一门学科.
- 人工智能的人工智能
背景情况:
- 自然语言处理 (NLP) 系统可以通过减少医疗报告中错过的发现来帮助放射科医生.
- 高昂的注释成本在开发这些NLP系统方面构成了重大挑战.
- 头部计算机断层扫描 (CT) 报告分析需要准确的显著性估计.
研究的目的:
- 为了比较NLP中主动学习 (AL) 算法的有效性,以估计头部CT报告的意义.
- 用变压器 (BERT) 的双向编码器表示来评估不同的AL策略.
主要方法:
- 根据重要性分类的使用了3728个头部CT报告.
- 雇员UTH-BERT,一个预先训练的BERT模型.
- 对比了七种采样指标:随机采样 (RS),四种不确定性采样 (US) 方法 (最小置信度,边缘采样,置信比,取样),以及两种基于距离的采样 (DS) 方法 (共弦值和欧几里德距离).
- 从一个空的标签数据集开始,并从一个没有标签的数据池中代添加了25个报告.
主要成果:
- 不确定性抽样 (US) 方法的准确性明显高于随机抽样 (RS),当标记的数据集包含不到1800个报告时.
- 基于距离的采样 (DS) 方法的性能明显低于RS.
- 边际抽样 (MS) 和信任比率 (RC) 是美国最有效的方法.
- 美国的方法将所需的标签数据减少了15.4-40.5%,RC是最有效的.
- 美国的方法倾向于优先考虑小类别的标签,而不是RS和DS.
结论:
- 不确定性抽样 (US) 方法,特别是RC和MS,可以有效地微调BERT模型用于头部CT报告分类.
- 这些AL策略有助于减轻数据集中的类别不平衡.
- 积极学习为大规模研究中高效的数据注释提供了一种有价值的方法.
相关概念视频
Vector Algebra: Graphical Method
Vectors can be multiplied by scalars, added to other vectors, or subtracted from other vectors. The vector sum of two (or more) vectors is called the resultant vector or, for short, the resultant.
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
Computed Tomography
Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
Introduction to Scalers
Many familiar physical quantities can be specified completely by giving a single number and the appropriate unit. For example, "a class period lasts 50 min," or "the gas tank in my car holds 65 L," or "the distance between the two posts is 100 m." A physical quantity that can be specified completely in this manner is called a scalar quantity. The word "scalar" is a synonym for "number." Time, mass, distance, length, volume, temperature, and energy are some examples of scalar quantities.
Scalar...
Scalar...
Deconvolution
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Block Diagram Reduction
The process of deriving the transfer function of a control system often involves reducing its block diagram to a single block. This simplification can be achieved through a series of strategic operations, including relocating branch points and comparators. These operations preserve the overall function of the system while allowing for easier manipulation and combination of blocks.
The first step in this process is the identification and relocation of a branch point. A branch point, where a...
The first step in this process is the identification and relocation of a branch point. A branch point, where a...
Signal Flow Graphs
Signal-flow graphs offer a streamlined and intuitive approach to representing control systems, providing an alternative to traditional block diagrams. These graphs use branches to symbolize systems and nodes to represent signals, effectively illustrating the relationships and interactions within the system.
In a signal-flow graph, branches denote the system's transfer functions, while nodes represent the signals. The direction of signal flow is indicated by arrows, with the corresponding...
In a signal-flow graph, branches denote the system's transfer functions, while nodes represent the signals. The direction of signal flow is indicated by arrows, with the corresponding...


