在数字病理学中对特定任务的自我监督学习框架的评估,与转移学习方法和现有的基础模型相关
Tawsifur Rahman1, Alexander S Baras2, Rama Chellappa3
1Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore Maryland.
概括
本研究介绍了一种针对特定任务的自主监督学习框架,用于数字病理学编码. 这种方法的性能优于标准方法,使得在组织病理学中更有效的域特定特征提取成为可能.
科学领域:
- 数字病理学数字病理学
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 数字病理学工作流程依赖于从整个幻灯片图像中提取特征.
- ImageNet预训练的神经网络通常用于编码.
- 评估不同的重量初始化策略对于优化性能至关重要.
研究的目的:
- 在数字病理学中批判性地分析各种编码策略.
- 确定转移学习在组织病理学中最有效的方法.
- 提出和评估一个新的特定任务的自主监督学习框架.
主要方法:
- 基于随机,基于ImageNet和自我监督的学习重量初始化进行分类的神经网络性能.
- 开发了一个框架,使用特定任务的自我监督学习与浅特征提取器和空间通道注意力块.
- 评估了关于补丁分类的框架,并对跨多个数据集的全幻灯片图像分类任务进行了弱监督.
主要成果:
- 提出的特定任务自主监督编码方法始终优于其他基于卷积神经网络的编码器.
- 在各种数据集中表现出卓越的性能,包括结直肠癌,Camelyon补丁和前列腺癌检测.
- 突出了针对特定任务的基于注意力的自我监督培训对病原体学的有效性.
结论:
- 特定任务的自主监督学习使得针对本病理学进行量身定制的特征提取.
- 这种方法提供了一个有前途的替代方案,可以使用来自异位病理学领域以外的预训练模型.
- 支持在数字病理学中开发更专注和特定领域的分析.
相关概念视频
01:12Observational Learning
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
01:26Metacognition
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
01:26Modeling in Therapy
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in situations...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in situations...
01:29Self-Evaluation Maintenance Model
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
01:24Strategies of Self-Presentation III: Self-Monitoring
Self-monitoring is a central construct in understanding individual differences in self-presentation strategies across social contexts. It refers to how individuals observe, regulate, and control their expressive behavior and self-presentation following situational cues. Self-monitoring reflects a person's sensitivity to social appropriateness and willingness to adapt behavior to fit varying interpersonal demands.High vs. Low Self-Monitoring IndividualsIndividuals high in self-monitoring are...
01:25Self-Regulation
Self-regulation, also known as self-control, encompasses a range of cognitive and behavioral processes that allow individuals to adjust their internal states and outward actions to align with socially acceptable norms and long-term goals. It plays a fundamental role in adaptive functioning, from resisting impulsive behaviors to persisting through challenging tasks. While its benefits are widely recognized, self-regulation is not limitless. Muraven and Baumeister's theory posits that...