弱教師あり自己符号化器におけるニューロン選択を通じたパッチレベル表現型同定(CLIP由来病理埋め込み用)
Keita Tamura1, Yao-Zhong Zhang2, Yohei Okubo3
1School of Medicine, Hiroshima University, Hiroshima, 734-8553, Japan.
Abstract:
Computer-aided analysis of whole slide images (WSIs) has advanced rapidly with the emergence of multi-modal pathology foundation models. In this study, we propose a weakly supervised neuron selection approach to extract disentangled representations from CLIPderived pathology foundation models, leveraging the interpretability of sparse autoencoders. Specifically, neurons are ordered and selected using whole-slide level labels within a multiple instance learning (MIL) framework. We investigate the impact of different pre-trained image embeddings derived from general and pathology images and demonstrate that a selected single neuron can effectively enable patch-level phenotype identification. Experiments on the Camelyon16 and PANDA datasets demonstrate both the effectiveness and explainability of the proposed method, as well as its generalization ability for tumor patch identification.


