Related Experiment Videos
Recurrent Prompting With MambaFormer for Domain Generalized Few-Shot Hyperspectral Image Classification
Abstract:
Cross-domain few-shot learning enables the transfer of knowledge from the source domain (SD) to the target domain (TD) with a limited number of annotated samples, proving highly effective in hyperspectral image (HSI) classification. Most existing methods involve iterative training between the SD and TD to achieve few-shot domain adaptation. However, the domain gap still compromises the overall performance of the model on the TD. Additionally, compared to the transformer criticized for speed and memory consumption, the Mamba framework has emerged as a promising alternative with comparable long-distance modeling capabilities while being simplified to linear computational complexity. To this end, we propose a recurrent prompting approach using a Mamba-transformer network (MambaFormer) for domain generalized few-shot HSI classification, referred to as ReProM. Specifically, we develop a novel domain-switch meta-learning strategy (DSMLS) that incorporates cross-domain scenarios into the training process through a "fast switching" manner. This strategy includes a domain-specific prompter designed to prevent the model from overfitting to the current domain and to mitigate catastrophic forgetting of knowledge from previous domains, thereby enhancing the generalization ability of the model. To lower the computational demands of the vanilla transformer, the devised MambaFormer integrates the bidirectional Mamba (BiMamba) and transformer architectures to effectively capture essential spectral-spatial information. Comprehensive experiments conducted on three benchmark HSI datasets reveal that the proposed ReProM achieves better generalization than state-of-the-art methods. The source code is available at https://github.com/B-Xi/TIP_2026_ReProM.