Local Variance-Guided Adaptive Infrared-Thermal Sensor Fusion Framework for Human Target Detection in Smoke-Filled...

Reliable human target detection in smoke-filled environments is essential for firefighting robots and rescue perception systems. However, conventional RGB cameras are severely degraded by dense smoke, while a single infrared or thermal imaging sensor cannot simultaneously provide sufficient structural details and reliable target-related thermal information. To address these challenges, this paper proposes a local variance-guided adaptive infrared-thermal sensor fusion framework for human target detection in smoke-filled environments, aiming to alleviate smoke-induced degradation in multimodal perception through improved infrared representation and adaptive cross-modal information utilization. An improved dark channel prior-based infrared desmoking algorithm is designed, where guided filtering is employed to refine the transmission map, suppress halo artifacts, and enhance infrared image quality. Furthermore, a local variance-guided adaptive fusion strategy is proposed, which utilizes local variance as an information saliency metric to generate pixel-level adaptive modality weights for fusing desmoked infrared and thermal images. In addition, a lightweight YOLO11n detector is adopted to achieve efficient human target recognition while maintaining a favorable balance among detection accuracy, computational cost, and inference efficiency. Experimental results on the self-built dense-smoke dual-modal dataset demonstrate that the proposed framework achieves high detection performance with low model complexity and efficient detector-stage inference. The ablation results demonstrate the contribution of infrared-thermal multimodal fusion to reliable smoke perception and indicate that the proposed local variance-guided adaptive fusion strategy maintains comparable detection accuracy while providing a better detector-stage speed-accuracy balance than fixed-weight fusion. With a low parameter count, the adopted YOLO11n detector shows potential for future deployment on resource-constrained firefighting robotic platforms.