Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 27, 2026

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
04:48

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

Progressive Pixel-Neighborhood Deformable Cross-Attention for Multispectral Object Detection.

Tian Qiu1, Jifeng Shen1, Xin Zuo2

  • 1School of Electrical and Information Engineering, Jiangsu University, Zhenjiang 212013, China.

Sensors (Basel, Switzerland)
|June 26, 2026
PubMed
Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same journal

RETRACTED: Ndaguba et al. Operability of Smart Spaces in Urban Environments: A Systematic Review on Enhancing Functionality and User Experience. <i>Sensors</i> 2023, <i>23</i>, 6938.

Sensors (Basel, Switzerland)·2026
Same journal

Correction: Ma et al. A Lightweight, Low-Frequency, Broadband Underwater Acoustic Transducer with Ternary Symmetric Excitation: Integrating KNN and Terfenol-D for Enhanced Performance. <i>2026</i>, <i>26</i>, 3645.

Sensors (Basel, Switzerland)·2026
Same journal

Correction: He et al. An Edge-Computing-Based Emotion-Aware Adaptive Lighting System for Intelligent Cockpits. <i>Sensors</i> 2026, <i>26</i>, 3489.

Sensors (Basel, Switzerland)·2026
Same journal

Correction: Tu et al. Lower Limb Motion Recognition with Improved SVM Based on Surface Electromyography. <i>Sensors</i> 2024, <i>24</i>, 3097.

Sensors (Basel, Switzerland)·2026
Same journal

Real-Time Detection System for Road Roughness Based on Ultrasonic Technology.

Sensors (Basel, Switzerland)·2026
Same journal

FedHSFV: Federated Learning for Finger Vein Recognition via Hierarchical Decoupling and Subspace Metric.

Sensors (Basel, Switzerland)·2026

This study introduces PNAFusion, a novel method for multispectral object detection that improves feature alignment using pixel-neighborhood attention. PNAFusion offers a practical balance between accuracy and memory usage for resource-constrained applications.

Area of Science:

  • Computer Vision
  • Machine Learning
  • Sensor Fusion

Background:

  • Multispectral object detection faces challenges in aligning and interacting features across different spectra.
  • Global cross-attention methods, while powerful, are computationally expensive for resource-limited platforms.

Purpose of the Study:

  • To develop an efficient multispectral feature fusion framework for object detection.
  • To address the limitations of global cross-attention in terms of computational complexity and handling local misalignments.

Main Methods:

  • Proposes Progressive Pixel-Neighborhood Deformable Cross-Attention (PNAFusion) for multispectral feature fusion.
  • Introduces Pixel-Neighborhood Cross-Attention (PNCA) to focus interaction on relevant areas and reduce noise.
  • Incorporates Adaptive Deformable Alignment (ADA) to capture non-linear spatial correspondences via learned offsets.
Keywords:
cross-modal interactiondeformable attentionfeature alignmentiterative feature fusionmultispectral object detectionpixel-neighborhood attention

More Related Videos

End-To-End Deep Neural Network for Salient Object Detection in Complex Environments
03:31

End-To-End Deep Neural Network for Salient Object Detection in Complex Environments

Published on: December 15, 2023

Related Experiment Videos

Last Updated: Jun 27, 2026

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
04:48

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

End-To-End Deep Neural Network for Salient Object Detection in Complex Environments
03:31

End-To-End Deep Neural Network for Salient Object Detection in Complex Environments

Published on: December 15, 2023

  • Employs an iterative feedback mechanism for progressive cross-modal feature alignment refinement.

    • Main Results:

    • PNAFusion achieved competitive mean Average Precision (mAP) scores on benchmark datasets (FLIR, M3FD, DroneVehicle) when integrated with YOLOv5 and Co-DETR detectors.
    • Demonstrated significant reductions in GPU memory allocation (33.0%) and theoretical FLOPs compared to existing methods like ICAFusion.
    • Showcased a practical accuracy-memory trade-off, making it suitable for resource-constrained environments.

    Conclusions:

    • PNAFusion effectively enhances multispectral object detection by improving feature alignment and interaction efficiency.
    • The proposed method provides a viable solution for deploying advanced object detection on platforms with limited computational resources.
    • PNAFusion represents a significant step towards practical and efficient multispectral object detection systems.