Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Multi-input and Multi-variable systems

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...

Relative Motion Analysis using Rotating Axes

Relative Motion Analysis using Rotating Axes

Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...

Depth Perception and Spatial Vision

Depth Perception and Spatial Vision

Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.

Propagation of Action Potentials

Propagation of Action Potentials

The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Diel coupling between drinking rate and oxygen consumption in Gymnocypris przewalskii under saline-alkaline stress.

Comparative biochemistry and physiology. Toxicology & pharmacology : CBP·2026

Same author

Naja atra SVPLA<sub>2</sub> upregulates hexokinase 2-driven macrophage M1 polarization via the cGAS-STING signaling activation.

Toxicon : official journal of the International Society on Toxinology·2026

Same author

Closing the quality gap: analysis of implementation barriers and interventions for postoperative exercise rehabilitation for patients with radiofrequency ablation for atrial fibrillation.

Frontiers in cardiovascular medicine·2026

Same author

Recognition of specific amino acids in migratory rivers and daily rhythmic behavior of naked carp (Gymnocypris przewalskii).

Scientific reports·2026

Same author

Early Prediction Model for Etoposide-Based Protocols Resistance in Pediatric HLH.

Pediatric health, medicine and therapeutics·2026

Same author

Tissue-Specific Redistribution of Free Amino Acids in Mandarin Fish (<i>Siniperca chuatsi</i>) Under Acute Salinity, Alkalinity and Combined Saline-Alkaline Stress.

Life (Basel, Switzerland)·2026

Search research articles

Related Experiment Video

Updated: Jan 7, 2026

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

Unified Multi-Modal Object Tracking Through Spatial-Temporal Propagation and Modality Synergy.

Jiajia Wu^1,2,3, Haorui Zuo^1,2,3, Yuxing Wei^1,2,3

¹State Key Laboratory of Optical Field Manipulation Science and Technology, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu 610209, China.

Journal of Imaging

|December 24, 2025

Summary

SMUTrack enhances multi-modal object tracking (MMOT) by unifying tasks and improving data fusion. This framework overcomes challenges in heterogeneous data and dynamic scenarios for robust perception.

Keywords:

adaptive perception fusion modality synergy spatial-temporal propagation unified multi-modal tracking

More Related Videos

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Related Experiment Videos

Last Updated: Jan 7, 2026

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

A Methodology for Capturing Joint Visual Attention Using Mobile Eye-Trackers

Published on: January 18, 2020

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Area of Science:

Computer Vision
Artificial Intelligence

Background:

Multi-modal object tracking (MMOT) leverages multiple sensors to overcome limitations of single-sensor systems.
Existing MMOT methods struggle with data heterogeneity, inter-modal imbalance, and degraded reliability in complex, dynamic environments.

Purpose of the Study:

To propose SMUTrack, a unified framework for multi-modal object tracking that addresses challenges in representation learning and generalization.
To enhance multi-modal consistent perception and data aggregation in dynamic scenarios.

Main Methods:

Developed SMUTrack, a unified framework with global shared parameters integrating three downstream MMOT tasks.
Implemented a batch merging-and-splitting strategy with multi-task joint training to establish cross-modal correlations.
Introduced a hierarchical modality synergy and reinforcement (HMSR) module and a gated fusion and context awareness (GFCA) module for progressive information exchange.
Incorporated a spatial-temporal information propagation (SIP) mechanism to learn trajectory and appearance cues for contextual relationships.

Main Results:

SMUTrack demonstrates outstanding performance on mainstream MMOT datasets.
The framework exhibits powerful adaptability across various MMOT tasks.
The proposed modules effectively improve multi-modal representation and tracking robustness.

Conclusions:

SMUTrack provides a unified and effective solution for multi-modal object tracking.
The framework successfully addresses data heterogeneity and dynamic environment challenges.
SMUTrack offers a robust and adaptable approach for advanced MMOT applications.