Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Aug 4, 2025

Human Fetal Blood Flow Quantification with Magnetic Resonance Imaging and Motion Compensation
06:56

Human Fetal Blood Flow Quantification with Magnetic Resonance Imaging and Motion Compensation

Published on: January 7, 2021

2.5K

SequenceMorph: A Unified Unsupervised Learning Framework for Motion Tracking on Cardiac Image Sequences.

Meng Ye, Dong Yang, Qiaoying Huang

    IEEE Transactions on Pattern Analysis and Machine Intelligence
    |April 6, 2023
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Toward Modality- and Sampling-Universal Learning Strategies for Accelerating Cardiovascular Imaging: Summary of the CMRxRecon2024 Challenge.

    IEEE transactions on medical imaging·2025
    Same author

    The state-of-the-art in cardiac MRI reconstruction: Results of the CMRxRecon challenge in MICCAI 2023.

    Medical image analysis·2025
    Same author

    Classification of lung cancer subtypes on CT images with synthetic pathological priors.

    Medical image analysis·2024
    Same author

    A Critical Analysis of the Limitation of Deep Learning based 3D Dental Mesh Segmentation Methods in Segmenting Partial Scans.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2023
    Same author

    Automatic Lung Cancer Subtypes Classification on CT Images with Self-generated Multi-modality Hybrid Features.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2023
    Same author

    Publisher Correction: Mining multi-center heterogeneous medical data with distributed synthetic learning.

    Nature communications·2023
    Same journal

    TraGraph-GS: Trajectory Graph-based Gaussian Splatting for Arbitrary Large-Scale Scene Rendering.

    IEEE transactions on pattern analysis and machine intelligence·2026
    Same journal

    SWIFT: A Small-World Interaction Framework for Flow-Aware Trajectory Prediction in Autonomous Driving.

    IEEE transactions on pattern analysis and machine intelligence·2026
    Same journal

    HardFlow: Hard-Constrained Sampling for Flow-Matching Models Via Trajectory Optimization.

    IEEE transactions on pattern analysis and machine intelligence·2026
    Same journal

    Industrial Brain: Self-Evolving Neuro-Symbolic Autonomy with Causal Resilience for Cyber-Physical Systems.

    IEEE transactions on pattern analysis and machine intelligence·2026
    Same journal

    Adaptive Hardness-Driven Dictionary Distillation for Incomplete Streaming View Clustering.

    IEEE transactions on pattern analysis and machine intelligence·2026
    Same journal

    Mixture of Global and Local Experts with Diffusion Transformer for Controllable Face Generation.

    IEEE transactions on pattern analysis and machine intelligence·2026
    See all related articles

    This article introduces a new computer program called SequenceMorph that automatically tracks how the heart muscle moves during a heartbeat. By using advanced artificial intelligence, this tool analyzes medical scans like ultrasound and MRI to provide faster and more accurate heart motion data than older methods.

    Area of Science:

    • Biomedical engineering and SequenceMorph imaging analysis
    • Computational cardiology within diagnostic medicine

    Background:

    No prior work had resolved the persistent limitations in accuracy and speed for automated heart wall tracking. Traditional computational approaches often fail to meet the rigorous demands of modern clinical diagnostic environments. These older systems struggle to process complex myocardial deformation patterns reliably across diverse imaging modalities. That uncertainty drove the need for more robust, automated solutions in cardiac assessment. Prior research has shown that ultrasound and magnetic resonance imaging provide rich data for evaluating heart function. However, translating these raw image sequences into precise motion maps remains a significant technical hurdle. This gap motivated the development of new strategies that do not rely on manual labeling or extensive training data. The field currently lacks a unified framework capable of handling the dynamic nature of cardiac cycles efficiently.

    Purpose Of The Study:

    The aim of this study is to introduce a novel deep learning-based fully unsupervised method for motion tracking in cardiac image sequences. Researchers sought to address the lack of accuracy and efficiency found in traditional automated estimation techniques. The project focuses on overcoming the limitations that prevent current methods from being widely adopted in clinical diagnosis. By proposing a new framework, the authors intend to provide a more reliable tool for evaluating myocardial deformation. The study investigates whether motion decomposition and recomposition can improve the tracking of heart muscle movement. This effort is motivated by the need for faster and more precise analysis of ultrasound and cardiac magnetic resonance data. The authors explore how a differentiable composition layer might refine motion estimation by reducing accumulated errors. Ultimately, the work aims to demonstrate that utilizing temporal information can yield superior spatio-temporal motion field estimations compared to conventional approaches.

    Keywords:
    cardiac magnetic resonanceultrasound imagingdeep learningmotion tracking

    Frequently Asked Questions

    The researchers propose a motion decomposition and recomposition strategy. This involves estimating inter-frame motion fields via a bi-directional generative diffeomorphic registration network, followed by calculating Lagrangian motion fields through a differentiable composition layer to track the heart muscle across the entire cardiac cycle.

    The framework utilizes a differentiable composition layer. This component is necessary to integrate inter-frame motion results into a cohesive Lagrangian motion field, which helps reduce the errors that typically accumulate during sequential frame-by-frame tracking steps.

    A bi-directional generative diffeomorphic registration neural network is required. This architecture ensures that the inter-frame motion fields between consecutive images are estimated with the mathematical properties of diffeomorphisms, which are essential for maintaining the physical consistency of the deforming myocardial tissue.

    More Related Videos

    Magnetic Resonance Derived Myocardial Strain Assessment Using Feature Tracking
    07:21

    Magnetic Resonance Derived Myocardial Strain Assessment Using Feature Tracking

    Published on: February 12, 2011

    14.4K
    Analyzing Mitochondrial Morphology Through Simulation Supervised Learning
    12:06

    Analyzing Mitochondrial Morphology Through Simulation Supervised Learning

    Published on: March 3, 2023

    4.1K

    Related Experiment Videos

    Last Updated: Aug 4, 2025

    Human Fetal Blood Flow Quantification with Magnetic Resonance Imaging and Motion Compensation
    06:56

    Human Fetal Blood Flow Quantification with Magnetic Resonance Imaging and Motion Compensation

    Published on: January 7, 2021

    2.5K
    Magnetic Resonance Derived Myocardial Strain Assessment Using Feature Tracking
    07:21

    Magnetic Resonance Derived Myocardial Strain Assessment Using Feature Tracking

    Published on: February 12, 2011

    14.4K
    Analyzing Mitochondrial Morphology Through Simulation Supervised Learning
    12:06

    Analyzing Mitochondrial Morphology Through Simulation Supervised Learning

    Published on: March 3, 2023

    4.1K

    Main Methods:

    The review approach focuses on a fully unsupervised deep learning architecture designed for in vivo cardiac tracking. Investigators utilized a bi-directional generative diffeomorphic registration neural network to calculate inter-frame motion fields. A differentiable composition layer was then applied to derive the Lagrangian motion field from these results. The team extended this framework by incorporating an additional registration network to minimize accumulated errors. This design choice specifically targets the refinement of Lagrangian motion estimation across the entire sequence. The researchers validated their approach using ultrasound, untagged cine, and tagged cine cardiac magnetic resonance image sequences. Their methodology relies on temporal information to ensure the spatio-temporal motion fields remain physically plausible. This systematic approach allows for high-speed inference without requiring manual annotations or pre-labeled training datasets.

    Main Results:

    Key findings from the literature indicate that the proposed framework significantly outperforms conventional motion tracking methods in both accuracy and inference efficiency. The system successfully processes diverse imaging modalities, including ultrasound and various cardiac magnetic resonance sequences. By employing motion decomposition, the model effectively reduces the errors typically associated with sequential inter-frame tracking. The differentiable composition layer allows for the precise estimation of Lagrangian motion fields relative to a reference frame. Results demonstrate that the integration of temporal information leads to more reasonable spatio-temporal motion field estimations. The authors report that their unsupervised approach provides a robust solution for complex myocardial deformation tasks. Quantitative comparisons confirm that the new method is superior to traditional techniques in clinical-grade image sequence analysis. These results highlight the potential of deep learning to enhance the reliability of automated cardiac function assessment.

    Conclusions:

    The authors propose that their novel framework offers a superior alternative to conventional motion tracking techniques. Synthesis and implications suggest that the integration of motion decomposition improves overall estimation precision. The researchers claim that their approach achieves higher accuracy while maintaining better computational efficiency than existing standards. Evidence indicates that the system performs reliably across both ultrasound and various cardiac magnetic resonance modalities. The study highlights that temporal information utilization allows for more reasonable spatio-temporal motion field estimations. The authors conclude that their method provides a practical solution for clinical image sequence analysis. The findings imply that the differentiable composition layer effectively addresses issues related to accumulated tracking errors. This work demonstrates that unsupervised deep learning architectures can successfully handle complex myocardial deformation tasks.

    The framework employs temporal information to perform spatio-temporal motion field estimations. This data type is crucial for the model to understand the continuity of the heart cycle, allowing it to produce more accurate results than methods that only analyze individual image pairs in isolation.

    The authors measured cardiac motion tracking accuracy and inference efficiency. They compared their unsupervised deep learning approach against conventional tracking methods, demonstrating that their system is significantly superior in both metrics across ultrasound, untagged cine, and tagged cine magnetic resonance images.

    The researchers claim that this framework provides a useful solution for image sequence motion tracking. They imply that by overcoming the limitations of traditional methods, their tool could eventually support more reliable automated assessments of myocardial deformation in clinical diagnostic settings.