Related Experiment Video
Updated: May 21, 2026

Evaluation of Left Ventricular Structure and Function using 3D Echocardiography
Published on: October 28, 2020
Algorithm versus physicians variability evaluation in the cardiac chambers extraction
José Silvestre Silva1, Jaime B Santos, Diogo Roxo
1School of Technology and Management, Polytechnic Institute of Portalegre, Portalegre, Portugal. jsilva@ci.uc.pt
This study compares a new automated computer program against human doctors for measuring heart chamber sizes in ultrasound images. By testing how well the software identifies heart borders compared to four different experts, the researchers found that the computer's measurements were highly consistent. In fact, the software showed less variation in its results than the doctors did when comparing their own individual measurements. These findings suggest that automated tools can provide reliable and objective support for diagnosing congenital heart conditions.
Area of Science:
- Medical imaging informatics within cardiac chambers extraction research
- Computational cardiology and diagnostic methodology
Background:
Congenital heart defects affect a significant portion of the newborn population globally. Accurate diagnosis relies heavily on the quality of diagnostic imaging techniques available to clinicians. Precise assessment necessitates careful examination of cardiac structures, including wall movement and valve performance. Quantitative analysis of chamber volume remains a persistent challenge in standard clinical workflows. Prior research has shown that manual contouring is prone to subjective interpretation by different specialists. This gap motivated the development of various computational tools designed to automate image segmentation tasks. No prior work had resolved the discrepancy between machine-based extraction and human-led diagnostic variability. That uncertainty drove the need for a rigorous comparison between automated algorithms and expert clinicians.
Purpose Of The Study:
The researchers aimed to evaluate the performance of a new automated algorithm for extracting heart cavity contours. This study addresses the need for objective and consistent measurements in the diagnosis of congenital heart diseases. The authors sought to determine if a level set method could match the accuracy of human experts. By comparing machine-generated borders with manual sketches, the team investigated the reliability of automated segmentation. The motivation stems from the inherent variability associated with manual image analysis by clinicians. This work explores whether a phase symmetry approach can reduce the subjectivity found in traditional diagnostic methods. The study also examines the interobserver variability among four different physicians to provide a clear benchmark. Ultimately, the goal is to establish whether automated tools can provide a viable alternative to manual contouring in clinical echocardiography.
Main Methods:
Review approach involved a comparative analysis between automated software and human expert performance. The investigators utilized a level set algorithm incorporating a novel logarithmic-based stopping function for image processing. Researchers gathered a total of 240 distinct cardiac cavities to serve as the primary test set. Four physicians manually sketched the borders of these cavities to establish a baseline for comparison. The team applied nonparametric statistical tests to quantify the differences between the automated and manual results. Several figures of merit were calculated to assess the similarity of the extracted contours. This design ensured a comprehensive evaluation of both interobserver and intraobserver variability across all participants. The study focused on validating the consistency of the machine-based output against the standard clinical practice of manual tracing.
Main Results:
The strongest finding indicates that the automated algorithm produces results highly consistent with those of human experts. Statistical analysis reveals a great level of concordance across all utilized similarity indexes. The researchers observed a higher degree of interobserver variability among the four physicians than the variability found when comparing the algorithm against the experts. This suggests that the software provides a more stable performance than individual human clinicians. The data confirm that the proposed method successfully extracts heart cavity contours in a fully automatic manner. The study demonstrates that the machine-based approach achieves performance levels comparable to the manual sketches. These quantitative results support the utility of the phase symmetry approach in diagnostic imaging. The findings indicate that the algorithm effectively minimizes the subjective discrepancies inherent in manual contouring tasks.
Conclusions:
The researchers demonstrate that their automated approach achieves high concordance with manual expert delineations. Synthesis and implications indicate that the software performs with a level of consistency comparable to human specialists. The authors suggest that the proposed method effectively minimizes the subjective differences often observed during manual contouring. Findings imply that such tools could enhance the reliability of volumetric assessments in clinical settings. The study highlights that machine-based segmentation may offer a more stable alternative to traditional human-dependent methods. Observations indicate that the algorithm maintains performance levels that align well with established medical standards. The team concludes that their specific phase symmetry approach provides a robust framework for cardiac imaging tasks. Future applications might leverage these findings to support more standardized diagnostic procedures for congenital heart conditions.
Frequently Asked Questions
The researchers propose that the algorithm utilizes a phase symmetry approach combined with a logarithmic-based stopping function. This mechanism allows the software to identify heart cavity boundaries automatically, whereas physicians rely on visual inspection and manual sketching to define these same cardiac borders.
The study employs a set of 240 cavities to evaluate performance. These images serve as the benchmark for comparing the automated software against the manual tracings provided by four distinct physicians during the assessment process.
Nonparametric statistical tests are necessary to evaluate the similarity indexes between the machine and human observers. These tests provide a robust way to compare the variability of the algorithm against the subjective differences found among the four individual physicians.
The data type consists of manually sketched contours from four experts. These tracings act as the ground truth for measuring the accuracy of the automated segmentation software across the entire set of cardiac images.
The researchers measure interobserver variability, which represents the differences between the four physicians, and compare it to the variability between the algorithm and the human experts. The results show that the software exhibits less variation than the human observers.
The authors suggest that their automated method produces results similar to those provided by human experts. They propose that this similarity indicates the potential for the software to serve as a reliable tool for cardiac chamber extraction in clinical practice.