Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Relevance of statistically significant differences between reconstruction algorithms.

S Matej1, S S Furuie, G T Herman

  • 1Dept. of Radiol., Pennsylvania Univ., Philadelphia, PA.

IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society
|January 1, 1996
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

LUFT: A low-frequency ultrasound tomography system designed for lung imaging.

IEEE sensors journal·2024
Same author

System models for PET statistical iterative reconstruction: A review.

Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society·2016
Same author

GPU-Accelerated Forward and Back-Projections with Spatially Varying Kernels for 3D DIRECT TOF PET Reconstruction.

IEEE transactions on nuclear science·2013
Same author

Accelerated perturbation-resilient block-iterative projection methods with application to image reconstruction.

Inverse problems·2013
Same author

Perturbation-resilient block-iterative projection methods with application to image reconstruction from projections.

International transactions in operational research : a journal of The International Federation of Operational Research Societies·2012
Same author

Reconstruction from a Few Projections by ℓ(1)-Minimization of the Haar Transform.

Inverse problems·2011
Same journal

Style-Aware Contrastive Test-Time Adaptation: A Dual-Cache Model for Robust Vision-Language Alignment.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

Semantic Frame Interpolation.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

Physics-Guided Cross-Modal Decoupling with Test-Time Adaptation for Hyperspectral Image Restoration.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

Change-Prior-Guided Unsupervised Change Detection of Heterogeneous Remote Sensing Images.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

AgonicDreamer: Enhancing Multi-View Consistency in Text-to-3D Generation via Rectified Score Distillation.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same journal

BiCM-Prompt: Bidirectional Cross-Modal Prompt Tuning for Class-Incremental Learning on Multisource Remote Sensing Images.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
See all related articles

Statistical significance in algorithm comparison can be misleading. This study introduces a method to ensure statistical tests only highlight practically relevant performance improvements, not trivial ones.

Area of Science:

  • Computer Science
  • Data Science
  • Algorithm Analysis

Background:

  • Comparing reconstruction algorithms often relies on statistical significance.
  • Small, practically irrelevant differences can achieve statistical significance, complicating algorithm selection.
  • Existing evaluation metrics may not adequately distinguish between meaningful and trivial performance gains.

Purpose of the Study:

  • To formalize the concept of "relevance" in algorithm performance evaluation.
  • To propose a novel methodology for assessing reconstruction algorithm improvements.
  • To ensure statistical significance reflects practical utility rather than marginal changes.

Main Methods:

  • Developing a framework to define and quantify "relevant" performance differences.

Related Experiment Videos

  • Implementing statistical tests that incorporate a threshold for practical relevance.
  • Applying the methodology to compare different reconstruction algorithms.
  • Main Results:

    • Demonstrated that statistically significant improvements are not always practically relevant.
    • The proposed methodology successfully filters out irrelevant statistical significances.
    • The evaluation framework provides a more interpretable measure of algorithm performance.

    Conclusions:

    • A new standard for evaluating reconstruction algorithms is proposed.
    • The methodology enhances the reliability of performance comparisons.
    • This approach aids in selecting algorithms with genuinely impactful improvements.