Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Typical Model Studies01:30

Typical Model Studies

Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
Acute Coronary Syndrome III: Diagnostic Studies01:30

Acute Coronary Syndrome III: Diagnostic Studies

Diagnosing acute coronary syndrome or ACS begins with a thorough patient history. Notable symptoms include central, crushing chest pain radiating to the left arm, neck, jaw, or back, along with shortness of breath, sweating (diaphoresis), nausea, vomiting, dizziness, and palpitations.It is crucial to note any history of cardiac illnesses and assess risk factors, including age, gender, smoking, hypertension, diabetes, hyperlipidemia, and a sedentary lifestyle.During physical examination, vital...
Multiple Comparison Tests01:13

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Historical and clinical contributions of the JSRT chest radiograph database to medical imaging research.

Radiological physics and technology·2026
Same author

John Roderick Cameron (1922-2005): Scientist, teacher, mentor, inventor, and philanthropist extraordinaire.

Radiological physics and technology·2024
Same author

[Spain, France, Germany, Italy].

Igaku butsuri : Nihon Igaku Butsuri Gakkai kikanshi = Japanese journal of medical physics : an official journal of Japan Society of Medical Physics·2023
Same author

[Investigating the Usefulness of Breath-holding Instructions by Change in the Room Light for the Hearing Impaired].

Nihon Hoshasen Gijutsu Gakkai zasshi·2023
Same author

[Chile, Guam Island, Czech, and Argentina].

Igaku butsuri : Nihon Igaku Butsuri Gakkai kikanshi = Japanese journal of medical physics : an official journal of Japan Society of Medical Physics·2023
Same author

[Portugal, Hungary, South Africa, and Thailand].

Igaku butsuri : Nihon Igaku Butsuri Gakkai kikanshi = Japanese journal of medical physics : an official journal of Japan Society of Medical Physics·2022

Related Experiment Videos

Comparison of typical evaluation methods for computer-aided diagnostic schemes: Monte Carlo simulation study.

Qiang Li1, Kunio Doi

  • 1Department of Radiology, MC2026, The University of Chicago, 5841 South Maryland Avenue, Chicago, Illinois 60637, USA. qiangli@uchicago.edu

Medical Physics
|April 19, 2007
PubMed
Summary

This study compares common evaluation methods for computer-aided diagnostic (CAD) schemes, offering guidance on selecting the best approach for assessing CAD performance in medical imaging. It addresses bias, generalization, and uniqueness for trained CAD systems.

Related Experiment Videos

Area of Science:

  • Medical Imaging
  • Artificial Intelligence in Medicine
  • Radiology

Background:

  • Computer-aided diagnostic (CAD) schemes assist radiologists in detecting lesions in medical images.
  • Existing evaluation methods for CAD schemes include resubstitution, leave-one-out, cross-validation, and hold-out techniques.
  • Previous research has explored the bias of these methods in estimating CAD performance with finite samples.

Purpose of the Study:

  • To systematically compare common CAD evaluation methods.
  • To analyze bias, generalization performance, and uniqueness of trained CAD schemes.
  • To provide a guideline for selecting appropriate evaluation methods in practical CAD assessment scenarios.

Main Methods:

  • Examination and comparison of multiple common evaluation methods for CAD schemes.
  • Assessment of bias in estimated performance levels.
  • Evaluation of generalization performance and uniqueness of trained CAD schemes.

Main Results:

  • Systematic comparison of bias, generalization, and uniqueness across different CAD evaluation methods.
  • Identification of strengths and weaknesses of each evaluation approach.
  • Data-driven insights into the reliability of performance estimates.

Conclusions:

  • The study provides a comprehensive comparison of CAD evaluation methodologies.
  • Findings aim to guide researchers in selecting optimal methods for assessing CAD schemes.
  • A guideline is proposed to enhance the rigor and applicability of CAD performance evaluations.