Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sample Size Calculation01:19

Sample Size Calculation

6.7K
Knowledge of the sample size is the first requirement to conduct random sampling or an experiment. The sample size is the total number of units, observations, or groups (in some cases) used to get the data to estimate a population parameter. As the name suggests, the sample size is that of the sample drawn from the population and differs from the population size.
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
6.7K
Reliability and Validity01:29

Reliability and Validity

14.1K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.1K
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

4.2K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
4.2K
One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

6.8K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
6.8K
Work Done on a System by External Force01:11

Work Done on a System by External Force

3.0K
The work done by an external force on a particle changes its kinetic energy. However, internal forces must also be considered for a system of interacting particles. The potential energy formulation helps formulate the effect of internal forces. The net work done by an external force can be written in terms of the total change of mechanical energy, which includes both kinetic and potential energies.
In the presence of a non-conservative opposing force, like friction, some part of the work done...
3.0K
Predicting Molecular Geometry02:27

Predicting Molecular Geometry

46.1K
VSEPR Theory for Determination of Electron Pair Geometries
46.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Performance of multivariable risk prediction algorithms in predicting COPD exacerbations: a population-based study.

Thorax·2026
Same author

Prediction of exposure to chrysotile asbestos fibers among Quebec miners and millers based on impinger measurements.

Annals of work exposures and health·2026
Same author

Effects of physical activity and diet in pregnancy to prevent gestational diabetes: an individual participant data (IPD) meta-analysis on the differential effects of interventions with economic evaluation.

Health technology assessment (Winchester, England)·2026
Same author

Prognostic factor research: why it matters in orthopaedics and how we do it better.

Bone & joint open·2026
Same author

Expected Value of Sample Information Calculations for Risk Prediction Model Development.

Statistics in medicine·2026
Same author

Performance of the Dutch Triage standard in managing fever in children in out-of-hours primary care: a secondary analysis of the chili study.

Family practice·2026
Same journal

A Causal Framework for Evaluating the Total Effect of Strategies Aiming to Expand Screening and to Improve Outcomes.

Statistics in medicine·2026
Same journal

Causal Effects on Nonterminal Event Time With Application to Antibiotic Usage and Future Resistance.

Statistics in medicine·2026
Same journal

Subgroup Analysis of Interval-censored Failure Time Data With Application to Alzheimer's Disease.

Statistics in medicine·2026
Same journal

Rejoinder to Commentaries on "A Perspective on the Appropriate Implementation of ICH E9(R1) Addendum Strategies for Handling Intercurrent Events".

Statistics in medicine·2026
Same journal

A Multi-Stage Drop-the-Loser Design With Superiority Boundaries.

Statistics in medicine·2026
Same journal

Interpretable ROI Identification in Brain Image Analysis: Overcoming CNN Black Box Challenges With Kriging-Enhanced Adaptive Sampling.

Statistics in medicine·2026
See all related articles
  1. Home
  2. Bayesian Sample Size Calculations For External Validation Studies Of Risk Prediction Models.
  1. Home
  2. Bayesian Sample Size Calculations For External Validation Studies Of Risk Prediction Models.

Related Experiment Video

An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.6K

Bayesian Sample Size Calculations for External Validation Studies of Risk Prediction Models.

Mohsen Sadatsafavi1, Paul Gustafson2, Solmaz Setayeshgar3

  • 1Faculty of Pharmaceutical Sciences and Faculty of Medicine, The University of British Columbia, Vancouver, British Columbia, Canada.

Statistics in Medicine
|February 12, 2026

View abstract on PubMed

Summary
This summary is machine-generated.

This study introduces a Bayesian framework for sample size calculations in risk prediction model validation. It offers flexible rules considering uncertainty, improving precision and clinical utility assessments for better model evaluation.

Keywords:
Bayesian statisticsdecision theoryrisk predictionsample sizeuncertainty

More Related Videos

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

7.5K
Author Spotlight: Streamlining Protein Target Prediction and Validation via Molecular Docking and CETSA
10:21

Author Spotlight: Streamlining Protein Target Prediction and Validation via Molecular Docking and CETSA

Published on: February 23, 2024

3.7K

Related Experiment Videos

An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.6K
How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

7.5K
Author Spotlight: Streamlining Protein Target Prediction and Validation via Molecular Docking and CETSA
10:21

Author Spotlight: Streamlining Protein Target Prediction and Validation via Molecular Docking and CETSA

Published on: February 23, 2024

3.7K

Area of Science:

  • Biostatistics
  • Epidemiology
  • Health Informatics

Background:

  • Current sample size calculations for external validation of risk prediction models rely on fixed performance metrics and precision targets.
  • This approach is limited by uncertainty in true model performance due to finite previous study samples.
  • Conventional methods are less suitable for assessing clinical utility using measures like net benefit (NB).

Purpose of the Study:

  • To propose a general Bayesian framework for multi-criteria sample size considerations for prediction models with binary outcomes.
  • To develop sample size rules for statistical performance metrics (discrimination, calibration) and clinical utility (net benefit).
  • To address limitations of conventional methods by incorporating uncertainty and providing flexible sample size determination.

Main Methods:

  • Developed a Bayesian framework for sample size calculations.
  • Proposed sample size rules targeting expected precision or assurance probability for performance metrics.
  • Introduced rules for net benefit based on Optimality Assurance and Value of Information (VoI) analysis.
  • Applied the framework to validate a COVID-19 patient deterioration risk model.

Main Results:

  • The Bayesian approach quantifies uncertainty in model performance, enabling flexible sample size rules.
  • Value of Information (VoI) analysis for net benefit suggested lower sample sizes compared to precision-based calibration metrics.
  • Demonstrated application in a case study for a COVID-19 risk prediction model.

Conclusions:

  • A Bayesian framework offers a more comprehensive approach to sample size calculation for external model validation.
  • This method allows for flexible sample size determination based on expected precision, assurance probabilities, and VoI.
  • The proposed approach, particularly VoI for net benefit, can lead to more efficient sample size requirements.