Related Experiment Video
Updated: Jul 11, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
Reliability of repeatability and reproducibility measures in collaborative trials.
1Health and Welfare Canada, Food Statistics and Operational Planning Division, Ottawa, Ontario.
Assessing new analytical methods relies on repeatability and reproducibility. Small collaborative studies yield unreliable reproducibility estimates, potentially leading to method acceptance based on less relevant repeatability data.
Area of Science:
- Analytical Chemistry
- Method Validation
Background:
- Analytical method validation typically involves assessing repeatability and reproducibility through collaborative studies.
- Acceptance criteria for new methods are often based on these statistical estimates.
Purpose of the Study:
- To present procedures for calculating confidence intervals and operating characteristic curves for method acceptance criteria.
- To compare the reliability of repeatability and reproducibility estimates with varying numbers of collaborators.
Main Methods:
- Utilized collaborative study data to derive repeatability and reproducibility estimates.
- Developed methods for calculating confidence intervals and operating characteristic curves.
- Analyzed the impact of the number of collaborators on estimate reliability.
Main Results:
- Established procedures for evaluating method acceptability based on statistical estimates.
- Demonstrated that a small number of collaborators significantly reduces the reliability of reproducibility estimates.
- Highlighted that method decisions may unduly favor repeatability over reproducibility with limited collaborators.
Conclusions:
- Method acceptability decisions require careful consideration of the number of collaborators in validation studies.
- Ensuring sufficient collaborators is crucial for obtaining reliable reproducibility estimates, which are key for method validation.
More Related Videos
04:50Reproducibility and Harmonization in Research Using Biological Standards: The Example of Platelet Agonist Collagen-Related Peptide
Published on: August 4, 2023
09:18Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting
Published on: December 15, 2023
Related Concept Videos
Reliability and Validity
Uncertainty in Measurement: Accuracy and Precision
Accuracy and Precision
Random and Systematic Errors
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs