A statistical framework for planning and analysing test-retest studies of repeatability.
Moritz Fabian Danzer1, Maria Eveslage1, Dennis Görlich1
1Institute of Biostatistics and Clinical Research, University of Münster, Münster, Germany.
Statistical Methods in Medical Research
|February 1, 2024
Summary
Accurate measurement repeatability is crucial for assessing biomarkers. This study introduces a framework for sample size calculation in test-retest studies to ensure reliable biomarker assessment in longitudinal research.
Area of Science:
- Biomarker research
- Longitudinal study design
- Statistical methodology
Background:
- Quantitative biomarkers aid early assessment of treatment response and disease progression.
- Biomarker measurements have inherent random variability, potentially masking real changes.
- Assessing measurement repeatability is essential before longitudinal biomarker studies.
Purpose of the Study:
- To develop a comprehensive framework for sample size calculation in test-retest studies.
- To establish criteria for assessing the quality of biomarker assessment in longitudinal studies.
- To enable flexible sample size determination for test-retest studies.
Main Methods:
- Quantification of measurement repeatability using the repeatability coefficient from test-retest studies.
- Development of a novel framework for sample size calculation based on longitudinal assessment quality criteria.
- Application of the framework for retrospective assessment of existing test-retest studies.
Main Results:
- A flexible framework for sample size calculation in test-retest studies has been established.
- The framework links sample size to the desired quality of biomarker assessment in longitudinal studies.
- The proposed method allows for retrospective evaluation of prior test-retest study sample sizes.
Conclusions:
- The developed framework addresses the lack of guidelines for sample size calculation in test-retest studies.
- Accurate estimation of the repeatability coefficient is vital for reliable longitudinal biomarker assessment.
- This framework enhances the quality and reliability of quantitative biomarker utilization in clinical research.
Related Concept Videos
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Statistical Analysis: Overview
6.6K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.6K
Comparing Experimental Results: Student's t-Test
1.6K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
1.6K
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
1.6K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.6K
Uncertainty in Measurement: Accuracy and Precision
73.7K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
73.7K
Cochran's Q Test
334
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
334


