Related Experiment Videos
Correcting for indirect range restriction in meta-analysis: testing a new meta-analytic procedure
1Department of Psychology, University of Central Florida, Orlando, FL 32816-1390, USA. hale@mail.ucf.edu
Psychological Methods
|December 13, 2006
Summary
A new meta-analysis procedure by Hunter et al. (2006) offers more accurate corrections for indirect range restriction than the conventional Thorndike Case II method. This improved accuracy holds even when assumptions are violated, leading to different conclusions in meta-analytic research.
Area of Science:
- Psychometrics
- Meta-analysis
- Statistical modeling
Background:
- Range restriction is a common issue in meta-analysis, affecting the accuracy of effect size estimates.
- The conventional Thorndike Case II correction is typically used, but it is designed for direct range restriction.
- Hunter et al. (2006) proposed a procedure to correct for indirect range restriction, the more prevalent form.
Purpose of the Study:
- To evaluate the accuracy of Hunter et al.'s (2006) indirect range restriction correction procedure.
- To compare its accuracy against the conventional Thorndike Case II correction for direct range restriction.
- To assess the robustness of Hunter et al.'s procedure when its assumptions are violated.
Main Methods:
- Computer simulations were employed to assess the accuracy of the two correction procedures.
- The simulations varied conditions, including violations of the key assumption of mediation.
- The accuracy of estimating the mean and standard deviation was compared between the methods.
Main Results:
- Hunter et al.'s (2006) procedure demonstrated superior accuracy in estimating both the mean and standard deviation compared to the Thorndike Case II correction.
- The improved accuracy of Hunter et al.'s procedure persisted even when the assumption of full mediation was violated.
- Application to a real-world meta-analysis revealed that the new procedure led to substantively different conclusions.
Conclusions:
- The Hunter et al. (2006) procedure is a more accurate method for correcting indirect range restriction in meta-analysis.
- Researchers should consider adopting this newer procedure for more reliable meta-analytic findings.
- The choice of correction method can significantly impact the substantive conclusions drawn from meta-analytic research.
Related Concept Videos
01:21Friedman Two-way Analysis of Variance by Ranks
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...
01:14Wilcoxon Signed-Ranks Test for Median of Single Population
The Wilcoxon signed-rank test for the median of a single population is a nonparametric test used to evaluate whether the median of a population differs from a specified value. Unlike parametric tests, it does not require data to follow a normal distribution, making it suitable for non-normal or small samples. The test begins by calculating the difference (d) between each observation and the hypothesized median. The absolute values of these differences are ranked in ascending order, with ties...
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:19The Mantel-Cox Log-Rank Test
The Mantel-Cox log-rank test is a widely used statistical method for comparing the survival distributions of two groups. It tests whether a statistically significant difference exists in survival times between the groups without assuming a specific distribution for the survival data, making it a non-parametric test. This flexibility makes the log-rank test particularly valuable in medical research and other fields where the timing of an event, such as death or disease recurrence, is of interest.
01:10Bonferroni Test
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
01:16Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...