在效果大小估计中的异质性
Felix Holzmeister1, Magnus Johannesson2, Robert Böhm3,4
1Department of Economics, University of Innsbruck, A-6020 Innsbruck, Austria.
概括
科学研究表明,样本,设计和分析 (异质性) 的变化可以显著降低假设真实的概率,从而影响研究的概括性.
科学领域:
- 社会科学 社会科学 社会科学
- 实证研究方法 实证研究方法
背景情况:
- 实证研究涉及样本选择,研究设计和分析.
- 这些选择中的变化会产生异质性,增加不确定性并限制研究结果的概括性.
研究的目的:
- 为研究社会科学中的异质性提供一个框架.
- 将异质性分类为人口,设计和分析类型.
- 评估异质性对假设正确的概率的影响.
主要方法:
- 为分析异质性而开发的框架.
- 人口,设计和分析异质性的估计.
- 数据来源于70个多实验室复制研究,11个前性元分析和5个多分析师研究.
主要成果:
- 人口异质性相对较小.
- 设计和分析异质性被发现是很大的.
- 对异质性的计算表明,假设真实性的概率低于名义错误率.
结论:
- 异质性,特别是设计和分析,显著影响研究结果.
- 结果强调了需要分析和考虑社会科学研究中的异质性.
- 由于数据有限和异质性估计的不确定性,建议谨慎使用.
相关概念视频
One-Way ANOVA: Equal Sample Sizes
3.2K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.2K
One-Way ANOVA: Unequal Sample Sizes
5.7K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.7K
Test for Homogeneity
2.0K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
2.0K
Accuracy and Errors in Hypothesis Testing
186
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
186
Statistical Significance
20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K
Behrens–Fisher Test
74
The Behrens-Fisher test is a statistical method designed to address the Behrens-Fisher problem, which arises when comparing the means of two normally distributed populations with unequal variances. Unlike the Student's t-test, which assumes equal variances, the Behrens-Fisher test allows for mean comparison without this restrictive assumption. This flexibility makes it particularly valuable in scenarios where two independent samples exhibit normality but lack variance homogeneity.
This test...
This test...
74


