在估计行为测试-重新测试可靠性时,样本大小很重要.
Brendan Williams1,2, Lily FitzGibbon3, Daniel Brady4,5
1Centre for Integrative Neuroscience and Neurodynamics, University of Reading, Harry Pitt Building, Reading, UK. b.williams3@reading.ac.uk.
Behavior research methods
|March 22, 2025
概括
类内相关系数 (ICC) 可靠地测量反转学习,但准确的差异成分估计需要比通常使用的更大的样本大小. 差异分解对于强大的可靠性研究至关重要.
科学领域:
- 心理学 心理学 心理学
- 神经科学是一个神经科学.
- 统计 统计 统计 统计
背景情况:
- 类内相关系数 (ICC) 是评估测试复试可靠性和受试者之间的差异的标准.
- 然而,ICC估计可能会受到主体内变异性,随机错误和测量偏差的影响.
- 反向学习任务是行为灵活性的常见测试.
研究的目的:
- 使用ICCs量化反转学习的行为和计算措施的测试-重试可靠性.
- 通过模拟研究样本大小对差异成分估计的影响及其与ICC措施的关联.
主要方法:
- 利用来自大型在线样本 (N=150) 的数据进行行为和计算逆向学习测量.
- 进行了类内相关系数 (ICC) 分析以量化可靠性.
- 进行了模拟研究,以评估不同样本大小对差异成分估计的影响.
主要成果:
- 反向学习的行为和计算测量表明了可靠的测试-重新测试性能.
- 估计受试者之间,受试者内部和错误差异组件所需的样本大小从10到300以上.
- ICC估计与受试者之间的差异和错误差异有很强的相关性,但与受试者内部差异的相关性很弱.
结论:
- 对任务绩效指标的可靠性进行强有力的估计,需要比目前可靠性研究中通常采用的样本大小更大.
- 对于全面的可靠性研究来说,差异分解是必不可少的,因为单独的ICC可能无法完全捕捉对象内部的变异性.
- 这些发现强调了需要更大的样本大小,以确保行为研究中可靠性估计的有效性和精度.
相关概念视频
Sample Size Calculation
3.2K
Knowledge of the sample size is the first requirement to conduct random sampling or an experiment. The sample size is the total number of units, observations, or groups (in some cases) used to get the data to estimate a population parameter. As the name suggests, the sample size is that of the sample drawn from the population and differs from the population size.
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
3.2K
Statistical Significance
20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K
One-Way ANOVA: Equal Sample Sizes
3.1K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.1K
Contaminants and Errors
81
Effective sample preparation is crucial for accurate and reliable laboratory analysis. During this process, two significant sources of error can arise: concentration bias from improper sample splitting and contamination caused by methods used to reduce particle size, such as grinding or homogenization. Identifying and minimizing these potential errors is crucial to ensuring the validity of the analysis.
Another key consideration is determining the appropriate number of samples required to...
Another key consideration is determining the appropriate number of samples required to...
81
Significance Testing: Overview
3.3K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.3K
Central Limit Theorem
14.3K
The central limit theorem, abbreviated as clt, is one of the most powerful and useful ideas in all of statistics. The central limit theorem for sample means says that if you repeatedly draw samples of a given size and calculate their means, and create a histogram of those means, then the resulting histogram will tend to have an approximate normal bell shape. In other words, as sample sizes increase, the distribution of means follows the normal distribution more closely.
The sample size, n, that...
The sample size, n, that...
14.3K


