通过设计获得更好的功率:在反复测量实验中,变子块随机化增加了功率
1School of Psychology & Neuroscience, University of Glasgow.
Psychological methods
|December 12, 2024
概括
实验中的时间变化降低了统计能力. 换算子块随机化 (PSR) 随着时间的推移平衡条件,平均增加13%的实验功率,并控制错误阳性. 一个R包,explain,实现了这个方法.
科学领域:
- 实验心理学 实验心理学
- 研究方法研究方法研究方法学
- 统计能力 统计能力
背景情况:
- 在实验期间,由于学习,疲劳或注意力波动,参与者的表现可能会有所不同.
- 这种时间变化可能会对测量准确性产生负面影响,并降低研究中的统计能力.
- 标准的随机化方法可能无法充分解决参与者的时间依赖性变化.
研究的目的:
- 介绍和评估一个受限制的随机化算法, permuted-subblock随机化 (PSR),旨在减轻实验会话中的时间变化.
- 评估PSR在提高统计能力的有效性,同时保持对虚假阳性率的控制.
- 为研究人员提供一个实用的工具,在他们的实验设计中实施PSR.
主要方法:
- 使用蒙特卡洛模拟来评估PSR性能在各种时间依赖的错误场景下.
- 模拟的错误类型包括指数式衰变 (学习效应),高斯随机步行,粉红色噪声和这些混合物.
- 评估了PSR对不同研究设计的统计能力和错误阳性率的影响.
主要成果:
- 转换子块随机化 (PSR) 显示,统计能力平均增加了大约13%.
- 在各种模拟研究设计中,功率提升范围从4%到45%不等.
- 在没有时间依赖变化的情况下,PSR有效控制了虚假阳性率.
结论:
- PSR是一种有效的受限随机化技术,用于增强时间变化的实验中的统计能力.
- 该算法在整个会话中成功平衡了实验条件,提高了测量可靠性.
- R包"explain"为实验规划提供了一个用户友好的PSR实现.
相关概念视频
01:13Randomized Experiments
6.7K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
6.7K
02:01Group Design
8.9K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
8.9K
01:17Wald-Wolfowitz Runs Test II
180
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
180
01:23McNemar's Test
146
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
146
01:17Wald-Wolfowitz Runs Test I
606
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
The test works...
606
01:09Censoring Survival Data
62
Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
62