多元分析 (PIMA) 中的选择后推理:基于符号翻转得分测试的推理框架
Paolo Girardi1, Anna Vesely2, Daniël Lakens3
1Department of Environmental Sciences, Informatics and Statistics, Ca' Foscari University of Venice, Via Torino 155, 30172, Venezia-Mestre, VE, Italy. paolo.girardi@unive.it.
Psychometrika
|April 25, 2024
概括
研究人员现在可以使用多元宇宙分析 (PIMA) 的后选择推理方法,在许多数据分析选择中严格测试假设. 该方法通过为复杂模型提供强大的推理程序来解决复制危机.
科学领域:
- 统计 统计 统计 统计
- 数据科学数据科学数据科学
- 研究方法研究方法研究方法学
背景情况:
- 数据分析涉及许多选择,有些是任意的,导致复制危机.
- 多元分析评估了跨选择的结果稳定性,但缺乏推断力.
- 规范曲线分析提供推断,但仅限于线性模型和简单的假设测试.
研究的目的:
- 引入一个灵活和通用的推理方法,用于多元分析.
- 为了使各种数据规格和通用线性模型的假设测试.
- 为稳健的统计索赔提供对家庭智能的错误率进行强有力的控制.
主要方法:
- 开发一种选择后推断方法来进行多元分析 (PIMA).
- 使用条件重抽样程序进行推理.
- 通过模拟进行I型错误率控制和统计功率计算的正式证明.
主要成果:
- 皮马为多元分析提供了一个灵活和通用的推理框架.
- 该方法控制了家族智能错误率,允许对显著规范的虚假假设拒绝的要求.
- 模拟研究证实了控制的I型错误率,并评估了统计能力.
结论:
- PIMA提供了一个强大的推断工具,用于导航数据分析的多元宇宙.
- 该方法通过考虑分析选择来提高研究结果的可靠性.
- 提供了实施PIMA在现实世界数据分析中的实用建议,包括COVID-19疫苗犹案例研究.
相关概念视频
Introduction to the Sign Test
816
The sign test is an important tool in nonparametric statistics, offering a straightforward yet effective method for analyzing matched pairs, nominal data, or hypotheses concerning the median of a population. It transforms data points into positive or negative signs, avoiding the need for assumptions about data distribution and instead focusing on the direction of change. It is particularly valuable when data does not conform to the normal distribution requirements of many parametric tests. For...
816
Sign Test for Matched Pairs
131
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
131
Sign Test for Nominal Data
95
The sign test is a nonparametric method used to evaluate hypotheses about the median of a single sample or to compare the medians of two related samples. The sign test is particularly useful when dealing with nominal data, which includes distinct categories without an inherent order, such as names, labels, and preferences. Nominal data restricts statistical analysis to evaluating population proportions rather than mean or median values that require continuous data.
For example, consider a...
For example, consider a...
95
Sign Test for Median of Single Population
114
In general, the sign test serves as a nonparametric method to test hypotheses about the median of a single population when the data does not follow a known distribution. This simplicity makes it particularly useful for small sample sizes or when the assumptions of parametric tests cannot be met. The process begins with identifying a null hypothesis, typically stating that the population median equals a specific value. The alternative hypothesis could be that the median is either not equal to,...
114
Significance Testing: Overview
3.4K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.4K
Bonferroni Test
2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K


