它会运行吗? - - 一个概念验证烟雾测试去中心化数据分析实验的实验.
Sascha Welten1, Sven Weber1,2, Adrian Holt1
1Chair of Computer Science 5, Rheinisch-Westfälische Technische Hochschule (RWTH) Aachen University, Aachen, Germany.
Frontiers in medicine
|January 23, 2024
概括
本研究介绍了DEATHSTAR,这是一个用于烟雾测试分布式分析 (DA) 的工具,以防止数据驱动医学研究的失败. 它确保了96.6%的分析成功运行,提高了诸如欧洲健康数据空间之类的倡议的可靠性.
科学领域:
- 医疗信息学 医疗信息学
- 数据科学数据科学数据科学
- 软件工程 软件工程 软件工程
背景情况:
- 在数据驱动医学中,对保护隐私的数据分析需求日益增长,例如欧洲健康数据空间 (EHDS) 等倡议.
- 分布式分析 (DA) 提供了多源数据分析的潜力,但引入了诸如识别单一故障点 (SPOF) 等挑战.
- 未被检测到的SPOF可以导致代码故障,研究延迟和成本增加.
研究的目的:
- 解决在执行前在分布式分析 (DA) 任务中识别 SPOF 的挑战.
- 通过烟雾测试引入和评估一种新的方法,以确保DA分析代码的可操作性.
- 为研究人员开发一个互动的环境,在DA实验中进行烟雾测试.
主要方法:
- 审查了现有的DA平台,以提取DA应用程序的六个特定的烟雾测试标准.
- 根据这些标准,开发了基于分析运行的Automated和整体烟雾测试 (DEATHSTAR) 的开发环境.
- 对29名参与者进行了用户研究,并将DEATHSTAR应用于三个真实世界的使用案例.
主要成果:
- 对DEATHSTAR环境进行了评估,以评估其在DA实验上的烟雾测试中的有效性.
- 一项用户研究表明,96.6%使用DEATHSTAR方法创建和测试的分析成功完成,没有错误.
- 该方法在开发过程的早期有效地识别了潜在的故障.
结论:
- 将烟雾测试作为一种基本方法显著提高了使用DA的数据驱动研究的可靠性.
- DEATHSTAR提供了一种灵活和可适应的解决方案,用于稳健和高效地开发DA实验.
- 开发的方法有助于更顺,更可靠,更具成本效益的数据密集型研究.
相关概念视频
Wald-Wolfowitz Runs Test I
648
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
The test works...
648
Data Collection by Experiments
24.2K
Data collection is a systematic method of obtaining, observing, measuring, and analyzing accurate information. An experimental study is a standard method of data collection that involves the manipulation of the samples by applying some form of treatment prior to data collection. It refers to manipulating one variable to determine its changes on another variable. The sample subjected to treatment is known as “experimental units.”
An example of the experimental method is a public...
An example of the experimental method is a public...
24.2K
Cochran's Q Test
334
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
334
Decision Making: Traditional Method
4.0K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.0K
Statistical Hypothesis Testing
1.9K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
1.9K
Significance Testing: Overview
3.4K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
3.4K


