Global sensitivity analyses for test planning with black-box models for Mars Sample Return
Giuseppe Cataldo1, Emanuele Borgonovo2, Aaron Siddens3
1NASA, Goddard Space Flight Center, Greenbelt, Maryland, USA.
Abstract:
This work describes sensitivity analyses performed on complex black-box models used to support experimental test planning under limited resources in the context of the Mars Sample Return program, which aims at bringing to Earth rock, regolith, and atmospheric samples from Mars. We develop a systematic workflow that allows the analysts to simultaneously obtain quantitative insights on key drivers of uncertainty, the direction of impact, and the presence of interactions. We apply optimal transport-based global sensitivity measures to tackle the multivariate nature of the output and we rely on sensitivity measures that do not require independence between the model inputs for the univariate output case. On the modeling side, we apply multifidelity techniques that leverage low-fidelity models to speed up the calculations and make up for the limited amount of high-fidelity samples, while keeping the latter in the loop for accuracy guarantees. The sensitivity analysis reveals insights useful to understand the model's behavior and identify the factors to focus on during testing, in order to maximize the informational value extracted from these tests and ensure mission success even with limited resources.
Related Concept Videos
Sampling Plans
Random sampling is a method where each member of the population has an equal chance of being selected for the sample. It involves selecting individuals randomly, often using random number generators or lottery-type methods. For example, when analyzing the properties of a...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
McNemar's Test
Case Studies
Mechanistic Models: Compartment Models in Individual and Population Analysis


