Groundwater modelling reports fail to comply with guideline recommendations for model reproducibility
Ehsan Kamali Maskooni1, Adrian D Werner1, S Cristina Solórzano-Rivas1
1College of Science and Engineering, Flinders University, GPO Box 2100, Adelaide, SA 5001, Australia; National Centre for Groundwater Research and Training, Flinders University, GPO Box 2100, Adelaide, SA 5001, Australia.
Journal of Environmental Management
|February 29, 2024
Summary
Groundwater model reports rarely contain enough information for external parties to rebuild the models. Only two of 25 reviewed reports allowed for model reproducibility, highlighting a gap in scientific best practices for groundwater impact assessments.
Area of Science:
- Hydrogeology
- Environmental modeling
- Scientific reproducibility
Background:
- Computer models are crucial for groundwater system decision-making.
- Model results inform regulatory approvals and project restrictions.
- Guidelines often recommend reports enable model rebuilding by external parties.
Purpose of the Study:
- To assess the "rebuildability" of groundwater models based on their reports.
- To evaluate compliance with best practices for groundwater model reporting.
- To identify deficiencies in information provided for model replication.
Main Methods:
- Reviewed 25 groundwater modeling reports from eight countries.
- Assessed 18 model components for information sufficiency to rebuild.
- Classified component reproducibility: reproducible, assumptions needed, or not reproducible.
- Used Analytical Hierarchical Process to rank report reproducibility.
Main Results:
- Only one report provided sufficient information to rebuild the model.
- One additional report included a model archive, enabling reproducibility.
- This resulted in only two of 25 reports meeting reproducibility standards.
- Significant deficiencies were found in reporting 18 key model components.
Conclusions:
- Groundwater modeling reports frequently lack the detail required for model replication.
- There is a significant gap between recommended best practices and actual reporting standards.
- Increased detail in reports or provision of model archives is necessary for stakeholder assessment of groundwater impacts.
Related Concept Videos
01:30Typical Model Studies
359
Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
359
01:12Modeling and Similitude
267
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
267
01:23Mechanistic Models: Compartment Models in Individual and Population Analysis
40
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
40
01:15Data Validation
162
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
162
01:21Design Example: Creating a Hydraulic Model of a Dam Spillway
168
Scaled hydraulic models of dam spillways provide a practical way to replicate and study the intricate flow dynamics of these structures. Often built to a 1:15 ratio, these models allow for observing critical water behavior, such as velocity distribution, flow patterns, and energy dissipation.
168
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
54
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
54