Model transparency and validation: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--7

Area of Science:

• Health economics and outcomes research
• Medical decision making
• Health modeling

Background:

• Trust and confidence are paramount for the success of health care models.
• Transparency and validation are key methods for building trust in health models.
• A joint taskforce from ISPOR and SMDM developed recommendations for model transparency and validation.

Purpose of the Study:

• To provide recommendations for enhancing transparency in health care models.
• To outline best practices for validating health care models.
• To ensure health models are understandable, reproducible, and accurately reflect reality.

Main Methods:

• Iterative development of recommendations by authors and a wider taskforce.
• Defining requirements for nontechnical descriptions (model type, inputs, outputs, data, limitations).
• Specifying requirements for technical documentation to enable evaluation and reproduction.
• Detailing various validation methods: face, verification, cross, external, and predictive validity.

Main Results:

• Recommendations for comprehensive nontechnical descriptions are provided.
• Guidelines for detailed technical documentation are established.
• A framework for multiple levels of model validation, emphasizing external and predictive validity, is presented.

Conclusions:

• Implementing these recommendations enhances the transparency and validity of health care models.
• Improved transparency and validation foster greater trust and confidence in model-based health decisions.
• The report provides a structured approach for modelers to meet standards for clarity and accuracy.