Psychometric properties of two implementation measures: Normalization MeAsure Development questionnaire (NoMAD) and...

Area of Science:

• Healthcare Implementation Science
• Psychometrics
• Mental Health Services Research

Background:

• Successful intervention implementation requires effective strategies and progress monitoring.
• Two key measures, the Normalization MeAsure Development (NoMAD) and Organizational Readiness for Implementing Change (ORIC), assess implementation effectiveness.
• NoMAD assesses Normalization Process Theory concepts, while ORIC measures organizational preparedness for change.

Purpose of the Study:

• To examine the measurement properties of the NoMAD and ORIC.
• To evaluate their validity and reliability in a multi-national implementation effectiveness study.
• To confirm psychometric properties across diverse language settings.

Main Methods:

• A multi-national study involving 318 staff across 12 mental health organizations in 9 countries.
• Translation of NoMAD and ORIC into 8 languages using a forward-backward procedure.
• Analysis of convergent validity, confirmatory factor analysis (CFA), test-retest reliability, internal consistency (Cronbach's alpha), and floor/ceiling effects.

Main Results:

• NoMAD and ORIC measure related but distinct constructs; total scores are appropriate.
• Both measures demonstrated adequate to high internal consistency across total scales and subscales.
• Test-retest reliability was suboptimal; no floor or ceiling effects were observed.

Conclusions:

• The NoMAD and ORIC are confirmed as valid and reliable measures in multi-national mental health care settings.
• These instruments effectively assess different but related aspects of implementation processes.
• Their psychometric properties are robust across various language contexts, supporting their use in global research.