Related Experiment Video
Updated: Apr 30, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Validating the strategies analysis diagram: assessing the reliability and validity of a formative method
Miranda Cornelissen1, Roderick McClure2, Paul M Salmon3
1Griffith Aviation, Griffith University, Nathan Campus, 170 Kessels road, Nathan, QLD 4111, Australia; Monash Injury Research Institute, Monash University, Building 70, Clayton Campus, Wellington Road, Clayton, VIC 3800, Australia.
The Strategies Analysis Diagram (SAD) method shows average individual performance but improved reliability and validity when group analysis is used. Structured group processes ensure the method
Area of Science:
- Sociotechnical systems analysis
- Human factors and ergonomics
- Cognitive systems engineering
Background:
- The Strategies Analysis Diagram (SAD) is a novel method for modeling strategies in complex sociotechnical systems.
- Ergonomics methods often lack robust performance evidence, hindering widespread adoption.
- Evaluating the validity and reliability of new methods is crucial for practical application.
Purpose of the Study:
- To evaluate the criterion-referenced validity and test-retest reliability of the SAD method.
- To assess the performance of novice analysts using the SAD method.
- To determine the impact of group analysis on SAD method's reliability and validity.
Main Methods:
- Criterion-referenced validity assessment.
- Test-retest reliability analysis.
- Novice analysts utilized the SAD method for modeling strategies.
Main Results:
- Individual analyst performance with the SAD method was average.
- Pooling individual analyst outputs into a group model significantly enhanced reliability and validity.
- A structured group process improved the overall performance of the SAD method.
Conclusions:
- The SAD method's reliability and validity can be assured through structured group analysis.
- Individual SAD models should be pooled by another analyst or a group to achieve a reliable group model.
- The SAD method is a viable tool for strategy analysis in sociotechnical systems when implemented with group consensus.
Related Concept Videos
Formulating and Validating Nursing Diagnosis II
Risk nursing diagnoses represent clinical judgments of an individual, family, or community more vulnerable to developing the health problem than others...
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Reliability and Validity
Formulating and Validating Nursing Diagnosis I
There are thirteen domains...
Strategies of Self-Presentation II: Self-Verification
Metacognition

