Related Experiment Video
Updated: Mar 22, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Tackling reliability and construct validity: the systematic development of a qualitative protocol for skill and
Trevor Nicholas Savage1, Andrew Stuart McIntosh2
1a Centre for Musculoskeletal Research , School of Allied Health Sciences, Griffith University , Nathan , Australia.
Developing a reliable skill analysis protocol is crucial for understanding sports injury causes. This study refined a qualitative method for analyzing complex movements like Rugby tackles, enhancing objectivity and reliability in sports science research.
Area of Science:
- Sports Science
- Biomechanics
- Injury Prevention
Background:
- Understanding sports injury causes is vital for improving skill effectiveness and safety.
- Quantitative analysis of complex sports skills faces ethical, technological, and validity challenges.
- Qualitative methods for human movement analysis are increasingly used but raise concerns about reliability and bias.
Purpose of the Study:
- To outline a systematic approach for developing an objective, valid, and reliable skill analysis protocol.
- To address concerns regarding the reliability and measurement bias of qualitative methods in human movement research.
- To improve the investigation of complex sports skills, using the Rugby union tackle as a case study.
Main Methods:
- Selected analysis characteristics using qualitative analysis, biomechanical models, and literature review.
- Utilized an expert panel for feedback on the developed skill analysis protocol.
- Assessed inter-rater reliability with ten trained raters, revised the protocol based on feedback, and re-assessed reliability.
Main Results:
- Initial inter-rater reliability assessment led to protocol revision by an expert panel.
- A second inter-rater reliability study showed improved mean agreement (52-90%) and intraclass correlation coefficients (ICC) between 0.6 and 0.9.
- The revised protocol demonstrated reliability comparable to other qualitative human movement analysis studies.
Conclusions:
- A systematic approach can enhance the objectivity, validity, and reliability of qualitative skill analysis protocols.
- The developed protocol provides a reliable method for analyzing complex movements like the Rugby tackle.
- This research contributes to more robust qualitative analysis in sports science, aiding in injury prevention and skill improvement.
Related Concept Videos
Reliability and Validity
Qualitative Analysis
There are two main approaches to qualitative analysis:...
Qualitative Analysis
For instance, group IV...
Cochran's Q Test
Data Validation
Key parameters for method validation include:
Quality Assurance

