Evaluation of a combat medic skills validation test

The purpose of this study was to describe validity and reliability of a skills-based test (the Semi-Annual Combat Medic Skills-Validation Test) used by the Army to determine combat medic competency. An instrumentation design was used in which a panel of experts completed a content validity index on all skills. Simulation testing was used to determine criterion validity, intrarater, interrater, and test-retest reliability. Findings revealed that needle chest decompression, Combitube insertion, and automatic external defibrillator were the only skills with low validity (content validity index < or = 0.75). Splinting was recommended as an addition to the skill test. The validity criterion of a modified postcourse Emergency Medical Technician-Basic examination score was significantly related to the Semi-Annual Combat Medic Skills-Validation Test scores (r = 0.409, p = 0.006, two tailed). There was high intra- and interrater agreement on performance steps and skills. Higher subject scores were seen on the medical skills than on the trauma skills. When retested, there was significant improvement (t = 3.268, df = 7, p < 0.014, two tailed).