Related Experiment Video
Updated: Oct 14, 2025

Computerized Adaptive Testing System of Functional Assessment of Stroke
Published on: January 7, 2019
Evidence for Validity and Reliability, and Development of Performance Standards and Cut-Scores for Job-Related Tests
Michael P Scarlett1, W Todd Rogers, Eric M Adams
1Faculty of Kinesiology, Sport, and Recreation (Mr Scarlett, Dr Petersen); Faculty of Education (Dr Rogers); Faculty of Law (Dr Adams), University of Alberta; and School of Health and Life Sciences, Northern Alberta Institute of Technology (Dr Dreger), Edmonton, Alberta, Canada.
Objective:
This multi-part study aimed to revise an existing battery of physical aptitude tests for firefighter applicants. Test validity and reliability were evaluated and performance thresholds were determined.
Methods:
In Part I, 49 structural firefighters rated the similarity between the physical demands of the tests and corresponding work activities. In Part II, 23 participants completed the tests on 3 separate days. In Part III, cut-scores were determined using the Bookmark method by an expert panel of 25 firefighter supervisors.
Results:
Analysis revealed high levels of validity and reliability. The expert panel provided invaluable direction through a combination of independent and group work, leading to consensus on acceptable completion times.
Conclusion:
Rigorous processes established scientific credibility for the revised battery of tests. Expert knowledge from firefighter supervisors contributed to determining cut-scores following established scientific methods.
Related Concept Videos
Pulmonary Function Tests
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
Design Consideration
The factor of safety is another key...
Reliability and Validity
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Strength of Cement
For compressive strength tests, ASTM C 109-05 standards prescribe a cement-sand mix ratio of 1:2.75 and a water/cement ratio of 0.485 for making 2-inch cubes. These cubes are mixed, cast, and cured in saturated lime water at 23°C until testing. Flexural strength testing, outlined in...
Mechanical Characteristics of Steel
The tension test is fundamental for determining tensile strength. In this test, a steel specimen is stretched using a gripping device until it breaks. The data collected during this test are used...

