Validity and reliability of the on-road driving assessment with senior drivers

The on-road driving assessment is widely regarded as the criterion measure for driving performance despite a paucity of evidence concerning its psychometric properties. The purpose of this study was 2-fold. First, we examined the psychometric properties of an on-road driving assessment with 100 senior drivers between 60 and 86 years (80 healthy volunteers and 20 with specific vision deficits) using Rasch modeling. Second, we compared the outcome of the gestalt decision made by trained professionals with that based on weighted error scores from the standardized assessment. Rasch analysis provided good evidence for construct validity and inter-rater reliability of the on-road assessment and some evidence for internal reliability. Goodness of fit statistics for all items were within an acceptable range and the item hierarchy was logical. The test had a moderate reliability index (0.67). The best cut off score yielded sensitivity of 81% and specificity of 95% compared with the gestalt decision. Further research is required with less competent drivers to more fully examine reliability. Healthy senior drivers failed to check blind spots when changing lanes and made errors when asked to report road markings and traffic signs as they drove. In addition unsafe drivers had difficulty negotiating intersections and lane changes.