An analysis of the FRACGP exam

This paper reports briefly on an analysis of data from five consecutive FRACGP examinations. Using new measurement technology, this study sought to investigate the reliability and efficiency of the exam, which has long been regarded as a valid and comprehensive assessment of competence for general practice in Australia. Results indicate that the examination achieves acceptable overall reliability, although some segments contribute more to the reliability than others. Suggestions for changes to improve reliability are made. A decision on implementing these changes must take into consideration any consequent changes in validity.