Validity and reliability of three methods used in the diagnosis of Raynaud's phenomenon. The UK Scleroderma Study...

Three different assessment methods for the classification of Raynaud's phenomenon (RP) were compared. These were (i) a previously validated method using colour charts supplemented with a short questionnaire, (ii) answers to a questionnaire based on criteria derived from the consensus opinion of a group of clinicians, and (iii) individual clinician's assessment using standard descriptions based upon the same consensus view. We report the results of a study involving six clinicians and 30 subjects investigating the level of repeatability between the three methods and also the reliability between the six clinicians. There did not exist any overall systematic bias between the six clinicians. Further, agreement between them, as assessed by the kappa statistic, ranged from moderate to good. However, there did exist systematic bias between the results from all three of the classification approaches with agreement between them ranging from only poor to moderate. We conclude that the previously validated colour chart assessment is too insensitive to detect RP. Further, a structured questionnaire based on perceived clinician's opinion could not reproduce clinicians' classification in practice. By contrast, supplying clinicians with standard descriptions did yield a reliable classification system for RP.