Related Experiment Video
Updated: Jul 17, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
The state of quality reports: comparing states by their rankings
Richard G Roberts1, Donna Friedsam, John W Beasley
1Department of Family Medicine, University of Wisconsin School of Medicine and Public Health , Madison 53715, USA. richard.roberts@fammed.wisc.edu
Background:
Public reports ranking physician competence and quality often yield conflicting results and create confusion.
Methods:
Bivariate Pearson correlation analyses were performed to compare states' rankings of physician discipline and physician quality, as reported by the Medicare program and National Practitioner Data Bank. Medical boards were surveyed on their rates of complaints against physicians and ratio of actions to complaints.
Results:
For all states, there was a poor to negative correlation between state rankings of disciplinary rates and quality, as well as rates of complaints against physicians. As an example, Wisconsin ranked 50th out of the 50 states plus the District of Columbia (where 1 is most desirable and 51 is worst) in rates of "serious" licensure sanctions, but did well when ranked by Medicare quality (eighth out of 51) and the rate of NPDB adverse reports (second out of 51). Wisconsin had a low rate of complaints per physician, ranking second out of 35 responding states, and a high ratio of actions to complaints, ranking fourth out of 35.
Conclusion:
Conflicting conclusions among public reports on physician discipline and quality raise questions about their methods and validity. State rankings of physician discipline and quality should be viewed with caution.
Related Concept Videos
Ranks
Review and Preview
Percentiles are a type of fractile that partition data into...
Review and Preview
Quality Control
Quality control helps track data, visualize trends, and identify variations, making it easier to detect deviations that may affect the accuracy of an analysis. One way to do this is by generating a quality control chart, which...
Percentile
Ordinal Level of Measurement
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks in the...