Performance characteristics of several rules for self-interpretation of proficiency testing data

Area of Science:

• Clinical laboratory science
• Medical diagnostics
• Quality assurance in healthcare

Background:

• Proficiency testing (PT) allows laboratory participants to identify errors, even with acceptable performance metrics.
• Effective interpretation of PT results is crucial for maintaining high standards in diagnostic testing.

Purpose of the Study:

• To identify the most effective rules for interpreting PT data with five samples per event.
• To optimize performance in PT by evaluating different data interpretation strategies.

Main Methods:

• Utilized Monte Carlo computer simulations to assess various PT data interpretation rules.
• Analyzed error detection capabilities based on method quality, PT failure probability, and SD ratios.
• Defined PT failure as two or more out of five results exceeding acceptable limits per CLIA '88.

Main Results:

• No single interpretation rule demonstrated optimal performance across all levels of method quality.
• The effectiveness of rules varied depending on the analytic quality, PT failure rates, and SD ratios.

Conclusions:

• Recommended specific PT data rejection rules: exceeding 75% of allowable error, inter-sample SD exceeding 4x peer group SD, or mean SD index > 1.5.
• As method quality improves, false rejections decrease, and the detection of significant shifts increases.
• Further investigation into PT data interpretation rules is warranted to enhance laboratory quality control.