Receiver operating characteristic analysis: a useful method for a comparison of the clinical relevance of two in

F de Blay1, H Zana, M Offner

  • 1Hôpital Civil, Hôpitaux Universitaires de Strasbourg, France.

Insights

Receiver Operating Characteristic (ROC) analysis effectively compares in vitro tests for specific immunoglobulin E (IgE) antibodies. This method highlights discrepancies between test units and aids in standardizing IgE testing.

Area of Science:

  • Allergy and Immunology
  • Diagnostic Test Evaluation
  • Clinical Chemistry

Background:

  • In vitro diagnostic tests for specific immunoglobulin E (IgE) antibodies are crucial for allergy diagnosis.
  • Standardization of these tests is essential for accurate clinical interpretation.
  • Receiver Operating Characteristic (ROC) analysis offers a statistical approach to evaluate diagnostic test performance.

Purpose of the Study:

  • To assess the utility of ROC analysis in defining positive thresholds for comparing two in vitro IgE tests.
  • To determine the clinical relevance of specific IgE tests based on ROC-derived sensitivity and specificity.
  • To compare the performance of MATRIX and PHADEZYM specific IgE assays.

Main Methods:

  • Specific IgE levels were measured using MATRIX and PHADEZYM tests in 109 patients (86 allergic, 23 controls).
  • Patients had a history of allergy to common aeroallergens (mite, cat, grass, birch) and positive skin prick tests.
  • ROC curves were generated to identify optimal thresholds for true positive and false positive ratios for four aeroallergens.

Main Results:

  • ROC analysis revealed a lack of correspondence between positive thresholds of MATRIX and PHADEZYM tests, except for mite allergen.
  • Threshold classes varied between tests for cat, grass, and birch pollen (MATRIX: class III; PHADEZYM: class II).
  • Sensitivity and specificity were generally similar, but PHADEZYM showed lower sensitivity for cat allergy (0.71) compared to MATRIX (0.90). Both tests demonstrated 100% specificity in control groups.

Conclusions:

  • ROC analysis is a reliable method for comparing in vitro IgE tests.
  • The study highlights the lack of standardization in arbitrary units across different IgE in vitro tests.
  • ROC analysis can aid in the standardization of IgE in vitro testing.
Abstract