Related Experiment Video
Updated: Aug 13, 2026

Supervised Machine Learning for Semi-Quantification of Extracellular DNA in Glomerulonephritis
Published on: June 18, 2020
Diagnostic performance and inter-observer reproducibility of glomerular PLA2R immunohistochemistry in primary
Birgitte G Tougaard1, Søren Krag2, Eva Gravesen3
1Department of Renal Medicine, Aarhus University Hospital, Palle Juul-Jensens Boulevard 99, Aarhus N, 8200, Denmark. birgod@rm.dk.
Background:
PLA2R immunohistochemistry (IHC) and serum anti-PLA2R antibodies are key diagnostic tools in PLA2R-associated membranous nephropathy (MN). However, diagnostic performance and inter-observer reproducibility of PLA2R IHC across different laboratory protocols and cut-offs remain insufficiently validated. We performed local validation of two routine PLA2R IHC protocols and report the methodological considerations that emerged, including the interaction between cut-off selection, diagnostic accuracy, and observer reproducibility.
Methods:
In a multi-laboratory study, kidney biopsies from patients with primary MN (pMN), secondary MN, and non-MN controls were stained using two routine PLA2R IHC protocols (Aarhus University Hospital [AUH] and Herlev Hospital [HEH]). Seven blinded observers scored granular capillary wall staining intensity on a 0-3 scale. Diagnostic performance was assessed at a prespecified cut-off (≥ 2) and at protocol-specific optimal cut-offs determined by Youden's J index. Inter-observer agreement for the ordinal scale was quantified using intraclass correlation coefficients (ICC). Reproducibility of dichotomized classifications was evaluated using the ONEST framework, examining overall percent agreement (OPA) across increasing numbers of observers.
Results:
At the prespecified cut-off (≥ 2), sensitivity/specificity was 70%/70% for AUH and 55%/100% for HEH. Applying Youden's J calculated optimal cut-offs (AUH: ≥3; HEH: ≥1) yielded sensitivity/specificity of 65%/100% for AUH and 65%/93% for HEH. Single-rating reliability was good-to-excellent overall [ICC (2,1) = 0.85], with protocol-specific differences (AUH = 0.78; HEH = 0.93), and the seven-observer panel demonstrated excellent reliability [ICC (2,7) = 0.96-0.99]. ONEST analyses demonstrated higher agreement for HEH at the prespecified cut-off (OPA 93% vs. 60%) and earlier stabilization of agreement curves, whereas AUH remained sensitive to panel size throughout the seven-observer range. Diagnostic accuracy and reproducibility were not fully aligned for the HEH protocol: Youden's J favored cut-off ≥ 1, whereas reproducibility was highest at ≥ 2.
Conclusion:
PLA2R IHC provides clinically useful diagnostic information for PLA2R-associated MN, but performance and reproducibility are protocol-dependent and were optimized at different cut-offs. Laboratories should therefore validate both dimensions locally rather than adopting a single fixed cut-off. We propose a stepwise framework combining Youden's J and ONEST as a practical guide for laboratories implementing PLA2R IHC.
Insights
PLA2R immunohistochemistry (IHC) is crucial for diagnosing PLA2R-associated membranous nephropathy (MN). Validation of IHC protocols and cut-offs is essential for accurate and reproducible results in clinical laboratories.
Area of Science:
- Nephrology
- Immunohistochemistry
- Diagnostic Pathology
Background:
- Phospholipase A2 receptor (PLA2R) immunohistochemistry (IHC) and serum anti-PLA2R antibodies are vital for diagnosing PLA2R-associated membranous nephropathy (MN).
- The diagnostic performance and inter-observer reproducibility of PLA2R IHC are not sufficiently validated across diverse laboratory protocols and scoring cut-offs.
- Methodological considerations, including the interplay between cut-off selection, diagnostic accuracy, and observer reproducibility, require local validation.
Purpose of the Study:
- To locally validate two routine PLA2R IHC protocols for diagnosing PLA2R-associated MN.
- To assess the impact of different cut-offs on diagnostic accuracy and inter-observer reproducibility.
- To provide a framework for laboratories implementing PLA2R IHC.
Main Methods:
- A multi-laboratory study involving kidney biopsies from patients with primary MN, secondary MN, and non-MN controls.
- Two routine PLA2R IHC protocols (Aarhus University Hospital [AUH] and Herlev Hospital [HEH]) were used.
- Seven blinded observers scored staining intensity (0-3 scale), with diagnostic performance assessed at a prespecified cut-off (≥2) and optimal cut-offs determined by Youden's J index. Inter-observer agreement was quantified using ICC and the ONEST framework.
Main Results:
- Diagnostic accuracy varied by protocol and cut-off: sensitivity/specificity ranged from 55%/100% to 70%/70% at the prespecified cut-off, and 65%/93% to 65%/100% at optimal cut-offs.
- Inter-observer agreement was good-to-excellent overall (ICC=0.85), with higher reliability for the HEH protocol (ICC=0.93) compared to AUH (ICC=0.78).
- Reproducibility varied between protocols and cut-offs; HEH showed higher agreement (OPA 93%) at the prespecified cut-off, but diagnostic accuracy and reproducibility were not aligned at optimal cut-offs.
Conclusions:
- PLA2R IHC is clinically useful for diagnosing PLA2R-associated MN, but its performance and reproducibility are protocol-dependent and optimized at different cut-offs.
- Laboratories must locally validate both diagnostic accuracy and reproducibility dimensions of PLA2R IHC, rather than relying on a single fixed cut-off.
- A stepwise framework combining Youden's J and ONEST is proposed to guide laboratories in implementing PLA2R IHC.

