AABB validation study of the CDC's National Healthcare Safety Network Hemovigilance Module adverse events definitions...

Area of Science:

• Healthcare quality and safety
• Public health surveillance
• Medical informatics

Background:

• Hemovigilance systems rely on consistent application of definitions for accurate adverse event reporting.
• Training on definitions is crucial, especially for systems without expert review.
• The study evaluated the impact of training on the National Healthcare Safety Network Hemovigilance Module (HVM) definitions.

Purpose of the Study:

• To assess if training on CDC's National Healthcare Safety Network Hemovigilance Module (HVM) definitions improves coding of adverse reactions.
• To determine the consistency of adverse event coding among healthcare facilities with and without specific training.

Main Methods:

• Eleven facilities with HVM data submission and eleven without reviewed 36 hypothetical adverse reaction cases.
• Respondents applied January 2013 HVM definitions to categorize events (type, definition match, severity, imputability).
• Concordance with expert analysis was compared between trained and untrained groups.

Main Results:

• No significant difference in agreement with expert assessment was found between trained and untrained groups across diagnostic categories.
• Response accuracy varied by categorization type: adverse event type (72.1%), definition match (76.5%), severity (69.6%), and imputability (64.4%).
• Accuracy also varied depending on the specific type of adverse event.

Conclusions:

• Considerable variability in applying surveillance definitions was observed, irrespective of training.
• Available training did not reduce the inconsistency in coding adverse reactions.
• Inconsistent application of hemovigilance definitions may compromise the utility of comparative safety reports.