Initial Steps toward Validating and Measuring the Quality of Computerized Provider Documentation.

Area of Science:

• Health Informatics
• Medical Documentation Quality

Background:

• Concerns regarding the quality of electronic health care documentation persist.
• Previous research primarily focused on physician perceptions of documentation quality.
• This study expands the scope to include nurses and administrative staff.

Purpose of the Study:

• To investigate and compare document quality perceptions among different healthcare roles: practitioners, nurses, and administrative staff.
• To determine if document length or redundancy affects perceived quality.
• To identify intrinsic document properties associated with quality judgments.

Main Methods:

• An instrument based on staff interviews and literature review was used.
• 110 healthcare professionals (practitioners, nurses, administrative staff) participated.
• Participants rated short, long, and original versions of health care records.

Main Results:

• Document length and redundancy did not significantly impact quality ratings.
• Practitioners consistently rated notes less favorably than nurses or administrators on several scales.
• The tf·idf statistic, a measure of text relevance, was strongly associated with practitioner quality ratings.

Conclusions:

• Perceived document quality is not sensitive to changes in document redundancy.
• Healthcare professionals' perceptions of documentation quality differ based on their roles.
• Intrinsic document characteristics, particularly tf·idf for practitioners, are key factors in judging document quality.