Related Experiment Video
Updated: Feb 23, 2026
E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
Interrater reliability of the Patient Education Materials Assessment Tool (PEMAT)
Julia Vishnevetsky1, Chasity Burrows Walters1, Kay See Tan2
1Patient and Caregiver Engagement, Memorial Sloan Kettering Cancer Center, New York, USA.
Objective:
To assess the interrater reliability (IRR) and usability of the Patient Education Materials Assessment Tool (PEMAT) and the relationship between PEMAT scores and readability levels.
Methods:
One hundred ten materials (80 print, 30 audiovisual) were evaluated, each by two raters, using the PEMAT. IRR was calculated using Gwet's AC1 and summarized across items in each PEMAT domain (understandability and actionability) and by material type. A survey was conducted to solicit raters' experience using the PEMAT. Readability of each material was assessed using the SMOG Index.
Results:
The median IRR was 0.92 for understandability and 0.93 for actionability across all relevant items, indicating good IRR. Eight PEMAT items had Gwet's AC1 values less than 0.81. PEMAT and SMOG Index scores were inversely correlated, with a Spearman's rho of -0.20 (p=0.081) for understandability and -0.15 (p=0.194) for actionability. While 92% of raters agreed the PEMAT was easy to use, survey results suggested specific items for clarification.
Conclusion:
While the PEMAT demonstrates moderate to excellent IRR overall, amendments to items with lower IRR may increase the usefulness of the tool.
Practice Implications:
The PEMAT is a useful supplement to reading level alone in the assessment of educational materials.
Related Concept Videos
01:21Methods of Documentation III: PIE
01:26Methods of Documentation II: POMR
01:25Assessment of apical radial pulse
The A-R pulse assessment involves simultaneous evaluation of the apical and radial pulses. When the apical and radial pulse rates vary, this assessment helps identify a pulse deficit.
Pre-Procedural Preparation
01:29Self-Evaluation Maintenance Model
01:24Nursing Process for Patient and Caregiver Teaching I: Assessment and Diagnosis
It is critical to determine the patient's learning needs during the assessment. Determination of learning needs compounds data...
01:20Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...