Related Experiment Video
Updated: Jan 5, 2026
10:39
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
969
The Development of an Instrument for Faculty to Assess Resident-Led Large Group Teaching
Ariel S Frey-Vogel1, Kristina Dzara1, Kimberly A Gifford2
1Department of Pediatrics, MassGeneral Hospital for Children (AS Frey-Vogel and K Dzara), Boston, Mass; Harvard Medical School (AS Frey-Vogel and K Dzara), Boston, Mass.
Academic Pediatrics
|October 21, 2019
Summary
A new instrument was developed to assess pediatric resident teaching in large groups. While showing good internal consistency, further refinement is needed to improve reliability among raters.
Area of Science:
- Medical Education
- Graduate Medical Training
- Pediatric Residency Programs
Background:
- Accreditation bodies mandate resident teaching, necessitating competency assessment.
- Existing tools lack validity evidence for assessing large-group resident teaching.
- No standardized instrument exists for evaluating faculty assessment of resident-led large group teaching.
Purpose of the Study:
- To develop and gather preliminary validity evidence for an instrument assessing pediatric resident-led large group teaching.
- To address the gap in assessment tools for resident teaching competency in large group settings.
Main Methods:
- Instrument development informed by literature review, resident focus groups, and expert Delphi panels.
- Pilot testing involved 3 investigators assessing video recordings of resident teaching sessions.
- Statistical analysis included Cronbach's alpha for internal consistency and intraclass correlation (ICC) for inter-rater reliability.
Main Results:
- The developed instrument comprises 6 elements with behavioral subelements.
- Pilot data indicated good internal consistency (Cronbach's alpha = .844).
- Inter-rater reliability varied, with excellent to poor scores across subelements.
Conclusions:
- An instrument for assessing pediatric resident-led large group teaching was successfully developed.
- Preliminary findings suggest good internal consistency but highlight the need for improved inter-rater reliability.
- Further development is recommended to enhance the instrument's utility in assessing resident teaching competency.
Related Concept Videos
01:20Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
2.4K
Evaluation of the teaching process enables the nurse to determine if the patient's learning needs were met and if training was effective. If the expected outcomes are not met, the care plan is revised, and additional education or reinforcement is provided. Nurses can ask questions after the session or obtain feedback to assess the patient's understanding of the topic.
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
2.4K
01:24Nursing Process for Patient and Caregiver Teaching II: Planning and Implementation
1.9K
Planning for learning involves the development of a teaching plan. Teaching plans are similar to nursing care plans—both follow the steps of the nursing process. Planning in the teaching process involves setting goals and outcomes. Here, goals identify what a patient needs to achieve to understand a healthcare topic better, whereas the outcomes are the action to be performed by the patient to achieve the goal within a timeframe. For example, if the goal is to educate the patient about...
1.9K
01:24Nursing Process for Patient and Caregiver Teaching I: Assessment and Diagnosis
2.3K
The nursing process provides a clinical decision-making framework for patients and families to establish and implement a personalized care plan. Since part of the nurse's duties is to teach patients, the steps of the nursing process are the most effective way to approach instruction. The nursing process and the teaching-learning process are inextricably linked.
It is critical to determine the patient's learning needs during the assessment. Determination of learning needs compounds data...
It is critical to determine the patient's learning needs during the assessment. Determination of learning needs compounds data...
2.3K
01:29Assessment of Ventilation II: Respiratory Depth and Rhythm
2.3K
Respiratory Depth
Respiratory depth measures the volume of air inhaled or exhaled during a breath. It can vary from shallow to deep and typically remains consistent when a person is at rest or asleep. Occasionally, individuals will automatically inhale deeply, known as sighing, which inflates the lungs with more air than normal breathing.
To assess respiratory depth, observe the degree of chest excursion or movement:
Respiratory depth measures the volume of air inhaled or exhaled during a breath. It can vary from shallow to deep and typically remains consistent when a person is at rest or asleep. Occasionally, individuals will automatically inhale deeply, known as sighing, which inflates the lungs with more air than normal breathing.
To assess respiratory depth, observe the degree of chest excursion or movement:
2.3K
01:23Assessment of Respiration
1.8K
The respiratory system's basic structures and primary functions lay the foundation for nurses' comprehensive respiratory assessments. This assessment includes subjective and objective data to gauge the patient's respiratory health.
Subjective Assessment: Nurses interview the patient to gather information directly during the subjective assessment. It includes questions about the individual's medical history, medications, and symptoms, focusing on past respiratory conditions like...
Subjective Assessment: Nurses interview the patient to gather information directly during the subjective assessment. It includes questions about the individual's medical history, medications, and symptoms, focusing on past respiratory conditions like...
1.8K
01:15Nursing Evaluation
4.1K
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
4.1K