Related Experiment Video
Updated: Mar 23, 2026
10:39
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
1.3K
Reliability assessment of a peer evaluation instrument in a team-based learning course
Joy Wahawisan1, Miguel Salazar2, Robin Walters3
1Rangel College of Pharmacy, Texas A&M Health Science Center. Kingsville, TX; & Clinical Pharmacist, Physicians Health Plan, Sparrow Health Systems. Lansing, MI ( United States ). joy.wahawisan@phpmm.org.
Pharmacy Practice
|March 25, 2016
Summary
This study found that a student peer evaluation instrument is reliable for assessing contributions in team-based learning. The tool demonstrated consistent results and strong agreement among raters in a longitudinal setting.
Area of Science:
- Medical Education
- Pharmacy Education
Background:
- Team-based learning (TBL) is a pedagogical approach increasingly used in health professions education.
- Effective peer evaluation is crucial for TBL success, but its reliability can be a concern.
- Developing and validating reliable assessment tools is essential for educational programs.
Purpose of the Study:
- To assess the reliability of a peer evaluation instrument.
- To determine the instrument's effectiveness in a longitudinal team-based learning environment.
Main Methods:
- Student pharmacists used a peer evaluation instrument to assess peer contributions.
- Evaluation scores were analyzed for variance (standard deviation) across different performance levels (high, medium, low).
- Intra-class correlation coefficient (ICC) was used to measure inter-rater agreement.
Main Results:
- Minimal variation in standard deviation was observed across score means, indicating precise results from the instrument.
- The intra-class correlation coefficient (ICC) demonstrated strong concordance among student raters.
- These findings suggest the instrument yields consistent and reliable data.
Conclusions:
- The developed student peer evaluation instrument is a reliable tool for peer assessment in team-based learning.
- The instrument's consistency supports its use in longitudinal educational settings.
- Reliable peer assessment can enhance the effectiveness of team-based learning.
Related Concept Videos
01:29Self-Evaluation Maintenance Model
389
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
389
01:29Reliability and Validity
14.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.3K
01:20Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
2.7K
Evaluation of the teaching process enables the nurse to determine if the patient's learning needs were met and if training was effective. If the expected outcomes are not met, the care plan is revised, and additional education or reinforcement is provided. Nurses can ask questions after the session or obtain feedback to assess the patient's understanding of the topic.
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
2.7K
01:37Social Loafing
39.8K
Another way in which a group presence can affect performance is social loafing—the exertion of less effort by a person working together with a group. Social loafing occurs when our individual performance cannot be evaluated separately from the group. Thus, group performance declines on easy tasks (Karau & Williams, 1993). Essentially individual group members loaf and let other group members pick up the slack. Because each individual’s efforts cannot be evaluated,...
39.8K
01:15Nursing Evaluation
4.6K
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
4.6K
01:24Sources of Self-Esteem II: Performance Feedback
210
Self-esteem is intricately tied to our perception of competence and our ability to exert control over our lives. One of the primary sources of this perception is performance feedback — the ongoing evaluation of our actions in terms of success and failure. According to Franks and Marolla (1976), people derive self-worth from experiencing themselves as causal agents, capable of achieving goals and overcoming obstacles. This process nurtures a critical component of self-esteem:...
210