Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Systematic Error: Methodological and Sampling Errors

Systematic Error: Methodological and Sampling Errors

In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...

Self-Evaluation Maintenance Model

Self-Evaluation Maintenance Model

The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...

Causes of Similarity-Dissimilarity Effect

Causes of Similarity-Dissimilarity Effect

The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Sources of Self-Esteem II: Performance Feedback

Sources of Self-Esteem II: Performance Feedback

Self-esteem is intricately tied to our perception of competence and our ability to exert control over our lives. One of the primary sources of this perception is performance feedback — the ongoing evaluation of our actions in terms of success and failure. According to Franks and Marolla (1976), people derive self-worth from experiencing themselves as causal agents, capable of achieving goals and overcoming obstacles. This process nurtures a critical component of self-esteem: self-efficacy,...

Self-Evaluation: Self-Enhancement and Self-Verification

Self-Evaluation: Self-Enhancement and Self-Verification

Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

A Rare Case of Solid Pseudopapillary Pancreatic Tumor Causing Abdominal Pain.

Journal of emergencies, trauma, and shock·2026

Same author

Inferior ST-Segment Elevation Pattern as a Result of a Small Bowel Obstruction: A Case Report.

Archives of academic emergency medicine·2025

Same author

Efficacy and Safety of Pharmacologic Therapies for Nausea and Emesis in the Emergency Department: A Systematic Review and Bayesian Network Meta-analysis.

Annals of emergency medicine·2025

Same author

Emergency Department Observation for Back Pain: Patient Characteristics and Factors Associated with Hospital Admission or 90-day Return Visit.

The Journal of emergency medicine·2025

Same author

Implementation of a Trauma Zone Improves Disposition Times for Patients With Intracerebral Hemorrhage or Hip Fracture.

American journal of medical quality : the official journal of the American College of Medical Quality·2025

Same author

Effectiveness and Safety of Pharmacologic Therapies for Migraine in the Emergency Department: A Systematic Review and Bayesian Network Meta-analysis.

Annals of emergency medicine·2024

Search research articles

Related Experiment Video

Updated: May 28, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Synchronous collection of multisource feedback evaluations does not increase inter-rater reliability.

Gregory Garra¹, Henry Thode

¹Emergency Medicine, Stony Brook University Medical Center, Stony Brook, NY, USA. Gregory.Garra@StonyBrook.edu

Academic Emergency Medicine : Official Journal of the Society for Academic Emergency Medicine

|October 18, 2011

Summary

Synchronous multisource feedback (MSF) collection did not improve reliability in emergency medicine resident evaluations. Asynchronous MSF remains the preferred method for resident assessment due to its consistent results.

More Related Videos

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers

Published on: March 14, 2018

Related Experiment Videos

Last Updated: May 28, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers

Published on: March 14, 2018

Area of Science:

Medical Education
Healthcare Professional Assessment

Background:

Multisource feedback (MSF) is crucial for evaluating resident performance.
Asynchronous MSF, where feedback is given after an event, often suffers from poor inter-rater reliability.
Cognitive biases may contribute to the unreliability of asynchronous MSF.

Purpose of the Study:

To investigate if synchronous MSF collection, tied to specific patient interactions, enhances reliability compared to asynchronous methods.
To assess within- and between-rater group reliability in synchronous versus asynchronous MSF.

Main Methods:

A survey study at a university emergency department involving 30 emergency medicine residents.
Asynchronous MSF using the Emergency Medicine Humanism Scale (EM-HS) was collected via web survey.
Synchronous MSF was collected immediately after patient encounters using the same scale.

Main Results:

Synchronous collection did not yield clinically significant differences in EM-HS scores within rater groups.
Correlations between asynchronous and synchronous feedback were poor for faculty and moderate for nurses.
Inter-rater correlations between faculty and nurses were moderate for both methods.

Conclusions:

Synchronous MSF collection did not improve score reliability or inter-rater agreement in this study.
The findings support the continued use of asynchronous MSF for evaluating emergency medicine residents.