Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Robbers Cave

Robbers Cave

During the 1950s, the landmark Robbers Cave experiment demonstrated that when groups must compete with one another, intergroup conflict, hostility, and even violence may result. At the Oklahoman summer camp, two troops of boys—termed the Rattlers and the Eagles—took part in a week-long tournament. During this time, their negativity culminated in derogatory name-calling, fistfights, and even vandalism and destruction of property. However, this work also revealed that such tension...

Stereotype Content Model

Stereotype Content Model

The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...

Self-Report Tests of Personality

Self-Report Tests of Personality

Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...

Naturalistic Observations

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same authorSame journal

Impact of Faculty Mentor Development Intervention on Mentees' Subjective Career Success.

The chronicle of mentoring & coaching·2026

Same authorSame journal

Impact of Mentors on Overall Faculty Experience and Reason for Leaving.

The chronicle of mentoring & coaching·2026

Same authorSame journal

Effectiveness of a Structured Curriculum-Based Developmental Network Intervention.

The chronicle of mentoring & coaching·2026

Same authorSame journal

Cross-Cultural Communication in Mentoring: Impact on Individual Growth.

The chronicle of mentoring & coaching·2026

Same author

Machine learning for predicting climate change impacts on <i>Pseudopithomyces chartarum</i> spore counts: a risk indicator of facial eczema.

New Zealand veterinary journal·2025

Same author

Cardiac dysfunction in transfusion-dependent β-thalassaemia: Insights into apolipoprotein E genotypes and iron metrics in a north Indian cohort.

British journal of haematology·2025

Search research articles

Related Experiment Video

Updated: Jul 6, 2025

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice

Published on: October 19, 2019

Inter-Rater Reliability of the Mentor Behavioral Interaction Rubric.

B Tigges¹, O Myers¹, N Mickel¹

¹University of New Mexico Health Sciences Center, University of Oklahoma Health Sciences Center, University of New Mexico, Arizona State University.

The Chronicle of Mentoring & Coaching

|January 8, 2024

Summary

The Mentor Behavioral Interaction (MBI) Rubric shows good to excellent inter-rater reliability for assessing mentor skills in academic settings. This observational tool can evaluate mentor training effectiveness through video analysis of interactions.

More Related Videos

The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs

The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs

Published on: October 13, 2017

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Related Experiment Videos

Last Updated: Jul 6, 2025

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice

Published on: October 19, 2019

The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs

The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs

Published on: October 13, 2017

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Area of Science:

Medical Education
Psychology
Social Sciences

Background:

Objective assessment of mentor behavioral skills is crucial for evaluating mentor training interventions in academic settings.
The Mentor Behavioral Interaction (MBI) Rubric is a novel, content-valid observational measure for mentor behavioral skills during single mentor-mentee interactions.

Purpose of the Study:

To assess the inter-rater reliability (IRR) of the MBI Rubric when applied to video-recorded mentor-mentee interactions.

Main Methods:

Three expert raters synchronously assessed 26 video-recorded mentor-mentee interactions using the MBI Rubric.
The MBI Rubric comprises six scaled items (Part 1) and ten yes/no items (Part 2).
Raters resolved disagreements through consensus or majority vote after initial individual scoring.

Main Results:

Inter-rater reliability ranged from good (Part 1 IRR=0.67) to excellent (Part 2 IRR=0.83).
Rater effects were observed in initial scoring (Part 1), but not in Part 2.
Raters' final scores were higher than their initial individual scores for both parts.

Conclusions:

The MBI Rubric demonstrates content validity and inter-rater reliability for assessing mentor behavioral skills in single interactions.
It can be utilized alongside other instruments to measure mentor training efficacy.
Limitations include potential ceiling effects and resource-intensive administration; future research will explore responsiveness and construct validity.