Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Comparing Experimental Results: Student's t-Test

Comparing Experimental Results: Student's t-Test

The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...

Self-Report Tests of Personality

Self-Report Tests of Personality

Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.

Theory of Attribution II: Kelley's Covariation Theory

Theory of Attribution II: Kelley's Covariation Theory

Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus:...

Self-Evaluation Maintenance Model

Self-Evaluation Maintenance Model

The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...

Surveys

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

SIMPLE CONDITIONS FOR GROWTH OF UNICELLULAR BLUE-GREEN ALGAE ON PLATES(1, 2).

Journal of phycology·2016

Same author

Neutral mechanical alignment: Is it Necessary?

The bone & joint journal·2016

Same author

The quality of psychiatric residency : the assessment of programs and options for distributing psychiatric residents in the service of health care reform.

Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry·2014

Same author

Competence in medicine.

Medical teacher·2014

Same author

Upstream migratory behaviour of wild and ranched Atlantic salmon Salmo salar at a natural obstacle in a coastal spate river.

Journal of fish biology·2013

Same author

Distraction osteogenesis of the mandible for airway obstruction in children.

The Laryngoscope·2001

Same journal

Gender, Racial, and Ethnic Representation in Academic Psychiatry Chairs, 2012 to 2022.

Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry·2026

Same journal

ClassPass Memberships to Improve Well-Being Among Psychiatry Residents: A Pilot Randomized Controlled Trial.

Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry·2026

Same journal

Medical Student Reflections on a Prison Psychiatric Experience: A Qualitative Analysis.

Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry·2026

Same journal

Projected Deficiencies in the Child and Adolescent Psychiatrist Workforce in the USA: A Call to Action.

Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry·2026

Same journal

A Survey to Assess Loneliness and Predictive Factors Among Students at a US Medical School.

Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry·2026

Same journal

Recovery-Oriented Education: The Impact of Visiting a Clubhouse on Psychiatry Residents.

Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry·2026

See all related articles

Search research articles

Related Experiment Video

Updated: May 3, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Interrater reliability in evaluating trainee interviewing skills.

B Templeton¹, M M Allen

¹Department of Psychiatry and Human Behavior, Jefferson Medical College, 1015 Walnut Street, 3rd Floor Curtis, Philadelphia, PA, 19107, USA.

Academic Psychiatry : the Journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry

|January 18, 2014

Summary

This summary is machine-generated.

Psychiatric faculty showed low reliability when evaluating physician-trainee interviewing skills using common methods. Modifications to observational systems are recommended to improve rating accuracy and reliability in medical education.

More Related Videos

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

Related Experiment Videos

Last Updated: May 3, 2026

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

Area of Science:

Medical Education
Psychiatry
Clinical Skills Assessment

Background:

Evaluating physician-trainee interviewing skills is crucial in psychiatric training.
Existing assessment methods may lack sufficient reliability for accurate evaluation.

Purpose of the Study:

To assess the reliability of evaluative judgments made by psychiatric faculty on physician-trainee interviewing skills.
To identify potential improvements in observational systems for skill assessment.

Main Methods:

Utilized three distinct evaluation methods: global rating scales, data checklists, and a time-allotment form.
Collected data during training workshops for psychiatric instructors in the U.S. and Canada.

Main Results:

All three methods demonstrated low interrater reliability among evaluators.
Findings were consistent across both U.S. and Canadian faculty participants.

Conclusions:

Current methods for rating trainee interviewing skills exhibit low reliability.
Modifications to observational systems and the adoption of quantitative techniques are suggested to enhance rating accuracy and reliability in psychiatric training.