Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

14.4K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.4K
Factorial Design02:01

Factorial Design

15.4K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
15.4K
Response Surface Methodology01:16

Response Surface Methodology

813
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
813
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

561
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
561
Theory of Attribution I: Correspondent Inference Theory01:15

Theory of Attribution I: Correspondent Inference Theory

854
Correspondent inference theory, proposed by Jones and Davis in 1965, seeks to explain how individuals infer stable personality traits from observed behaviors. It suggests that people attribute actions to underlying dispositions rather than external circumstances, particularly when the behavior appears intentional and socially significant.Voluntary Behavior and Dispositional AttributionAccording to this theory, individuals are more likely to attribute behavior to personal traits when it appears...
854
Theory of Attribution II: Kelley's Covariation Theory01:29

Theory of Attribution II: Kelley's Covariation Theory

887
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus:...
887

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

HIV-Risk Behavior Among Adults with Opioid Use Disorder During 12 Months Following Pre-trial Detention: Results from a Randomized Trial of Methadone Treatment.

AIDS and behavior·2020
Same author

Methadone treatment of arrestees: A randomized clinical trial.

Drug and alcohol dependence·2019
Same author

Identifying substance misuse in primary care: TAPS Tool compared to the WHO ASSIST.

Journal of substance abuse treatment·2017
Same author

Corrigendum to "A randomized trial of intensive outpatient (IOP) vs. standard outpatient (OP) buprenorphine treatment for African Americans" [Drug Alcohol Depend. 128 (2013) 222-229].

Drug and alcohol dependence·2016
Same author

A Comparison Of The Adjective Check List, Bem Sex Role Inventory, And Personal Attributes Questionnaire Masculinity And Femininity Subscales.

Multivariate behavioral research·2016
Same author

A Multidimensional Scaling Analysis Of Sex Guilt.

Multivariate behavioral research·2016

Related Experiment Video

Updated: Mar 26, 2026

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K

Rater Reliability: A Maximum Likelihood Confirmatory Factor-Analytic Approach.

K E O'Grady, D R Medoff

    Multivariate Behavioral Research
    |February 2, 2016
    PubMed
    Summary

    This study introduces a new procedure for evaluating rater reliability models using factor analysis. The method offers a robust alternative to traditional intraclass correlation for assessing rating consistency.

    Area of Science:

    • Psychometrics
    • Statistical Modeling

    Background:

    • Assessing rater reliability is crucial for data quality in various fields.
    • Existing methods like intraclass correlation have limitations in complex rating scenarios.

    Purpose of the Study:

    • To present a novel procedure for evaluating diverse rater reliability models.
    • To offer a flexible framework for analyzing rating data.

    Main Methods:

    • Utilized a multivariate linear model to describe and assess ratings.
    • Reexpressed model parameters using a factor-analytic model.
    • Employed maximum likelihood methods for parameter estimation and testing.

    Main Results:

    • The factor-analytic approach provides a comprehensive evaluation of rater reliability.

    More Related Videos

    Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
    08:27

    Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

    Published on: September 27, 2019

    7.3K
    Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
    10:39

    Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

    Published on: August 29, 2025

    1.3K

    Related Experiment Videos

    Last Updated: Mar 26, 2026

    Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
    09:00

    Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

    Published on: August 16, 2024

    1.3K
    Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
    08:27

    Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

    Published on: September 27, 2019

    7.3K
    Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
    10:39

    Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

    Published on: August 29, 2025

    1.3K
  • Demonstrated the procedure's application through two contrasting examples.
  • Highlighted the method's advantages over the intraclass correlation coefficient.

    • Conclusions:

    • The proposed procedure offers a powerful and adaptable method for rater reliability assessment.
    • The factor-analytic framework can be extended to more complex rating situations.