Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Beyond the Spearman-Brown: a structural approach to maximal reliability.

D W Drewes1

  • 1Department of Psychology, College of Education and Psychology, North Carolina State University, Raleigh 27695-7801, USA. drewes@unity.ncsu.edu

Psychological Methods
|August 11, 2000
PubMed
Summary

Classic reliability theory assumed parallel parts, but a new structural equation framework allows unique reliability estimates for each item or rater. This enables maximal reliability assessment for weighted composites, advancing reliability analysis.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A TEST OF INTENTIONAL MIXING OR CLUSTERING IN A BEHAVIOR SEQUENCE.

Psychological reports·1965
See all related articles

Area of Science:

  • Psychometrics
  • Statistical Modeling
  • Reliability Theory

Background:

  • Traditional reliability theory relies on the assumption of parallel parts, limiting its application.
  • Existing methods often treat items, raters, or judges as interchangeable entities.

Purpose of the Study:

  • To recast reliability theory within a structural equation modeling (SEM) framework.
  • To develop a method for determining unique reliability estimates for individual components (items, raters, judges).
  • To assess the maximal reliability of weighted composites and perform inferential tests on composite reliability.

Main Methods:

  • Utilizing a structural equation framework to model reliability.
  • Calculating unique reliability estimates for individual components.

Related Experiment Videos

  • Aggregating unique estimates to determine composite reliability.
  • Generalizing procedures from single-factor to multifactor applications.
  • Main Results:

    • Demonstrated that items, raters, or judges do not need to be treated as equivalent.
    • Established procedures for determining unique reliability estimates for each component.
    • Showcased the assessment of maximal reliability for weighted composites.
    • Extended the methodology to multifactor applications.

    Conclusions:

    • A structural approach offers a more flexible and nuanced method for reliability determination.
    • This framework moves beyond the limitations of the parallel parts assumption.
    • The approach allows for inferential testing of composite reliability.
    • Researchers should consider the implications for the true score hypothesis.