Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.9K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.9K
pH Scale02:41

pH Scale

79.5K
Hydronium and hydroxide ions are present both in pure water and in all aqueous solutions, and their concentrations are inversely proportional as determined by the ion product of water (Kw). The concentrations of these ions in a solution are often critical determinants of the solution’s properties and the chemical behaviors of its other solutes. Two different solutions can differ in their hydronium or hydroxide ion concentrations by a million, billion, or even trillion times. A common means of...
79.5K
Self Within Cultural Contexts01:30

Self Within Cultural Contexts

229
Cultural frameworks for understanding the self are often categorized into two broad orientations: individualism and collectivism. These paradigms influence how people define themselves, relate to others, and interpret their social worlds. Each orientation offers distinct perspectives on autonomy, responsibility, and the role of the individual within a community.Individualistic CulturesIn individualistic cultures like North America and Western Europe, identity is understood as autonomous and...
229
Impact of Social Context on Individuals01:21

Impact of Social Context on Individuals

298
Social psychology examines how the real or imagined presence of others influences individuals' thoughts, feelings, and behaviors. A key concept in this field is the role of social context in shaping behavior. The same individual may act differently depending on the social setting, due to the varying expectations and norms associated with each environment. This context-dependent behavior illustrates the influence of social roles, which prescribe appropriate conduct in specific situations.Social...
298
Distribution Reliability and Automation01:25

Distribution Reliability and Automation

506
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
506
Scaling01:26

Scaling

593
In designing and analyzing filters, resonant circuits, or circuit analysis at large, working with standard element values like 1 ohm, 1 henry, or 1 farad can be convenient before scaling these values to more realistic figures. This approach is widely utilized by not employing realistic element values in numerous examples and problems; it simplifies mastering circuit analysis through convenient component values. The complexity of calculations is thereby reduced, with the understanding that...
593

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Self-Objectification, Body Surveillance, and Body Shame Across Countries: A Comparison Between US, UK, Belgian, Israeli, and Thai Women.

Psychologica Belgica·2026
Same author

Everything, altogether, all at once: Addressing data challenges when measuring speech intelligibility through entropy scores.

Behavior research methods·2024
Same author

Glucose metabolism and radiodensity of abdominal adipose tissue: A 5-year longitudinal study in a large PET cohort.

Clinical endocrinology·2024
Same author

Alterations in type 2 dopamine receptors across neuropsychiatric conditions: A large-scale PET cohort.

NeuroImage. Clinical·2024
Same author

The First-year Integration Test: a validation study.

Frontiers in psychology·2023
Same author

Understanding transitions in exploration profiles of students opting for higher education.

Frontiers in psychology·2023

Related Experiment Video

Updated: Jan 28, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

3.0K

Scale Separation Reliability: What Does It Mean in the Context of Comparative Judgment?

San Verhavert1, Sven De Maeyer1, Vincent Donche1

  • 1University of Antwerp, Belgium.

Applied Psychological Measurement
|February 22, 2019
PubMed
Summary

The Scale Separation Reliability (SSR) effectively measures split-half reliability and interrater correlation in comparative judgment (CJ) assessments. However, its interpretation as a correlation with the truth requires further investigation.

Keywords:
IRTRasch measurementScale Separation Reliability (SSR)comparative judgment (CJ)reliability theory

More Related Videos

Assessment of Mouse Judgment Bias through an Olfactory Digging Task
12:10

Assessment of Mouse Judgment Bias through an Olfactory Digging Task

Published on: March 4, 2022

3.1K
Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments
13:00

Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments

Published on: January 23, 2017

10.3K

Related Experiment Videos

Last Updated: Jan 28, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

3.0K
Assessment of Mouse Judgment Bias through an Olfactory Digging Task
12:10

Assessment of Mouse Judgment Bias through an Olfactory Digging Task

Published on: March 4, 2022

3.1K
Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments
13:00

Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments

Published on: January 23, 2017

10.3K

Area of Science:

  • Educational Measurement
  • Psychometrics
  • Competence Assessment

Background:

  • Comparative Judgment (CJ) offers an alternative to traditional competence assessment methods.
  • The Bradly-Terry-Luce model analyzes CJ data, yielding logit estimates for student work.
  • Scale Separation Reliability (SSR), derived from Rasch modeling, is commonly used for reliability in CJ, but its applicability is debated.

Purpose of the Study:

  • To systematically investigate the transferability of the meaning of Scale Separation Reliability (SSR) from Rasch modeling to Comparative Judgment (CJ).
  • To determine if SSR can serve as a reliable indicator of assessment quality in CJ contexts.
  • To explore the interpretation of SSR in relation to split-half reliability and interrater correlation within CJ.

Main Methods:

  • A meta-analysis was conducted on 26 independent Comparative Judgment (CJ) assessments.
  • Split-half reliability was assessed by dividing each assessment based on assessors.
  • Rank orders were correlated, and Bland-Altman plots were used to compare split-half correlations with SSR values.

Main Results:

  • The study found that SSR is a good measure for split-half reliability in CJ assessments.
  • SSR was also shown to be interpretable as an interrater correlation when comparing SSR of a half-assessment to the correlation between its two respective halves.
  • The interpretation of SSR as a correlation with the 'truth' yielded mixed results, indicating areas for further research.

Conclusions:

  • Scale Separation Reliability (SSR) demonstrates strong validity as a measure of split-half reliability and interrater correlation in Comparative Judgment (CJ).
  • The findings support the use of SSR in CJ for evaluating assessment consistency and quality.
  • Further research is needed to clarify the extent to which SSR reflects a 'true' measure of competence in CJ.