Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Bias in consensus scoring, with examples from ability emotional intelligence tests.

Kimberly A Barchard1, James A Russell

  • 1University of Nevada, Las Vegas, NV 89154, USA. barchard@unl.nevada.edu

Psicothema
|February 14, 2007
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Correction: Plasma apolipoprotein A-I is a causal protective factor in sepsis.

Scientific reports·2026
Same author

Association between COVID-19 vaccination, SARS-CoV-2 variants, and post COVID-19 condition: A cross-sectional study.

PloS one·2025
Same author

Brain Death/Death by Neurologic Criteria Guidance on Communication, Objections, Pregnancy, and Public Trust: An AAN Position Statement.

Neurology·2025
Same author

Plasma apolipoprotein A-I is a causal protective factor in sepsis.

Scientific reports·2025
Same author

Divergent biological pathways distinguish community-acquired pneumonia from COVID-19 despite similar plasma cytokine profiles.

Respiratory research·2025
Same author

Obesity- and Lipid-Related Traits May Causally Contribute to Sepsis-Associated Acute Kidney Injury.

Critical care medicine·2025
Same journal

Personal Recovery in Addictions: Development of a new Assessment Instrument.

Psicothema·2026
Same journal

Internet Habits, Problematic Internet Use, and Online Risk Practices Among Adolescents With ADHD in Spain.

Psicothema·2026
Same journal

Relationship Between Social Connectedness and Quality of Life in Older Adults: An Examination of Sex Differences.

Psicothema·2026
Same journal

The Influence of Gender on Measuring Mental Health Stigma. A Cross-Sectional Vignette Study With the Attribution Questionnaire 9.

Psicothema·2026
Same journal

Comprehensive Assessment of Mental Health Stigma.

Psicothema·2026
Same journal

Psychometric Properties of the Teachers' Responses to Bullying Questionnaire (TRBQ) in Spanish Students.

Psicothema·2026
See all related articles

Mode consensus scoring unfairly impacts smaller groups in ability tests. Proportion consensus scoring is preferred as it minimizes bias, making it a more equitable method for test development.

Area of Science:

  • Psychometrics
  • Psychological Assessment

Background:

  • Consensus scoring uses norm group responses to create test keys.
  • It's valuable when expert consensus on answers is lacking, such as in emotion perception.
  • Mode and proportion consensus scoring are common variations.

Purpose of the Study:

  • To evaluate the psychometric properties of mode and proportion consensus scoring.
  • To identify potential biases in these consensus scoring methods.

Main Methods:

  • Analysis of mode consensus scoring for sub-group bias.
  • Analysis of proportion consensus scoring for sub-group bias.
  • Comparison of scoring methods under varying group conditions.

Main Results:

Related Experiment Videos

  • Mode consensus scoring exhibits bias against smaller sub-groups when modal responses differ.
  • Proportion consensus scoring is generally unbiased, with bias only in extreme cases.
  • No current scoring method completely eliminates bias.

    • Conclusions:

    • Mode consensus scoring is biased due to norm group size influencing scores.
    • Proportion consensus scoring is the preferred method due to its reduced bias.
    • Further research may be needed to eliminate all bias in consensus scoring.