Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Evaluating judge performance in sport.

Marilyn A Looney1

  • 1Department of Kinesiology and Physical Education, Northern Illinois University, DeKalb, IL 60115, USA. MLooney@niu.edu

Journal of Applied Measurement
|February 6, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Interpreting linked psychomotor performance scores.

Research quarterly for exercise and sport·2013
Same author

Expediting the institutional review board process for exercise protocols.

Research quarterly for exercise and sport·2011
Same author

Walkway length determination for steady state walking in young and older adults.

Research quarterly for exercise and sport·2008
Same author

Aerobic exercise equipment preferences among older adults: a preliminary investigation.

Journal of applied measurement·2003
Same journal

Development of a Short Form of the CPAI-A (Form B) with Rasch Analyses.

Journal of applied measurement·2021
Same journal

Evaluating the Impact of Multidimensionality on Type I and Type II Error Rates using the Q-Index Item Fit Statistic for the Rasch Model.

Journal of applied measurement·2021
Same journal

Diabetes Distress in Emerging Adults: Refining the Problem Areas in Diabetes-Emerging Adult Version using Rasch Analysis.

Journal of applied measurement·2021
Same journal

A Psychometric Replication of Fan (1998) Item Response Theory and Classical Test Theory: An Empirical Comparison of their Item/Person Statistics.

Journal of applied measurement·2021
Same journal

The Development of the Mental Toughness Situational Judgment Test: A Novel Approach to Assessing Mental Toughness.

Journal of applied measurement·2021
Same journal

Using the Rasch Model to Measure Comprehension of Fraction Addition.

Journal of applied measurement·2021
See all related articles

Rasch analysis offers detailed feedback on judge scoring patterns in sports like figure skating. This method helps identify inconsistencies and potential biases, improving judge performance and competition fairness.

Area of Science:

  • Sports Science
  • Psychometrics
  • Statistical Modeling

Background:

  • Sports competitions often rely on subjective judge scores, necessitating quality control for judge performance.
  • Past judging controversies, notably in figure skating, have increased scrutiny on judge objectivity.
  • Effective feedback mechanisms are crucial for enhancing judge reliability and consistency.

Purpose of the Study:

  • To demonstrate the application of Rasch analysis for providing specific feedback on judges' scoring patterns.
  • To highlight how psychometric modeling can identify judge scoring inconsistencies.
  • To offer a data-driven approach for improving judge performance in sports.

Main Methods:

  • Utilized a four-faceted Rasch rating scale model to analyze judges' scores from the 2002 Winter Olympics figure skating competition.

Related Experiment Videos

  • Applied fit statistics, ordering of elements, and separation indices to assess model fit to the data.
  • Examined individual judge scoring patterns, including deviations from expected scores.

    • Main Results:

    • The Rasch model demonstrated a good fit to the judges' scoring data.
    • Analysis revealed scoring patterns that could indicate nationalistic bias or influence from skater order.
    • Specific feedback was generated for an unpredictable judge, showing 10% of marks were unexpected by the model.

    Conclusions:

    • Many-facet Rasch analysis provides an effective tool for monitoring judges' internal consistency.
    • Sport governing bodies can use this method to improve judge performance and ensure fairer competition.
    • Objective, data-driven feedback is essential for maintaining the integrity of judged sports.