Related Experiment Video
Updated: Jan 24, 2026
07:39
How to Obtain Reliable Visual Event-related Potentials in Newborns
Published on: October 24, 2019
6.8K
Reliability of Judging in DanceSport
Jerneja Premelč1, Goran Vučković1, Nic James2
1Faculty of Sport, University of Ljubljana, Ljubljana, Slovenia.
Frontiers in Psychology
|May 29, 2019
Summary
This study found low agreement among judges using a new DanceSport judging system, indicating potential issues with its validity and consistency. Further research is needed to improve the system's objectivity.
Area of Science:
- Sports Science
- Dance Research
- Performance Analytics
Background:
- DanceSport competitions rely on subjective judging.
- Assessing the reliability and validity of judging systems is crucial for fair competition.
- Previous research on DanceSport judging objectivity is limited.
Purpose of the Study:
- To evaluate the reliability and validity of a new judging system in DanceSport.
- To determine the level of agreement and consistency among judges.
- To identify potential areas for improvement in DanceSport judging.
Main Methods:
- Eighteen judges evaluated 12 elite adult couples in an international competition.
- Judges used a 10-level scale for all judging criteria.
- Calculated absolute agreement and consistency using Kendall's coefficient of concordance and Intraclass Correlation Coefficient (ICC).
Main Results:
- Low agreement was observed in overall judging marks (Kendall's W = 0.58).
- Artistic criteria showed slightly lower agreement than technical criteria.
- Intraclass Correlation Coefficient (ICC) for absolute agreement was moderate (ICC(2,3) = 0.62), while consistency was higher (ICC(3,3) = 0.80).
Conclusions:
- Significant differences in judges' scores suggest disagreement on quality or inconsistent scale use.
- The standard error of measurement (SEM) often exceeded score differences, questioning the system's validity.
- This study highlights the need for improvements in DanceSport judging objectivity and validity.
Related Concept Videos
01:29Reliability and Validity
13.8K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.8K
01:25Distribution Reliability and Automation
500
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
500
02:16Self-Schemas
35.4K
In general, a schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
35.4K
02:46Uncertainty in Measurement: Reading Instruments
50.9K
Counting is the type of measurement that is free from uncertainty, provided the number of objects being counted does not change during the process. Such measurements result in exact numbers. By counting the eggs in a carton, for instance, one can determine exactly how many eggs are there in the carton. Similarly, the numbers of defined quantities are also exact. For example, 1 foot is exactly 12 inches, 1 inch is exactly 2.54 centimeters, and 1 gram is exactly 0.001 kilograms. Quantities...
50.9K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.8K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.8K
02:13The Representativeness Heuristic
16.7K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
16.7K