Related Experiment Video
Updated: May 21, 2026
06:17
A Task for Assessing the Impact of a Partner on the Speed and Accuracy of Motor Performance in Rats
Published on: October 17, 2019
Top performers are not the most impressive when extreme performance indicates unreliability
1Saïd Business School, University of Oxford, Oxford OX1 1HP, United Kingdom. jerker.denrell@sbs.ox.ac.uk
Summary
High performance doesn't always mean high ability due to unpredictable factors. Extreme success may stem from luck, not skill, suggesting caution in imitating top performers.
Area of Science:
- Social Sciences
- Psychology
- Behavioral Economics
Background:
- The link between performance and underlying ability is a key question in social sciences.
- Previous studies indicate that randomness and feedback loops weaken the performance-ability correlation.
- Unpredictability in performance is a known challenge in assessing true capability.
Purpose of the Study:
- To investigate whether extreme performance reliably indicates high ability.
- To determine the influence of luck versus skill in achieving top performance.
- To provide guidance on imitating or praising high performers based on ability assessment.
Main Methods:
- Analysis of performance data incorporating noise and self-reinforcing dynamics.
- Modeling the relationship between ability, luck, and observed performance.
- Statistical examination of extreme performance outcomes in relation to underlying skill.
Main Results:
- The same factors causing performance unpredictability also make extreme results uninformative about ability.
- Highest performers may not possess the greatest expected ability.
- The degree to which performance reflects ability is contingent on the role of luck versus skill.
Conclusions:
- Extreme performance outcomes should be interpreted cautiously regarding underlying ability.
- Imitation and praise of top performers may be misguided if success is luck-driven.
- Understanding the skill-luck balance is crucial for accurate performance evaluation.
Related Concept Videos
01:52Regression Toward the Mean
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...
01:16Unusual Results
Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value = μ + 2σ
Minimum unusual value...
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value = μ + 2σ
Minimum unusual value...
01:30Unrealistic Optimism Bias
Unrealistic optimism bias is the tendency to overestimate the likelihood of positive outcomes. This cognitive bias makes individuals believe they are less likely to experience failures, setbacks, or risks and more likely to succeed than others. For example, people may assume they are less prone to health issues, accidents, or financial struggles than their peers, even when they share similar risk factors.One key component of this bias is the above-average effect, where individuals perceive...
01:08Outliers and Influential Points
An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the vertical...
01:29Theory of Attribution II: Kelley's Covariation Theory
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...
01:12What Are Outliers?
Outliers are observed data points that are far from the least squares line. They have unusual values and need to be examined carefully. Though an outlier may result from erroneous data, at other times, it may hold valuable information about the population under study and should be included in the data. Hence, it is crucial to examine what causes a data point to be an outlier.
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...
The z score is used to find outliers or unusual values. It should be noted that any values beyond -2 and +2 are...