Related Experiment Video
Updated: Feb 1, 2026
07:00
Electrically Evoked Stapedius Reflex Measurements in Cochlear Implantation and Its Application in the Postoperative Fitting Process
Published on: June 21, 2024
1.5K
What matched comparisons can and cannot tell us: the case of cochlear implants
Elad Sagi1, Matthew B Fitzgerald, Mario A Svirsky
1Department of Otolaryngology, New York University School of Medicine, New York, NY, USA.
Ear and Hearing
|July 5, 2007
Summary
The outcome-matching method in cochlear implant studies can lead to misinterpretations. Matching subjects on one speech perception measure significantly alters results when comparing another, regardless of true group performance.
Area of Science:
- Audiology
- Biostatistics
- Medical device research
Background:
- The outcome-matching method is increasingly used in cochlear implant research.
- This method involves matching subjects on variables related to the primary outcome, potentially introducing bias.
- Misinterpretations can arise from how this design is applied and analyzed.
Purpose of the Study:
- To critically evaluate the outcome-matching method used in cochlear implant literature.
- To identify potential misinterpretations and limitations of this study design.
- To assess the impact of outcome-matching on perceived device efficacy.
Main Methods:
- A simulation study using pseudo-randomized speech perception data (quiet and noise) was conducted.
- The outcome-matching method was applied by matching on quiet scores then comparing noise, and vice versa, repeated 10,000 times.
- A questionnaire assessed student opinions on cochlear implant devices before and after exposure to a study using the outcome-matching method.
Main Results:
- The choice of outcome measure for matching significantly determined the comparison results.
- Simulations showed identical comparative outcomes regardless of the underlying true group performance.
- Student opinions on cochlear implant devices changed significantly after reading a study employing this method, despite unwarranted data.
Conclusions:
- The outcome-matching method is unsuitable for determining the superiority of devices or interventions.
- While it may reveal within-group differences, it can lead to erroneous conclusions about comparative effectiveness.
- Caution is essential when interpreting studies utilizing the outcome-matching method in audiology.
Related Concept Videos
01:17Sign Test for Matched Pairs
411
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
411
02:57The Sense of Self: Reflected Self-Appraisal and Social Comparison
56.1K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
56.1K
01:09Wilcoxon Signed-Ranks Test for Matched Pairs
495
The Wilcoxon signed-rank test for matched pairs evaluates the null hypothesis by combining the ranks of differences with their signs. It essentially tests whether the median of the differences in a population of matched pairs is zero. Since the test incorporates more information than the sign test, it generally yields more trustable conclusions. This test also does not require the data to follow a normal distribution, but two conditions must be met for it to be applicable: (1) the data must...
495
01:13Multiple Comparison Tests
4.5K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.5K
02:54Evolutionary Relationships through Genome Comparisons
7.0K
Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...
7.0K
01:24Comparison Between Electrical And Gravitational Forces
4.1K
There are four fundamental forces in nature: the gravitational force, the electromagnetic force, the strong nuclear force, and the weak nuclear force. To compare the numerical strengths of the first two, take two particles of the same kind. Since electrons are fundamental particles, they are a good example.
Since both are inverse square law forces, the distance gets canceled when the ratio of the two forces is considered. Instead, the ratio of the electrical and gravitational forces depends on...
Since both are inverse square law forces, the distance gets canceled when the ratio of the two forces is considered. Instead, the ratio of the electrical and gravitational forces depends on...
4.1K