Related Experiment Video
Updated: May 15, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
Reducing the low prevalence effect: Does similarity search translate to binary decisions?
Greer Gillies1, Anna Kosovicheva2,3
1Department of Psychology, University of Toronto, Toronto, Canada. greer.gillies@mail.utoronto.ca.
Abstract:
In visual search, observers often miss rare targets. This low prevalence effect (LPE) is resistant to many cognitive interventions. However, a recent study showed that having participants identify the item that was most similar to the target (similarity search) eliminated the LPE. As real-world searches often require binary decisions (e.g., is there a threat in this bag?) we tested whether the benefits of similarity search generalize to binary decisions and to more naturalistic stimuli. Participants searched for T shapes amongst near-T distractors and the prevalence of true Ts was manipulated. In the similarity-search-only condition, participants clicked on the "most T-like object." In the similarity search & binary decision condition, participants additionally reported whether the chosen item was a true T (yes/no). We found that in some circumstances, similarity search can be used to attenuate the LPE. However, there was an LPE for the binary decision task. Participants were less likely to classify the target as a true T during low prevalence compared with high. We replicated this result in an additional experiment using more naturalistic stimuli. Participants watched clips of road videos and clicked on the "most hazardous location" in the video, followed by a binary decision ("would you need to respond to that hazard? yes/no"). Though participants located the hazards regardless of prevalence, there was an LPE for the binary decision task. Together, these results indicate potential limitations in applying similarity search outside the laboratory; the LPE is still seen in these searches if a binary decision is involved.
Related Concept Videos
Sign Test for Matched Pairs
To conduct the sign test, we first calculate the differences in...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Odds Ratio
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...

