Related Experiment Video
Updated: Aug 9, 2026

Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
Reliability, decision rules, and the value of repeated tests
Abstract:
While unreliable medical tests often must be repeated, the value of such repetitions may be elusive. This paper attempts to clarify some influences upon the diagnostic usefulness of repeated tests. Reliability is a complex factor whose effect varies with patient heterogeneity and with the decision rule used to resolve conflicts in test results. Two informal rules and one formal statistical method are examined in this paper. In all of these cases, differences in reliability which depend on the disease status of the patient appear to be critical. These differences may alter the value of tests and provide important information that can help us to distinguish between persons with and without a disease. Illustrations of this phenomenon are provided from published data on the hemoccult test in silent colon cancer and the platelet monoamine oxidase test in chronic schizophrenia. These findings may provide heuristics to refine clinical intuition about the value of repeated tests. They also clarify the need to estimate test reliabilities for both disease and nondisease groups.
Related Concept Videos
Reliability and Validity
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Errors In Hypothesis Tests
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Detection of Gross Error: The Q Test

