When It Comes to Benchmarks, Humans Are the Only Way

Adam Rodman1,2, Laura Zwaan3, Andrew Olson4,5

  • 1Department of Medicine, Beth Israel Deaconess Medical Center, Boston.

NEJM AI
|October 26, 2026
PubMed

Related Concept Videos

Measures of Intelligence01:29

Measures of Intelligence

Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Toxicity Testing in Animals01:23

Toxicity Testing in Animals

Toxicity tests in animals are grounded on two main assumptions: first, the effects observed in laboratory animals can be extrapolated to humans, especially when adjusted for body surface area; second, high-dose exposure in animals is essential to identify potential human hazards from lower doses. This is based on the quantal dose-response concept, which faces the challenge of extrapolating results from relatively few test animals to much larger human populations. For example, a 0.01% incidence...
Mouse Models of Cancer Study02:43

Mouse Models of Cancer Study

Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
Regression Toward the Mean01:52

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...
Blind Procedures02:07

Blind Procedures

Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
Case Studies01:22

Case Studies

There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.