Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Cause and Effect01:53

Cause and Effect

While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
Testing a Claim about Population Proportion01:24

Testing a Claim about Population Proportion

A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Theory of Attribution II: Kelley's Covariation Theory01:29

Theory of Attribution II: Kelley's Covariation Theory

Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...
Uncertainty in Measurement: Accuracy and Precision03:37

Uncertainty in Measurement: Accuracy and Precision

Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
Random and Systematic Errors01:20

Random and Systematic Errors

Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Mating status-dependent "choice" in competitive and noncompetitive arenas.

Behavioral ecology : official journal of the International Society for Behavioral Ecology·2025
Same author

Heroic heirs: evidence for sexy and competitive sons.

Evolution; international journal of organic evolution·2025
Same author

Variability of morphology-performance relationships under acute exposure to different temperatures in 3 strains of zebrafish.

Current zoology·2025
Same author

Environmental dependence of mutational (co)variances of adaptive traits.

Evolution; international journal of organic evolution·2023
Same author

Using inbreeding to test the contribution of non-additive genetic effects to additive genetic variance: a case study in <i>Drosophila serrata</i>.

Proceedings. Biological sciences·2023
Same author

The contribution of mutation and selection to multivariate quantitative genetic variance in an outbred population of <i>Drosophila serrata</i>.

Proceedings of the National Academy of Sciences of the United States of America·2021

Related Experiment Video

Updated: Jul 14, 2026

Operant Procedures for Assessing Behavioral Flexibility in Rats
08:30

Operant Procedures for Assessing Behavioral Flexibility in Rats

Published on: February 15, 2015

Repeatedly unreliable, and unreliably repeatable: the trials-to-criterion fallacy.

Robert J Dugand1

  • 1Centre for Evolutionary Biology, School of Biological Sciences, The University of Western Australia, Crawley, WA, 6009, Australia. robert.dugand@uwa.edu.au.

Animal Cognition
|July 13, 2026
PubMed
Summary

Trials-to-criterion (TTC) may inaccurately estimate intelligence due to chance. Simulations show that lucky streaks and occasional errors in TTC tasks can inflate scores, making results unreliable for assessing learning speed or cognitive ability.

Keywords:
BehaviourCognitionRepeatabilityTrials-to-criterion

More Related Videos

RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans
11:09

RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans

Published on: July 17, 2021

An Experimental Analysis of Children's Ability to Provide a False Report about a Crime
07:36

An Experimental Analysis of Children's Ability to Provide a False Report about a Crime

Published on: May 3, 2016

Related Experiment Videos

Last Updated: Jul 14, 2026

Operant Procedures for Assessing Behavioral Flexibility in Rats
08:30

Operant Procedures for Assessing Behavioral Flexibility in Rats

Published on: February 15, 2015

RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans
11:09

RBDT: A Computerized Task System based in Transposition for the Continuous Analysis of Relational Behavior Dynamics in Humans

Published on: July 17, 2021

An Experimental Analysis of Children's Ability to Provide a False Report about a Crime
07:36

An Experimental Analysis of Children's Ability to Provide a False Report about a Crime

Published on: May 3, 2016

Area of Science:

  • Cognitive Science
  • Psychometrics
  • Behavioral Neuroscience

Background:

  • Trials-to-criterion (TTC) is widely used to measure learning speed and estimate intelligence.
  • TTC involves tasks with a 50% chance of success per trial, requiring a set criterion (e.g., consecutive passes) to be met.

Purpose of the Study:

  • To investigate the reliability of TTC as a measure of intelligence.
  • To determine the extent to which chance and variability influence TTC outcomes.

Main Methods:

  • The study employed computer simulations to model TTC task performance.
  • Simulations analyzed the impact of random chance, lucky streaks, and occasional errors on TTC scores.

Main Results:

  • Simulations demonstrated that random chance and lucky streaks can lead to criterion attainment, conflating luck with intelligence.
  • Occasional errors by intelligent individuals can significantly inflate TTC scores, misrepresenting cognitive ability.
  • High variability in TTC outcomes for a fixed intelligence level highlights its unreliability.

Conclusions:

  • Inferences based on TTC data may be misleading due to inherent unreliability.
  • The study cautions against the use of TTC for accurately estimating intelligence or learning speed.
  • Recommendations are provided for future research to mitigate artefactual results in learning assessments.