Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Efficiently measuring recognition performance with sparse data.

Lael J Schooler1, Richard M Shiffrin

  • 1Center for Adaptive Behavior and Cognition, Max Planck Institute for Human Development, Berlin, Germany. schooler@mpib-berlin.mpg.de

Behavior Research Methods
|August 16, 2005
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

How should the advancement of large language models affect the practice of science?

Proceedings of the National Academy of Sciences of the United States of America·2025
Same author

Dialogues about the practice of science.

Proceedings of the National Academy of Sciences of the United States of America·2025
Same author

Modeling collaborative memory with SAM.

Memory & cognition·2024
Same author

Validation of a rodent model of episodic memory replay.

Learning & behavior·2024
Same author

Function estimation: Quantifying individual differences of hand-drawn functions.

Memory & cognition·2024
Same author

Recognition memory decisions made with short- and long-term retrieval.

Memory & cognition·2024
Same journal

Exploring psychological tradeoffs: Developing and demonstrating an R Shiny app for Pareto optimization.

Behavior research methods·2026
Same journal

The performance of Bayesian fit measures in detecting misspecified multilevel structural equation modeling.

Behavior research methods·2026
Same journal

Psychometric functions from multiple responses : Dedicated to the memory of Colin L. Mallows.

Behavior research methods·2026
Same journal

Low-cost, open-source, full-stack software and Arduino-based hardware for control of commercially available animal behavior systems.

Behavior research methods·2026
Same journal

PyNeon: A Python package for the analysis of Neon multimodal mobile eye-tracking data.

Behavior research methods·2026
Same journal

Talking surveys: How photorealistic embodied conversational agents shape response quality, engagement, and satisfaction.

Behavior research methods·2026
See all related articles

When measuring performance with few observations in signal detection tasks, standard d' analysis risks many Type I errors. Combining d' with bootstrap confidence intervals or using gamma with t-tests offers more reliable statistical inference.

Area of Science:

  • Psychology
  • Cognitive Science
  • Psychophysics

Background:

  • Accurate performance measurement is crucial in signal-detection tasks.
  • Limited observations per participant pose statistical challenges.
  • Standard d' analysis may yield unreliable results with small sample sizes.

Purpose of the Study:

  • To evaluate statistical methods for performance measurement in signal-detection tasks with few observations.
  • To compare Type I and Type II error rates of different statistical techniques.
  • To identify the most reliable methods for analyzing limited data in psychophysical experiments.

Main Methods:

  • Monte Carlo simulations were employed to generate hypothetical data.
  • Standard d' analysis was compared against alternative methods, including percentile bootstrap confidence intervals and gamma.

Related Experiment Videos

  • Type I and Type II error rates were assessed under various weighting schemes for errors.

    • Main Results:

    • Standard d' analysis demonstrated a high rate of Type I errors with limited data.
    • Combining aggregate d' with percentile bootstrap confidence intervals emerged as a promising nonparametric approach.
    • Gamma, when used with repeated measures t-tests, offered a more conservative alternative to d', with Type I error rates closer to the .05 alpha level.

    Conclusions:

    • For signal-detection tasks with few observations, percentile bootstrap confidence intervals with d' or gamma with t-tests are recommended over standard d' analysis.
    • Gamma provides a more conservative and reliable alternative to d' in many psychological research contexts.
    • Researchers should carefully consider the choice of statistical methods to avoid inflated Type I errors when analyzing limited data.