Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Study samples are too small to produce sufficiently precise reliability coefficients.

Richard A Charter1

  • 1Department of Veterans Affairs, VA Long Beach Healthcare System, CA 90822, USA.

The Journal of General Psychology
|May 30, 2003
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A novel immunogen to modulate cytokine production and promote immune system reconstitution in HIV-AIDS.

American journal of therapeutics·2011
Same author

Statistical extensions of Ponterotto and Ruckdeschel's (2007) reliability matrix for estimating the adequacy of internal consistency coefficients.

Perceptual and motor skills·2009
Same author

Differences scores: regression-based reliable difference and the regression-based confidence interval.

Journal of clinical psychology·2009
Same author

A comprehensive approach to the interpretation of difference scores.

Applied neuropsychology·2009
Same author

Statistical approaches to achieving sufficiently high test score reliabilities for research purposes.

The Journal of general psychology·2008
Same author

Statistical significance and reliability of single-subtest and cluster deviation scores.

Psychological reports·2008

Reliability studies for tests often use small sample sizes, potentially leading to inaccurate results. While recent decades show larger sample sizes, many studies still lack sufficient participants for precise reliability coefficients.

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Psychological Testing

Background:

  • Reliability is crucial for accurate test interpretation.
  • Previous research indicates variability in sample sizes used for reliability studies.
  • Ensuring adequate sample size is essential for robust psychometric properties.

Purpose of the Study:

  • To analyze sample size trends in published reliability studies.
  • To evaluate the adequacy of sample sizes for estimating reliability coefficients.
  • To identify potential implications for true-score confidence intervals.

Main Methods:

  • A comprehensive survey of journal articles, test manuals, and critique books.
  • Analysis of sample size statistics (mean and median) for 742 reliability studies.

Related Experiment Videos

  • Examination of sample size distributions across different reliability types (internal consistency, retest, interjudge).

    • Main Results:

    • The mean sample size was 260, but the median was only 90, indicating a skewed distribution.
    • Median sample sizes varied significantly by reliability type: 182 (internal consistency), 64 (retest), and 36 (interjudge).
    • Many internal consistency studies used sample sizes too small for precise reliability coefficients, impacting confidence interval accuracy.

    Conclusions:

    • Current sample sizes in many reliability studies are insufficient for precise coefficient estimation.
    • Inadequate sample sizes can lead to imprecise true-score confidence intervals for examinees.
    • A trend towards larger sample sizes is observed in recent publications, suggesting improved practices.