Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Conditional reliability coefficients for test scores.

W Alan Nicewander1

  • 1Pacific Metrics Corporation.

Psychological Methods
|April 7, 2017
PubMed
Summary
This summary is machine-generated.

This study links measurement precision in psychological and educational testing. It shows a simple relationship between reliability coefficients and information functions in item response theory (IRT) and classical test theory (CTT).

Related Experiment Videos

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same journal

Addressing selective reporting bias in meta-analysis of dependent effect sizes: A tutorial in R.

Psychological methods·2026
Same journal

Heterogeneous variance models with Gaussian processes.

Psychological methods·2026
Same journal

Bayesian evaluation for latent variable models: A tutorial on computing information criteria and bayes factors with the r package bleval.

Psychological methods·2026
Same journal

A stochastic block prior for clustering in graphical models.

Psychological methods·2026
Same journal

Three-level vector autoregressive models.

Psychological methods·2026
Same journal

Scaling cognitive modeling to big data: A deep learning approach to studying individual differences in evidence accumulation model parameters.

Psychological methods·2026
See all related articles

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Psychological Assessment

Background:

  • The reliability coefficient is the standard measure of precision for test scores.
  • Item response theory (IRT) uses the information function as a key conditional index of precision.
  • Classical test theory (CTT) and IRT traditionally use different precision metrics.

Purpose of the Study:

  • To derive conditional reliability coefficients from IRT information functions.
  • To establish a unified relationship between IRT and CTT precision indices.
  • To explore the applicability of this relationship across various scoring methods and item types.

Main Methods:

  • Deriving conditional reliability coefficients as transformations of information functions.
  • Applying these derivations to number-correct scores, computerized adaptive test scores, and theta-estimates.
  • Demonstrating the relationship for dichotomous, polytomous, and mixed item types.

Main Results:

  • A simple formula relating conditional reliability to the information function was derived: ρ(X,X'|θ ) =I(X,θ ) /[I(X,θ ) +1].
  • This relationship holds for various score types, including number-correct scores, and across different item formats.
  • Conditional reliabilities for computerized adaptive tests and theta-estimates were also found to be directly related to the information function.

Conclusions:

  • A fundamental link exists between reliability in CTT and information in IRT.
  • This unified approach simplifies understanding measurement precision across different testing models.
  • The findings offer a more cohesive framework for evaluating the precision of psychological and educational assessments.