Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.9K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.9K
Introduction to z Scores01:06

Introduction to z Scores

11.2K
A z score (or standardized value) is measured in units of the standard deviation. It tells you how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a zero z score. It is important to note that the mean of the z scores is zero, and the standard deviation is one.
z scores...
11.2K
Introduction to z Scores01:05

Introduction to z Scores

1.3K
A z score (or standardized value) is measured in units of the standard deviation. It indicates how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a zero z score. It is important to note that the mean of the z scores is zero, and the standard deviation is one.
z scores...
1.3K
z Scores and Area Under the Curve01:17

z Scores and Area Under the Curve

19.6K
z scores are the standardized values obtained after converting a normal distribution into a standard normal distribution. A z score is measured in units of the standard deviation. The z score tells you how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a z score of...
19.6K
What are Estimates?01:06

What are Estimates?

8.8K
It isn't easy to measure a parameter such as the mean height or the mean weight of a population. So, we draw samples from the population and calculate the mean height or mean weight of the individuals in the sample. This sample data acts as a representative measure of the population parameter. These sample statistics are known as estimates. 
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
8.8K
z Scores and Unusual Values01:07

z Scores and Unusual Values

11.0K
The z score is one of the three measures of relative standing. It describes the location of a value in a dataset relative to the mean. z scores are obtained after the standardization of the values in a dataset. The z score for the mean is 0.
 This score indicates how far a value is from the mean in terms of standard deviation. For example, if a data value has a z score of +1, the researcher can infer that the particular data value is one standard deviation above the mean. If another data...
11.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

When Do Unifactorial Items Increase the Reliability?

Psychometrika·2026
Same author

Bias and precision in true-score estimation.

The British journal of mathematical and statistical psychology·2026
Same author

User-Friendly Software and Estimated Conditional Standard Errors of Measurement. A Commentary on Pfadt et al.

Psychometrika·2026
Same author

How Extreme Is It Anyways?: An Empirical Investigation Into the Prevalence and Strength of Extreme Response Style.

Educational and psychological measurement·2026
Same author

Recognize the Value of the Sum Score, Psychometrics' Greatest Accomplishment.

Psychometrika·2026
Same author

Proof of Reliability Convergence to 1 at Rate of Spearman-Brown Formula for Random Test Forms and Irrespective of Item Pool Dimensionality.

Psychometrika·2026
Same journal

babebi: An R Package for Bayesian Estimation and Validation in Small-N Two-Rater Pre-Post Designs.

Applied psychological measurement·2026
Same journal

A Tool for Agreement and Alignment Analysis in Binary Rating Tasks: The R Package scindex.

Applied psychological measurement·2026
Same journal

The EM Algorithm and Its Variants in Cognitive Diagnostic Models: Comparing Their Propensity for Boundaries, Extremes, Convergence, and Suboptimal Solutions.

Applied psychological measurement·2026
Same journal

When Perceptions of Social Desirability Differ: Implications for the Multidimensional Nominal Response Model of Faking.

Applied psychological measurement·2026
Same journal

csemGT: An R Package for Estimating Raw-Score Conditional Standard Errors of Measurement in Generalizability Theory.

Applied psychological measurement·2026
Same journal

Confirmatory Factor Analysis with Adaptive Quadrature Estimator Using Four Link Functions.

Applied psychological measurement·2026
See all related articles

Related Experiment Video

Updated: Feb 5, 2026

Estimation of Nephron Number in Whole Kidney using the Acid Maceration Method
08:15

Estimation of Nephron Number in Whole Kidney using the Acid Maceration Method

Published on: May 22, 2019

10.7K

Methods for Estimating Item-Score Reliability.

Eva A O Zijlmans1, L Andries van der Ark2, Jesper Tijmstra1

  • 1Tilburg University, Tilburg, Netherlands.

Applied Psychological Measurement
|September 22, 2018
PubMed
Summary
This summary is machine-generated.

Estimating item-score reliability is crucial for understanding individual item contributions to overall test scores. Methods MS and CA demonstrated the highest accuracy in simulation studies.

Keywords:
Guttman’s method λ6correction for attenuationitem-score reliabilitylatent class reliability coefficientmethod MS

More Related Videos

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
06:05

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time

Published on: February 19, 2021

1.8K
Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
09:16

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers

Published on: March 14, 2018

10.8K

Related Experiment Videos

Last Updated: Feb 5, 2026

Estimation of Nephron Number in Whole Kidney using the Acid Maceration Method
08:15

Estimation of Nephron Number in Whole Kidney using the Acid Maceration Method

Published on: May 22, 2019

10.7K
The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
06:05

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time

Published on: February 19, 2021

1.8K
Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
09:16

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers

Published on: March 14, 2018

10.8K

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Statistical Modeling

Background:

  • Reliability is typically assessed for total test scores.
  • Item-score reliability offers insights into individual item performance and contribution to overall test reliability.
  • Applications include identifying unreliable items and selecting single-item measures.

Purpose of the Study:

  • To compare four distinct methods for estimating item-score reliability.
  • To evaluate the accuracy and performance of these methods under various conditions.
  • To identify the most suitable methods for practical application in test development and analysis.

Main Methods:

  • The study compared four methods: Molenaar-Sijtsma (MS), Guttman's , Latent Class Reliability Coefficient (LCRC), and Correction for Attenuation (CA).
  • A simulation study was conducted across six conditions: standard, polytomous items, unequal parameters, two-dimensional data, long tests, and small sample sizes.
  • Performance was evaluated based on median bias, variability (IQR), and percentage of outliers.

Main Results:

  • Methods MS and CA were found to be the most accurate among the evaluated methods.
  • Method LCRC produced nearly unbiased results but exhibited significant variability.
  • Guttman's method consistently underestimated item-score reliability, though it showed lower variability (IQR).

Conclusions:

  • Methods MS and CA are recommended for accurate item-score reliability estimation.
  • The choice of method may depend on specific study conditions and desired balance between bias and variability.
  • Further research can explore the practical implications of these findings in test construction and psychometric analysis.