Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Accuracy and Errors in Hypothesis Testing

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...

Prediction Intervals

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

Statistical Hypothesis Testing

Statistical Hypothesis Testing

Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...

Interpretation of Confidence Intervals

Interpretation of Confidence Intervals

A confidence interval is a better estimate of the population than a point estimate, as it uses a range of values from a sample instead of a single value.
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...

Confidence Coefficient

Confidence Coefficient

The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

A Measure Of Separability And Random Zeros In Statistical Classification.

Multivariate behavioral research·2016

Same author

The Standard Uptake Value (SUV). Is It Necessary for Diagnosing Malignant Tissue by F-18-FDG PET?

Clinical positron imaging : official journal of the Institute for Clinical P.E.T·2003

Same author

Immunobiologic studies in hepatoma-bearing mice passively immunized to alpha-fetoprotein.

Archivum immunologiae et therapiae experimentalis·1979

See all related articles

Search research articles

Related Experiment Video

Updated: Mar 26, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

A Probabilistic Latent Class Model for Assessing Inter-Judge Reliability.

W R Dillon, N Mulani

Multivariate Behavioral Research

|January 24, 2016

Summary

This summary is machine-generated.

This study introduces a probabilistic model to assess inter-judge reliability in behavioral research. The model enhances the evaluation of cognitive response categorization, improving data quality assessment.

More Related Videos

Assessment of Mouse Judgment Bias through an Olfactory Digging Task

Assessment of Mouse Judgment Bias through an Olfactory Digging Task

Published on: March 4, 2022

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

Related Experiment Videos

Last Updated: Mar 26, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

Assessment of Mouse Judgment Bias through an Olfactory Digging Task

Assessment of Mouse Judgment Bias through an Olfactory Digging Task

Published on: March 4, 2022

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Author Spotlight: Assessing the Reliability of Doppler Ultrasound in Measuring Leg Blood Flow

Published on: December 15, 2023

Area of Science:

Behavioral Science
Psychology
Communication Studies

Background:

Behavioral researchers increasingly collect cognitive responses alongside attitudinal measures.
Assessing persuasive communication effects relies on coding cognitive responses, often by independent judges.
Inter-judge reliability is crucial for evaluating the quality of categorized cognitive response data.

Purpose of the Study:

To present a novel probabilistic model for assessing inter-judge reliability.
To provide a framework for evaluating the agreement among judges coding cognitive responses.
To enhance the rigor of data quality assessment in behavioral research.

Main Methods:

Development of a probabilistic model for inter-judge reliability assessment.
Operationalization of the model using restricted latent class models.
Illustration of the model's application in evaluating cognitive response categorization.

Main Results:

The probabilistic model enables formal statistical testing of inter-judge reliability.
It allows for the estimation of assignment error rates and their standard errors.
The model facilitates testing simultaneous agreement for multiple judges.

Conclusions:

The proposed probabilistic model offers a robust method for assessing inter-judge reliability.
This approach improves the evaluation of data derived from categorized cognitive responses.
The model contributes to more reliable and valid measurement in behavioral research.