Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Surveys02:16

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
Cochran's Q Test01:17

Cochran's Q Test

Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs01:15

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
Group Design02:01

Group Design

The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

SPAIRE Approach Versus Direct Anterior Approach in Hemiarthroplasty for Displaced Femoral Neck Fractures: A Randomized Controlled Trial.

JB & JS open access·2026
Same author

Comparisons of core component delivery in cardiac rehabilitation programs by country income classification and decade based on the 2025 Global Audit Update: A survey study.

PLoS medicine·2026
Same author

Insomnia symptoms in women and men after percutaneous coronary intervention - a prospective multicentre cohort study.

Journal of patient-reported outcomes·2026
Same author

Methodologies for ethical risk management of digital health interventions: a discussion paper.

European journal of cardiovascular nursing·2026
Same author

Marked Changes in One-Carbon Metabolism on a Low-Carbohydrate High-Fat Diet: A Randomized Controlled Trial (CARBFUNC).

The Journal of nutrition·2026
Same author

Heterogeneity in postprandial glucose-insulin and triacylglycerol dynamics and associations with plasma metabolome and body composition in obesity.

American journal of physiology. Endocrinology and metabolism·2026

Related Experiment Video

Updated: May 28, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
10:39

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

A proposed method to investigate reliability throughout a questionnaire.

Tore Wentzel-Larsen1, Tone M Norekvål, Bjørg Ulvik

  • 1Unit of Biostatistics and Epidemiology, Oslo University Hospital, Kirkeveien 116, Oslo, Norway.

BMC Medical Research Methodology
|October 7, 2011
PubMed
Summary

This study introduces a novel method to assess changes in questionnaire reliability by analyzing random error. The proposed awareness measure can identify if participants are providing thoughtful or random answers, improving data quality in health research.

Related Experiment Videos

Last Updated: May 28, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
10:39

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

Area of Science:

  • Medical research methodology
  • Psychometrics
  • Health services research

Background:

  • Questionnaires are vital in health research but susceptible to decreased participant engagement over time, impacting data reliability.
  • A novel method is proposed to detect systematic changes in random error, thereby assessing fluctuating answer reliability.
  • This approach aims to enhance the trustworthiness of data collected through extensive surveys.

Purpose of the Study:

  • To develop and validate a method for assessing systematic changes in questionnaire reliability.
  • To introduce an 'awareness measure' to differentiate between cognitive effort and random responses.
  • To evaluate the applicability of this method in both simulated and real-world clinical datasets.

Main Methods:

  • A simulation study was performed using cluster analysis (CA) and intraclass correlation coefficient (ICC) to assess reliability changes.
  • The proposed method was applied to a clinical dataset of 753 cardiac patients utilizing the Jalowiec Coping Scale.
  • Unsupervised classification and ICC estimation were key techniques to explore systematic changes in random error.

Main Results:

  • A correlation was found between systematic random error changes and the slope of ICC estimates across questionnaire items, serving as an awareness measure.
  • The awareness measure effectively distinguished between random answers and those reflecting cognitive effort.
  • Different scales within the Jalowiec Coping Scale demonstrated varying impacts on the awareness measure.

Conclusions:

  • The proposed method shows promise for evaluating systematic reliability changes in long questionnaires, despite simulation limitations.
  • The awareness measure, derived from CA and ICC, can provide insights into participant engagement and response quality.
  • Clinical data application confirmed that the awareness measure varies across different scales, highlighting its potential utility.