Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Data Validation01:03

Data Validation

6.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
6.3K
Behavior Modification01:21

Behavior Modification

536
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
536
Reliability and Validity01:29

Reliability and Validity

13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Investigating the replicability of the social and behavioural sciences.

Nature·2026
Same authorSame journal

VALIDITY IN DESIGN SCIENCE.

MIS quarterly : management information systems·2026
Same author

AI assistance improves people's ability to distinguish correct from incorrect eyewitness lineup identifications.

Proceedings of the National Academy of Sciences of the United States of America·2025
Same author

A comparison between numeric confidence ratings and verbal confidence statements.

Journal of experimental psychology. Applied·2024
Same author

Dispositional and ideological factor correlate of conspiracy thinking and beliefs.

PloS one·2022
Same author

Unobtrusive measures of prejudice: Estimating percentages of public beliefs and behaviours.

PloS one·2021
Same journal

Digression and Value Concatenation to Enable Privacy-Preserving Regression.

MIS quarterly : management information systems·2016
See all related articles

Related Experiment Video

Updated: Jan 14, 2026

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
09:16

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers

Published on: March 14, 2018

10.7K

AI-Augmented Content Validation in Behavioral Research: Development and Evaluation of the RATER System.

Jean-Charles Pillet1, Kai R Larsen2, David Dobolyi2

  • 1TBS Business School, 31000 Toulouse, France.

MIS Quarterly : Management Information Systems
|October 22, 2025
PubMed
Summary
This summary is machine-generated.

Content validation is crucial for measurement instruments. A new free tool, RATER (Replicable Approach to Expert Ratings), uses AI to provide quick, reliable content validity insights for behavioral research scales.

Keywords:
behavioral researchcontent validitydesign science researchlarge language models (LLMs)machine learningpsychometricsresearch rigorscale development

More Related Videos

Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems
08:42

Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems

Published on: May 5, 2015

12.6K
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
10:39

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

1.1K

Related Experiment Videos

Last Updated: Jan 14, 2026

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
09:16

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers

Published on: March 14, 2018

10.7K
Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems
08:42

Assessment of Social Cognition in Non-human Primates Using a Network of Computerized Automated Learning Device ALDM Test Systems

Published on: May 5, 2015

12.6K
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
10:39

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

1.1K

Area of Science:

  • Psychometrics
  • Behavioral Science
  • Artificial Intelligence

Background:

  • Content validation is essential for measurement instrument development, ensuring scales accurately capture intended constructs.
  • Researchers often skip content validation due to high costs and specialized expertise requirements.
  • Existing methods for content validation are resource-intensive, limiting their widespread use in behavioral research.

Purpose of the Study:

  • To introduce RATER (Replicable Approach to Expert Ratings), a free, web-based system designed to streamline content validity assessment.
  • To provide researchers, reviewers, and students with accessible and reliable tools for evaluating measurement instruments.
  • To enhance the scale development and validation process in behavioral research through automated content validity insights.

Main Methods:

  • RATER utilizes psychometric measurement theory to evaluate scale items against intended constructs, construct distinctness, and domain representation.
  • The system incorporates two artificial intelligence models, RATERC and RATERD, trained on 2,443 psychometric scales from diverse disciplines.
  • Leverages advanced large language model architectures, including BERT and GPT, for sophisticated analysis.

Main Results:

  • Six studies confirmed the RATER system's accuracy, reliability, and practical utility.
  • RATER demonstrated its capability to provide quick and dependable insights into the content validity of measurement instruments.
  • The system effectively assesses whether scale items align with their intended constructs and represent the domain comprehensively.

Conclusions:

  • RATER significantly augments the scale development and validation process by offering an efficient and reliable method for content validation.
  • The tool democratizes access to content validity assessment, overcoming previous barriers of cost and expertise.
  • Implementing RATER can lead to more valid and robust findings in behavioral research by improving the quality of measurement instruments.