Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

14.3K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.3K
Case Studies01:22

Case Studies

13.8K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
13.8K
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs01:15

Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs

373
Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
373
Group Design02:01

Group Design

11.0K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
11.0K
Surveys02:16

Surveys

17.2K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
17.2K
Study Design in Statistics01:15

Study Design in Statistics

10.2K
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
10.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Trauma-Specific Interventions for Individuals With Intellectual Disabilities: A Meta-Analysis of Single-Case Experiments.

Trauma, violence & abuse·2026
Same author

Synthesis of single-case design mediation effects using two-stage multilevel modeling.

Behavior research methods·2026
Same author

Defining asymmetry in item response theory.

The British journal of mathematical and statistical psychology·2026
Same author

Interventions for Transition-Related Challenging Behavior in Individuals with Disabilities: A Targeted Research Synthesis and Meta-Analysis of Studies Published in Behavior Analytic Journals.

Behavior modification·2026
Same author

Using latent class analysis to justify a latent continuum in item development.

Psychological methods·2026
Same author

Internalized racism and personal self-esteem among ethnoracial minoritized groups: A meta-analytic review.

Psychological bulletin·2026

Related Experiment Video

Updated: Mar 22, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.3K

Reliability, Validity, and Usability of Data Extraction Programs for Single-Case Research Designs.

Mariola Moeyaert1, Daniel Maggin2, Jay Verkuilen3

  • 1State University of New York, Albany, USA The City University of New York, New York City, USA mmoeyaert@albany.edu.

Behavior Modification
|April 30, 2016
PubMed
Summary
This summary is machine-generated.

This study evaluated four software programs for extracting data from single-case experimental designs (SCEDs). WebPlotDigitizer offers the best balance of usability, speed, and cost for SCED data extraction.

Keywords:
inter-observer agreementintra-observer agreementmultiple-baseline designreliabilityusabilityvalidity

More Related Videos

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
10:39

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

1.3K
A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
07:50

A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts

Published on: September 20, 2018

16.6K

Related Experiment Videos

Last Updated: Mar 22, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.3K
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
10:39

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning

Published on: August 29, 2025

1.3K
A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
07:50

A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts

Published on: September 20, 2018

16.6K

Area of Science:

  • Behavioral Sciences
  • Intervention Development
  • Research Methodology

Background:

  • Single-case experimental designs (SCEDs) are crucial for intervention development and validation in behavioral sciences.
  • Extracting data from SCED graphs is a standard but labor-intensive process.
  • Previous research on data extraction software has focused on aggregate data, not individual data points.

Purpose of the Study:

  • To evaluate the reliability, validity, and usability of four software programs for extracting individual data points from SCED graphs.
  • To compare Ungraph, DataThief, WebPlotDigitizer, and XYit based on these criteria.

Main Methods:

  • Assessed reliability and validity of numeric coding for each program against real data.
  • Evaluated program usability, including user-friendliness, data retrieval time, and cost.
  • Conducted a comparative analysis of the four selected software programs.

Main Results:

  • Data reliability and validity were dependent on graph quality, not software choice.
  • WebPlotDigitizer and Ungraph scored highest in usability.
  • DataThief performed poorly, requiring double the retrieval time; WebPlotDigitizer was the only free option.

Conclusions:

  • WebPlotDigitizer is the optimal choice for SCED data extraction due to its usability, efficiency, and cost-effectiveness.
  • Ungraph also offers strong usability, making it a viable alternative.
  • Software choice impacts usability and efficiency, but not the fundamental reliability/validity of extracted SCED data.