Related Experiment Video
Updated: Jul 2, 2025
09:17
Using a Virtual Store As a Research Tool to Investigate Consumer In-store Behavior
Published on: July 24, 2017
11.3K
A Comparison of Single-Case Effect Measures Using Check-In Check-Out Data
Allison M Peart1, Daniel D Drevon1, Andrea D Jasper1
1Central Michigan University, Mount Pleasant, MI, USA.
Behavior Modification
|February 23, 2024
Summary
Researchers found that while all effect measures showed check-in check-out (CICO) improved student behavior, the magnitude of effects varied. This highlights how choosing different measures can impact conclusions on intervention effectiveness.
Area of Science:
- Educational Psychology
- Behavioral Interventions
- Research Methodology
Background:
- Meta-analysis of single-case experimental designs (SCED) involves choosing from various effect measures.
- Different effect measures can model distinct data characteristics, potentially leading to varied conclusions on intervention effectiveness.
- The study focuses on check-in check-out (CICO), a common intervention in School-Wide Positive Behavior Interventions and Supports (SWPBIS).
Approach:
- A multilevel meta-analysis was conducted on 95 cases from 22 studies evaluating CICO.
- Seven distinct effect measures were employed to analyze the data.
- The impact of selecting different effect measures on study conclusions was investigated.
Key Points:
- All seven effect measures indicated statistically significant positive effects of CICO on student behavior.
- The magnitude of CICO's effectiveness varied across the different effect measures when compared to interpretive guidelines.
- This variation suggests that the choice of effect measure can influence the perceived extent of an intervention's success.
Conclusions:
- While CICO demonstrates effectiveness across various measures, the precise magnitude of its impact is sensitive to the chosen effect measure.
- Researchers must carefully consider the implications of effect measure selection in SCED meta-analyses.
- Further research should explore the nuances of different effect measures and their interpretive guidelines for SCED.
Related Concept Videos
01:13Multiple Comparison Tests
3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
01:08Data Collection by Observations
12.0K
Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the most widely used methods of data collection. It involves collecting data by observing the behavior and physical characteristics of a sample without making any modifications to the sample.
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
12.0K
01:17Sign Test for Matched Pairs
131
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
131
01:09Comparing Experimental Results: Student's t-Test
1.6K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
1.6K
01:20Comparing the Survival Analysis of Two or More Groups
186
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
186
01:22Case Studies
11.7K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
11.7K