The effect of data points per x- to y-axis ratio on visual analysts evaluation of single-case graphs

Research based on single-case designs (SCD) are frequently utilized in educational settings to evaluate the effect of an intervention on student behavior. Visual analysis is the primary method of evaluation of SCD, despite research noting concerns regarding reliability of the procedure. Recent research suggests that characteristics of the graphic display may contribute to poor reliability and overestimation of intervention effects. This study investigated the effect of increasing or decreasing the data points per x- to y-axis ratio (DPPXYR) on rater evaluations of functional relation and effect size in SCD data sets. Twenty-nine individuals (58.6% male) with experience in SCD were asked to evaluate 40 multiple baseline data sets. Two data sets reporting null, small, moderate, and large intervention effects (8 total) were modified by manipulating the ratio of the x- to y-axis (5 variations), resulting in 40 total graphs. Results indicate that raters scored effects as larger as the DPPXYR decreased. Additionally, a 2-way within-subjects analysis of variance (ANOVA) revealed a significant main effect of DPPXYR manipulation on effect size rating, F(2.11, 58.98) = 58.05, p < .001, η2 = .675, and an interaction between DPPXYR manipulation and magnitude of effect, F(6.71, 187.78) = 11.45, p < .001, η2 = .29. Overall, results of the study indicate researchers and practitioners should maintain a DPPXYR of .14 or larger in the interest of more conservative effect size judgments. (PsycINFO Database Record