Measuring Executive function: Performance-based versus self-report, evidence from a community sample

Executive functions (EF) are often indexed with performance-based tasks (PBT), yet self-report questionnaires (SRQ) have recently become more widespread. Despite overlapping terminology, previous research reports only weak correlation between these two methods. It remains unclear whether this weak correlation reflects a lack of association or methodological limitations. The principal objective of this study is to investigate how measurement methods influence assessment of EF. To address this, we employed a comprehensive measurement battery that included three PBT and three SRQ, each targeting the same executive function domain (working memory, cognitive flexibility, and inhibition) in a community sample of adults (n = 193, 111 women, mean age = 25.08 years). We used Bayesian correlation, and we specified a Gaussian (identity linked) Bayesian linear mixed model (BLMM) to investigate the effect of measurement methods. Posterior estimates indicated that correlations between PBT and SRQ were weak (r < .30, all LogBF10 values < 0). BLMM provided evidence for measurement method effects on working memory (ß = 0.2977), inhibition (ß = 0.0387), and cognitive flexibility (ß = -0.4242). Our observations are in line with the hypothesis that measurement methods affect assessment of Es. More specifically, by testing these method effects in a Turkish (non-Western, educated, industrialized, rich, democratic [WEIRD]) community sample, the study evaluates the cross-cultural generalizability of PBT-SRQ discrepancies documented in predominantly Western populations. This suggests that approaches to refine and measure EF might incorporate the distinct contributions of different measurement methods, particularly in settings where cultural norms around self-evaluations influence how individuals respond to SRQ items.