Related Experiment Videos
projectgst: A Shiny Application for Generalizability Study Analysis in Nonformal Education Settings
Indriani H Ismail1,2, Soni Nopembri3, Muhammad Nursa'ban1
1Educational Research and Evaluation, State University of Yogyakarta, Yogyakarta, Indonesia.
Abstract:
Generalizability Theory (G-Theory) extends classical reliability estimation by simultaneously de-composing score variance into multiple sources of measurement error such as raters, occasions, and items within a single analytical framework. Despite its methodological advantages, G-Theory analyses typically require specialized programming expertise, limiting accessibility for applied researchers. This paper introduces projectGST, an open-source R Shiny application that provides a unified, code-free interface for conducting G-Theory analyses. The application integrates preliminary statistical analyses including descriptive statistics, normality tests, inter-rater correlation matrices, Cronbach's alpha, and intraclass correlation coefficients with G-Study variance component estimation and D-Study reliability optimization. projectgst supports both crossed and nested measurement designs and is illustrated using simulated datasets representative of nonformal education assessment contexts, including tutor evaluations at community learning centers and portfolio-based assessments in equivalency education programs. The application is openly accessible via a hosted Shiny interface and GitHub repository.
Related Concept Videos
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
Purposive Learning
Case Studies
Qualitative Analysis
For instance, group IV...
Qualitative Analysis
There are two main approaches to qualitative analysis:...