Application of Hierarchical/Multilevel Models and Quality of Reporting (2010-2020): A Systematic Review

Multilevel models have gained immense popularity across almost every discipline due to the presence of hierarchy in most data and phenomena. In this paper, we present a systematic review on the adoption and application of multilevel models and the important information reported on the results generated from the use of these models.

The review was performed by searching Google Scholar for original research articles on the application of multilevel models published between 2010 and 2020. The search strategy involved topics such as "multilevel models," "hierarchical linear models," and "mixed models with hierarchy." The search placed more emphasis on the application of hierarchical models in any discipline but excluded software methodological development and related articles.

A total of 121 articles were initially obtained from the search results. However, 65 articles met the inclusion criteria for the review. Out of the 65 articles reviewed, 46.2% were related to health/epidemiology, 15.4% to education and psychology, and 16.9% to social life. The majority of the articles (78.5%) were two-level models, and most of these studies modelled univariate responses. However, the few that modelled more than one response modelled them separately. Moreover, 83.1% were cross-sectional design, and 9.2% and 6.2% were longitudinal and repeated measures, respectively. Moreover, a little over half (55.4%) of articles reported on the intraclass correlation measure, and all articles indicated the response variable distribution where most (47.7%) were normally distributed. Only 58.5% of articles reported on the estimation methods used as Bayesian (20%) and MLE (18.5%). Again, model validation measures and statistical software were reported in 70.8% and 90.8% articles, respectively.

There is an increase in the utilization of multilevel modelling in the last decade, which could be attributed to the presence of clustered and hierarchically correlated data structures. There is a need for improvement in the area of measurement and reporting on the intraclass correlation, parameter estimation, and variable selection measures to further improve the quality of the application of multilevel models. The integration of spatial effects into multilevel models is very limited and needs to be explored in the future.