Related Experiment Video
Updated: Jun 5, 2025

Split Point Analysis and Uncertainty Quantification of Thermal-Optical Organic/Elemental Carbon Measurements
Published on: September 7, 2019
Meta-analysis of Monte Carlo simulations examining class enumeration accuracy with mixture models
Tiffany A Whittaker1, Jihyun Lee2, Devin Dedrick1
1Department of Educational Psychology, University of Texas at Austin.
Abstract:
This article walks through steps to conduct a meta-analysis of Monte Carlo simulation studies. The selected Monte Carlo simulation studies focused on mixture modeling, which is becoming increasingly popular in the social and behavioral sciences. We provide details for the following steps in a meta-analysis: (a) formulating a research question; (b) identifying the relevant literature; (c) screening of the literature; (d) extracting data; (e) analyzing the data; and (f) interpreting and discussing the findings. Our goal was to investigate which simulation design factors (moderators) impact class enumeration accuracy in mixture modeling analyses. We analyzed the meta-analytic data using a generalized linear mixed model with a multilevel structure and examined the impact of the design moderators on the outcome of interest with a meta-regression model. For instance, the Bayesian information criterion was found to perform more accurately in conditions with larger sample sizes whereas entropy was found to perform more accurately with smaller sample sizes. It is hoped that this article can serve as a guide for others to follow in order to quantitatively synthesize results from Monte Carlo simulation studies. In turn, the findings from meta-analyzing Monte Carlo simulation studies can provide more details about factors that influence outcomes of interest as well as help methodologists when planning Monte Carlo simulation studies. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
Related Concept Videos
Mechanistic Models: Compartment Models in Individual and Population Analysis
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Probability Histograms
Wald-Wolfowitz Runs Test II
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...

