On tests for group variation with a small to moderate number of groups

This paper considers a family of penalized likelihood score tests for group variation. The tests can be indexed by a measure of degrees of freedom. At one extreme, with degrees of freedom one less than the number of groups, is the usual score test for a fixed effects alternative using indicator variables for the groups, while at the other extreme, in the limit as the degrees of freedom-->0, is a test closely related to a score test based on a random effects alternative. Asymptotic power comparisons are made for the tests in the family. As would be expected, different members of the family are more efficient for different alternatives. Generally the tests with smaller degrees of freedom appear to have better power than the standard test for alternatives focusing on differences among the larger groups, and lower power for alternatives focusing on differences among the smaller groups. Simulations indicate the asymptotic approximation to the distribution performs better for the tests with small degrees of freedom.