A comment on the importance of numerical evaluation of analytic solutions involving approximations

An analytic solution proposed by Senn (1) for removing the effects of covariate imbalance in controlled clinical trials was subjected to Monte Carlo evaluation. For practical applications of his derivation, Senn proposed substitution of sample statistics for parameters of the bivariate normal model. Unfortunately, that substitution produces severe distortion in the size of tests of significance for treatment effects when covariate imbalance is present. Numerical verification of proposed substitutions into analytic models is recommended as a prudent approach.