The Utility of Mixed Effects Models in the Evaluation of Complex Genomic Traits In Vitro

In pharmacogenomic studies, the use of human liver microsomes as a model system to evaluate the impact of complex genomic traits (i.e., linkage-disequilibrium patterns, coding, and non-coding variation, etc.) on efficiency of drug metabolism is challenging. To accurately predict the true effect size of genomic traits requires large richly sampled datasets representative of the study population. Moreover, the acquisition of this data can be labor-intensive if the study design or bioanalytical methods are not high throughput, and it is potentially unfeasible if the abundance of sample needed for experiments is limited. To overcome these challenges, we developed a novel strategic approach using non-linear mixed effects models (NLME) to determine enzyme kinetic parameters for individual liver specimens using sparse data. This method can facilitate evaluation of the impact that complex genomic traits have on the metabolism of xenobiotics in vitro when tissue and other resources are limited. In addition to facilitating the accrual of data, it allows for rigorous testing of covariates as sources of kinetic parameter variability. In this in silico study, we present a practical application of such an approach using previously published in vitro cytochrome P450 (CYP) 2D6 data and explore the impact of sparse sampling, and experimental error on known kinetic parameter estimates of CYP2D6 mediated formation of 4-hydroxy-atomoxetine in human liver microsomes. SIGNIFICANCE STATEMENT: This study presents a novel non-linear mixed effects model (NLME)-based framework for evaluating the impact of complex genomic traits on saturable processes described by a Michaelis-Menten kinetics in vitro using sparse data. The utility of this approach extends beyond gene variant associations, including determination of covariate effects on in vitro kinetic parameters and reduced demand for precious experimental material.