Related Experiment Video
Updated: Jul 20, 2025

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
Published on: July 3, 2020
Type-I-error rate inflation in mixed models for repeated measures caused by ambiguous or incomplete model
Sebastian Häckl1, Armin Koch1, Florian Lasch2
1Hannover Medical School, Institute of Biostatistics, Hannover, Niedersachsen, Germany.
Abstract:
Pre-specification of the primary analysis model is a pre-requisite to control the family-wise type-I-error rate (T1E) at the intended level in confirmatory clinical trials. However, mixed models for repeated measures (MMRM) have been shown to be poorly specified in study protocols. The magnitude of a resulting T1E rate inflation is still unknown. This investigation aims to quantify the magnitude of the T1E rate inflation depending on the type and number of unspecified model items as well as different trial characteristics. We simulated a randomized, double-blind, parallel group, phase III clinical trial under the assumption that there is no treatment effect at any time point. The simulated data was analysed using different clusters, each including several MMRMs that are compatible with the imprecise pre-specification of the MMRM. T1E rates for each cluster were estimated. A significant T1E rate inflation could be shown for ambiguous model specifications with a maximum T1E rate of 7.6% [7.1%; 8.1%]. The results show that the magnitude of the T1E rate inflation depends on the type and number of unspecified model items as well as the sample size and allocation ratio. The imprecise specification of nuisance parameters may not lead to a significant T1E rate inflation. However, the results of this simulation study rather underestimate the true T1E rate inflation. In conclusion, imprecise MMRM specifications may lead to a substantial inflation of the T1E rate and can damage the ability to generate confirmatory evidence in pivotal clinical trials.
Insights
Imprecise specification of mixed models for repeated measures (MMRM) in clinical trials can inflate the family-wise type-I-error rate (T1E), potentially compromising confirmatory evidence. This study quantifies this inflation, showing significant T1E rate increases with ambiguous MMRM models.
Area of Science:
- Biostatistics
- Clinical Trial Methodology
- Statistical Inference
Background:
- Controlling the family-wise type-I-error rate (T1E) is crucial for confirmatory clinical trials.
- Mixed models for repeated measures (MMRM) are frequently used but often poorly specified in protocols.
- The impact of MMRM specification ambiguity on T1E has not been fully quantified.
Purpose of the Study:
- To quantify the magnitude of T1E rate inflation resulting from unspecified MMRM model items.
- To investigate how T1E inflation varies with the type and number of unspecified model parameters.
- To assess the influence of trial characteristics on T1E inflation in confirmatory trials.
Main Methods:
- Simulated a randomized, double-blind, parallel-group, phase III clinical trial assuming no treatment effect.
- Analyzed simulated data using multiple MMRMs compatible with imprecise protocol specifications.
- Estimated T1E rates for each cluster of MMRM analyses to assess inflation.
Main Results:
- Significant T1E rate inflation was observed for ambiguous MMRM specifications, reaching a maximum of 7.6% [7.1%; 8.1%].
- The extent of T1E inflation depends on the type and number of unspecified model items, sample size, and allocation ratio.
- Imprecise specification of nuisance parameters may not significantly inflate T1E, but results may underestimate true inflation.
Conclusions:
- Imprecise MMRM specifications in clinical trials can lead to substantial T1E rate inflation.
- This inflation can significantly impair the ability to generate reliable confirmatory evidence.
- Careful and precise specification of MMRMs is essential for maintaining statistical integrity in pivotal trials.
More Related Videos
Related Concept Videos
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Errors In Hypothesis Tests
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Uncertainty in Measurement: Accuracy and Precision
Random and Systematic Errors
Mechanistic Models: Compartment Models in Individual and Population Analysis

