Related Experiment Video
Updated: Jul 16, 2026

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Using lowess to remove systematic trends over time in predictor variables prior to logistic regression with quantile
Craig B Borkowf1, Paul S Albert, Christian C Abnet
1National Cancer Institute, Center for Cancer Research, Cancer Prevention Studies Branch, 6116 Executive Blvd., Suite 705, MSC 8314, Bethesda, MD 20892-8314, USA. CBorkowf@cdc.gov
Abstract:
In case-control studies one may employ logistic regression to model the relationship between binary responses and continuous predictor variables that have been categorized by the empirical quartiles of the controls. Sometimes, however, systematic trends over time (or drifts) contaminate the laboratory measurements of predictor variables. In this paper we consider the use of locally weighted robust regression (lowess) to estimate and remove these systematic trends when the trends for the cases and controls have a common shape. One can then use the lowess adjusted data in the desired logistic regression model. We illustrate these methods with a case-control study that was designed to assess the risk of oesophageal cancer as a function of the quartile categories of sphinganine levels in the blood serum. Upon examination of the data, it was discovered that the sphinganine laboratory measurements were contaminated by a systematic trend, the magnitude of which depended only on the day of analysis. This trend needed to be removed before performing further analyses of the data. In addition, we present simulations to examine the use of lowess methods to estimate and remove various shapes of trends from contaminated predictor data before constructing logistic regression models with quartile categories. We found that using the trend-contaminated data tends to give attenuated parameter estimates and hence lower significance and power levels than using the uncontaminated data. Conversely, using appropriate lowess methods to adjust the data tends to give nearly unbiased parameter estimates, near nominal significance levels, and improved power.
Related Concept Videos
Regression Toward the Mean
Percentile
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Detection of Gross Error: The Q Test
Quantifying and Rejecting Outliers: The Grubbs Test
Truncation in Survival Analysis
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are observed.

