Related Experiment Video
Updated: Jun 27, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
Assumption-lean falsification tests of rate double-robustness of double-machine-learning estimators
Lin Liu1, Rajarshi Mukherjee2, James M Robins3
1Institute of Natural Sciences, MOE-LSC, School of Mathematical Sciences, CMA-Shanghai, SJTU-Yale Joint Center for Biostatistics and Data Science, Shanghai Jiao Tong University; Shanghai Artificial Intelligence Laboratory.
Abstract:
The class of doubly robust (DR) functionals studied by Rotnitzky et al. (2021) is of central importance in economics and biostatistics. It strictly includes both (i) the class of mean-square continuous functionals that can be written as an expectation of an affine functional of a conditional expectation studied by Chernozhukov et al. (2022b) and the class of functionals studied by Robins et al. (2008). The present state-of-the-art estimators for DR functionals are double-machine-learning (DML) estimators (Chernozhukov et al., 2018). A DML estimator of depends on estimates and of a pair of nuisance functions and , and is said to satisfy "rate double-robustness" if the Cauchy-Schwarz upper bound of its bias is . Were it achievable, our scientific goal would have been to construct valid, assumption-lean (i.e. no complexity-reducing assumptions on or ) tests of the validity of a nominal () Wald confidence interval (CI) centered at . But this would require a test of the bias to be , which can be shown not to exist. We therefore adopt the less ambitious goal of falsifying, when possible, an analyst's justification for her claim that the reported () Wald CI is valid. In many instances, an analyst justifies her claim by imposing complexity-reducing assumptions on and to ensure "rate double-robustness". Here we exhibit valid, assumption-lean tests of : "rate double-robustness holds", with non-trivial power against certain alternatives. If is rejected, we will have falsified her justification. However, no assumption-lean test of , including ours, can be a consistent test. Thus, the failure of our test to reject is not meaningful evidence in favor of .
Related Concept Videos
Goodness-of-Fit Test
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Expected Frequencies in Goodness-of-Fit Tests
Friedman Two-way Analysis of Variance by Ranks
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Errors In Hypothesis Tests

