Comparison of chemotherapy and bone marrow transplants using two independent clinical databases

Comparing the outcome of chemotherapy and bone marrow transplants in the absence of a randomized trial is difficult but necessary for diseases where small numbers of patients make such trials difficult if not impossible. To address this issue for adults with acute lymphoblastic leukemia in first remission, we created an empirical database using two separate datasets, one from the International Bone Marrow Transplant Registry and the other from two multicenter chemotherapy studies. Prior to combining the datasets, a study protocol was developed to define inclusion criteria, outcomes to be compared and statistical methods. The main problems of a non-randomized comparison are biases potentially introduced by differences in baseline composition of the two cohorts and differences in time-to-treatment. The source of the latter bias is different distributions of waiting times between achieving complete remission and receiving post-remission therapy. Several techniques to control these biases were evaluated; each gave qualitatively similar results. These methods can easily be applied to other clinical situations where randomized trials are not available.