Mining a clinical data warehouse to discover disease-finding associations using co-occurrence statistics
Related Experiment Video
Updated: Aug 7, 2026

Performing Data Mining And Integrative Analysis Of Biomarker in Breast Cancer Using Multiple Publicly Accessible Databases
Published on: May 17, 2019
Hui Cao1, Marianthi Markatou, Genevieve B Melton
1Department of Biomedical Informatics, Columbia University, New York, NY, USA.
Abstract:
This paper applies co-occurrence statistics to discover disease-finding associations in a clinical data warehouse. We used two methods, chi2 statistics and the proportion confidence interval (PCI) method, to measure the dependence of pairs of diseases and findings, and then used heuristic cutoff values for association selection. An intrinsic evaluation showed that 94 percent of disease-finding associations obtained by chi2 statistics and 76.8 percent obtained by the PCI method were true associations. The selected associations were used to construct knowledge bases of disease-finding relations (KB-chi2, KB-PCI). An extrinsic evaluation showed that both KB-chi2 and KB-PCI could assist in eliminating clinically non-informative and redundant findings from problem lists generated by our automated problem list summarization system.
Related Concept Videos
Genome-wide Association Studies-GWAS
GWAS does not require the identification of the target gene involved in...
Statistical Software for Data Analysis and Clinical Trials
Investigation of Disease Outbreaks
Statistical Methods for Analyzing Epidemiological Data
Steps in Outbreak Investigation