Related Experiment Video
Updated: Jan 13, 2026

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
Development and validation of data-driven, decision tree-based algorithms for identifying Behçet's disease in claims
Ken-Ei Sada1, Yoshia Miyawaki2, Ryo Yanai3
1Department of Clinical Epidemiology, Kochi Medical School, Nankoku, Japan.
Insights
Developing data-driven algorithms for Behçet
Area of Science:
- Rheumatology
- Medical Informatics
- Data Science
Background:
- Behçet's disease diagnosis in Japan relies on clinical criteria.
- Accurate identification of Behçet's disease patients using administrative data is challenging.
- Existing diagnostic algorithms may lack precision and external validation.
Purpose of the Study:
- To develop and externally validate novel, data-driven algorithms for identifying Behçet's disease patients in Japan.
- To assess the utility of variable selection methods and decision tree models for this purpose.
- To improve the accuracy of claims-based research for Behçet's disease.
Main Methods:
- Retrospective cross-sectional study of 13,538 patients from six tertiary hospitals.
- Claims data linked to chart-confirmed Behçet's disease diagnoses.
- Utilized Least Absolute Shrinkage and Selection Operator, Boruta, and Recursive Feature Elimination for feature selection.
- Developed rule-based algorithms from decision tree models and evaluated diagnostic performance.
Main Results:
- Diagnosis codes alone showed high sensitivity (1.000) and specificity (0.992) but modest positive predictive value (PPV).
- Incorporating prescriptions for sulphamethoxazole-trimethoprim and colchicine significantly improved PPV (0.793 in test set, 0.865 in external validation).
- The developed algorithms maintained high sensitivity and specificity while enhancing PPV.
Conclusions:
- Integrating prescription data with diagnosis codes enhances the accuracy of identifying Behçet's disease patients in claims data.
- A data-driven framework combining variable selection and decision tree analysis offers a validated and scalable approach.
- This methodology supports more reliable claims-based research for Behçet's disease.
Objective:
To develop and externally validate novel, data-driven algorithms that are based on appropriate variable selection methods for identifying patients with Behçet's disease in Japan.
Methods:
This retrospective cross-sectional study included 13,538 patients from six tertiary hospitals (November-December 2023). One year of claims data was linked to chart-confirmed Behçet's disease diagnoses. Patients were randomly divided into training (n = 8,811) and test (n = 3,775) sets, with external validation (n = 952) from another hospital. Feature selection among Behçet's disease-coded patients used the Least Absolute Shrinkage and Selection Operator, Boruta, and Recursive Feature Elimination. The diagnostic performance of the rule-based algorithms, which were derived from the decision tree models, was evaluated using accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value, and F1 score.
Results:
Diagnosis codes alone achieved high sensitivity (1.000) and specificity (0.992) but modest PPV (0.767, test set; 0.850, external validation). Incorporating sulphamethoxazole-trimethoprim and colchicine prescriptions improved the positive predictive value, which was 0.793 in the test set and 0.865 in external validation.
Conclusion:
Incorporating prescriptions alongside diagnosis codes improved PPV while maintaining high sensitivity and specificity. Building upon a data-driven framework that integrates variable selection methods and decision tree analysis, this study provides a validated and scalable approach for reliable claims-based research on Behçet's disease.
Related Concept Videos
Statistical Software for Data Analysis and Clinical Trials
Survival Tree
Building a Survival Tree
Constructing a...
Classification of Illness
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
Pedigree Analysis
