Related Experiment Video
Updated: Jun 13, 2026

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Revenue-sensitive evaluation of AI-assisted ICD-10-CM coding and human-AI collaboration under dual DRG payment
Ming-I Chen1, Ying-Lin Hsu2, Yi-Hsin Chen3,4,5
1Doctoral Program in Big Data Analytics for Industrial Applications, National Chung Hsing University, Taichung, Taiwan.
Abstract:
Automated ICD-10-CM coding is critical for hospital reimbursement under Diagnosis-Related Group (DRG) payment systems, yet standard metrics weight all errors equally. This study evaluated 11 models on MIMIC-IV under heterogeneous conditions (the full 7942-code space, top-50 self-trained baselines, and 200-admission zero-shot LLM samples) and proposed two revenue-sensitive metrics: the Revenue Sensitivity Index (RSI) and Coding Reimbursement Score (CRS). Performance was compared across US Medicare Severity DRG (MS-DRG) and Taiwan DRG (Tw-DRG) systems, with five human-AI review strategies simulated. PLM-ICD achieved the highest micro-averaged F1 (0.5934), while open-source zero-shot LLMs performed markedly worse in this exploratory comparison. A 26.5% CRS gap separated the best and worst fine-tuned models. Rankings were identical under both DRG schemes (Spearman ρ = 1.00), indicating stability under a tiered Tw-DRG approximation (93.9% coverage), not the official grouper. At a 20% review rate, revenue-targeted prioritization achieved 43.2% CRS reduction versus 20.0% for random sampling, reaching 91% of the oracle bound. Revenue-aware evaluation captures financially meaningful differences missed by standard metrics, and revenue-guided human-AI collaboration emerges as a candidate deployment framework requiring prospective validation.
Related Concept Videos
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Integrated Healthcare System