Validation studies of Japanese administrative health care data: A scoping review

Large-scale administrative health care databases are increasingly being utilized for research. However, there has not been much literature that validated administrative data in Japan; a previous review identified six validation studies published between 2011 and 2017. We conducted a literature review of studies that assessed the validity of Japanese administrative health care data.

We searched for studies published by March 2022 that compared individual-level administrative data with a reference standard from another data source, as well as studies that validated administrative data using other data within the same database. The eligible studies were also summarized based on characteristics which included data types, settings, reference standard used, numbers of patients, and conditions validated.

There were 36 eligible studies, including 29 that used external reference standard and seven that validated administrative data using other data within the same database. Chart review was the reference standard in 21 studies (range of the numbers of patients, 72-1674; 11 studies conducted in single institutions and nine studies in 2-5 institutions). Five studies used a disease registry as the reference standard. Diagnoses of cardiovascular diseases, cancer, and diabetes were frequently evaluated.

Validation studies are being conducted at an increasing rate in Japan, although most of them are small scale. Further large-scale comprehensive validation studies are necessary to effectively utilize the databases for research.