[ICT in the evaluation of the quality of medical care]

The Virtual Verification Application (VVA) was developed as an information and communication technology with the potential to support the formative aspect of evaluation, reduce costs, improve productivity, and provide results and feedback immediately.

To determine the performance of the VVA in an experimental and controlled environment in the evaluation of processes and medical programs.

A process study was conducted comparing the VVA in four controlled clinical environments: Outpatient Consultation, Emergency, Operating Room, and Hospitalization, within the Simulation Center, modifying the conditions of each scenario. Additionally, the results of virtual (VV) and in-person (IP) evaluations conducted by both experts and novices in each environment and scenario were compared. The Bland-Altman method was used, and median differences were evaluated. The costs of both evaluations were also compared.

No statistically significant differences were found between scenarios (p = 0.795) or by experience (p = 0.819). In the Outpatient Consultation scenario, the difference was 0.58% (95% CI: -2.45, 1.29%); in Emergency, -0.9% (95% CI: -2.84, 1.04%); in the Operating Room, 0.19% (95% CI: -1.98, 2.36%); and in Hospitalization, there was no difference (0%, 95% CI: -7.37, 7.37%). The cost of the IP was 9.3 times higher than that of the VV.

The VVA and the IP evaluations have similar performance, with a significant reduction in costs. Therefore, it is a useful tool for evaluation and for improving the quality of medical care.