Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Data Validation

Data Validation

Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Can Generative Artificial Intelligence Reliably Score Open-Ended Question Assessments in Undergraduate Medical Education?

Medical science educator·2026

Same author

Correction: A Mixed Reality-Based Telesupervised Ultrasound Education Platform on 5G Network Compared to Direct Supervision: Prospective Randomized Pilot Trial.

JMIR serious games·2025

Same author

A Mixed Reality-Based Telesupervised Ultrasound Education Platform on 5G Network Compared to Direct Supervision: Prospective Randomized Pilot Trial.

JMIR serious games·2025

Same author

Adoption of Augmented Reality in Educational Programs for Nurses in Intensive Care Units of Tertiary Academic Hospitals: Mixed Methods Study.

JMIR serious games·2024

Same author

Incidence and Mortality Trends in Critically Ill Children: A Korean Population-Based Study.

Journal of Korean medical science·2023

Same author

Trends in Incidences and Survival Rates in Pediatric In-Hospital Cardiopulmonary Resuscitation: A Korean Population-Based Study.

Journal of the American Heart Association·2023

Search research articles

Related Experiment Video

Updated: Jun 14, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Advancing Clinical Chatbot Validation Using AI-Powered Evaluation With a New 3-Bot Evaluation System: Instrument

Seungheon Choo¹, Suyoung Yoo², Kumiko Endo³

¹Research Institute for Future Medicine, Samsung Medical Center, Seoul, Republic of Korea.

|February 27, 2025

Summary

A new 3-bot method efficiently tests artificial intelligence (AI) health chatbots safely. This AI evaluation approach ensures accuracy and reliability, addressing healthcare workforce shortages by automating tasks.

Keywords:

accurate anxiety anxious artificial intelligence automation bots chatbots communication computer computer-assisted conversational agents depression depressive emotional emotions empathetic empathy frustrated frustration interactions nervous nervousness patient education relationships therapy understandability understandable

More Related Videos

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

Related Experiment Videos

Last Updated: Jun 14, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

Area of Science:

Healthcare Technology
Artificial Intelligence
Medical Informatics

Background:

The healthcare sector faces a significant workforce shortage projected by 2030.
Artificial intelligence (AI) offers a strategic solution for automating tasks like patient education and screening.
Current AI chatbot evaluation methods are limited by safety concerns and resource intensity.

Purpose of the Study:

Introduce a novel 3-bot method for efficient testing of early-stage AI healthcare chatbots.
Validate AI chatbots without involving real patients or researchers.
Develop AI patient and evaluator bots for comprehensive testing.

Main Methods:

AI provider bots interacted with AI patient bots simulating various emotional states.
An AI evaluator bot assessed interaction transcripts against predefined criteria.
Human experts reviewed transcripts, and results were compared to the AI evaluator's for accuracy.

Main Results:

AI and human evaluations of patient-education bots showed nearly identical results.
AI and human evaluations of screening bots also yielded highly similar outcomes.
Statistical analysis confirmed the reliability and accuracy of the AI evaluation method.

Conclusions:

The 3-bot method provides a safe, adaptable, and effective way to test healthcare AI chatbots.
This approach reduces risks to patient safety and conserves researcher time and effort.
Future enhancements, like retrieval augmented generation, can further improve AI chatbot evaluation specificity and accuracy.