Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Ethical Standards II01:23

Ethical Standards II

1.2K
Ethical standards are the backbone of nursing practice, guiding nurses as they interact with patients, families, and colleagues. These standards are crucial for providing safe, empathetic care centered on the patient's needs.
Nurses are entrusted with upholding various ethical principles and standards. Nurses forge solid therapeutic relationships using trust, empathy, autonomy, confidentiality, and professional competence.
Confidentiality is crucial, embodying respect for individual privacy...
1.2K
Ethics and Bioethics01:22

Ethics and Bioethics

2.6K
Ethics is a philosophical study of moral actions. Ethics attempts to determine what is valuable for individuals and society. It examines the rational justification of moral judgments and analyzes what is morally just, fair, and right. Bioethics is a sub-discipline of applied ethics that analyzes the philosophical, social, and legal issues in life sciences and medicine. Ethical theories serve as a foundation for decision-making and represent the viewpoints from which people seek direction. They...
2.6K
Ethics in Research01:56

Ethics in Research

25.3K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
25.3K
Ethical Standards I01:25

Ethical Standards I

1.4K
The American Nurses Association (ANA) created and implemented the first nationally accepted Code of Ethics for Nurses with Interpretive Statements. The Code of Ethics is a living document regularly updated by the ANA and establishes an ethical standard that is non-negotiable for nurses in all roles and settings.
The Code of Ethics provisions outline the nurse's duty to the patient, the healthcare team, the profession, and society. The Code's fundamental principles include advocacy,...
1.4K
Obedience01:08

Obedience

35.2K
According to obedience research, we may harm others under the forceful pressures of an authority figure (Milgram, 1974). How about if the inappropriate orders were delivered with less force? The increasing interdependence between nurses and physicians compelled Hofling and his colleagues to explore nurses’ reactions to a potentially harmful medical request made by the perceived authority figure, the doctor (Hofling, Brotzman, Dalrymple, Graves, & Pierce, 1966). In this situation,...
35.2K
Types of Reports III: Telephone and Verbal Reports01:26

Types of Reports III: Telephone and Verbal Reports

967
Telephone and Verbal Reports in healthcare settings are two communication methods for conveying therapeutic instructions from healthcare providers to nurses or other healthcare staff.
Here's an overview of each type:
Telephone Orders
967

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Extracting patient reported cannabis use and reasons for use from electronic health records: a benchmarking study of large language models.

medRxiv : the preprint server for health sciences·2026
Same author

The impact of increased living temperature on the cardiopulmonary response of male and female mice to benzene toluene ethylbenzene and xylene (BTEX).

Inhalation toxicology·2026
Same author

An AI-based chatbot to support health-related social needs among pediatric primary care population: Protocol for a pilot randomized controlled trial.

PloS one·2026
Same author

Toward trustworthy chatbots: a protocol for red teaming for health related conversations.

Scientific reports·2026
Same author

Socially Grounded Exemplars Improve Synthetic Conversations for Health-Related Social Needs Navigation.

medRxiv : the preprint server for health sciences·2026
Same author

An AI-Based Chatbot to Support Health-Related Social Needs among Pediatric Primary Care Population: Protocol for a Pilot Randomized Controlled Trial.

medRxiv : the preprint server for health sciences·2025

Related Experiment Video

Updated: Jan 7, 2026

The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm
06:18

The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm

Published on: October 20, 2022

2.5K

Toward Trustworthy Chatbots: A Protocol for Red Teaming for Health Related Conversations.

Syed-Amad Hussain1,2, Daniel I Jackson1,2, Ashley Lewis3

  • 1Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus OH.

Medrxiv : the Preprint Server for Health Sciences
|December 25, 2025
PubMed
Summary

Red teaming health chatbots revealed behavioral safety risks, not knowledge gaps. Multi-turn tests identified critical vulnerabilities missed by single-turn evaluations, highlighting the need for robust mitigation strategies to ensure patient safety.

More Related Videos

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

1.2K
Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
07:31

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Published on: May 15, 2020

7.5K

Related Experiment Videos

Last Updated: Jan 7, 2026

The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm
06:18

The Collective Trust Game: An Online Group Adaptation of the Trust Game Based on the HoneyComb Paradigm

Published on: October 20, 2022

2.5K
Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

1.2K
Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
07:31

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Published on: May 15, 2020

7.5K

Area of Science:

  • AI Safety and Ethics
  • Human-Computer Interaction
  • Digital Health

Background:

  • Health-related chatbots mediate sensitive conversations, posing risks beyond factual accuracy.
  • Retrieval-augmented generation (RAG) reduces hallucinations but doesn't eliminate behavioral safety and scope rule violations.
  • Adversarial testing (red teaming) is crucial for identifying pre-deployment risks in AI systems.

Purpose of the Study:

  • To describe a task-informed red-teaming protocol for health-related, patient-facing chatbots.
  • To evaluate chatbot adherence to knowledge and behavioral guidelines.
  • To assess the effectiveness of mitigation techniques against identified vulnerabilities.

Main Methods:

  • Developed a protocol with error stratification, single/multi-turn attack evaluation, and mitigation frameworks.
  • Defined Knowledge Adherence (KA) and Behavioral Adherence (BA) error categories.
  • Tested a social care chatbot using 140 single-turn and 20 multi-turn probes, evaluating two mitigations: prompt and document augmentation.

Main Results:

  • The primary risk was Behavioral Adherence (BA) failure (15% error rate), not Knowledge Adherence (KA).
  • Multi-turn tests revealed critical BA vulnerabilities (e.g., advice-seeking, user distress) missed in single-turn tests.
  • Mitigations significantly reduced errors: prompt augmentation decreased total errors by 60%, document augmentation eliminated user distress errors, and combined mitigations removed high-severity errors.

Conclusions:

  • A protocol combining single-turn breadth and multi-turn depth testing with layered mitigations improves chatbot safety.
  • The developed protocol offers a practical template for enhancing patient-facing chatbot reliability.
  • Future work should involve diverse clinical domains and larger evaluator panels.