Related Experiment Video
Updated: Jun 9, 2025
12:44
The In ovo CAM-assay as a Xenograft Model for Sarcoma
Published on: July 17, 2013
25.4K
Assessment of Artificial Intelligence Chatbot Responses to Common Patient Questions on Bone Sarcoma
Kameel Khabaz1, Nicole J Newman-Hung2, Jennifer R Kallini2
1David Geffen School of Medicine at UCLA, Los Angeles, California, USA.
Journal of Surgical Oncology
|October 29, 2024
Summary
Artificial intelligence (AI) chatbots show promise in bone sarcoma care but have limitations. Current AI tools need improvement in factual accuracy and completeness for safe clinical use.
Area of Science:
- Oncology
- Medical Informatics
- Artificial Intelligence
Background:
- The clinical utility of artificial intelligence (AI) chatbots in bone sarcoma patient care remains largely unexplored.
- Understanding the risks and benefits of AI chatbots is crucial for defining their role in surgical practice.
Purpose of the Study:
- To evaluate the accuracy, balance, data basis, completeness, and empathy of AI chatbot responses regarding bone sarcoma.
- To assess the understandability and actionability of AI-generated patient education materials.
Main Methods:
- Three AI chatbots were queried with eleven questions on bone sarcoma diagnosis, treatment, and recovery.
- Responses were rated on a 5-point Likert scale for clinical accuracy metrics and quantitatively assessed for empathy and readability.
- The Patient Education Materials Assessment Tool (PEMAT) evaluated understandability and actionability.
Main Results:
- Chatbots scored well in relevance (4.24) and balance (4.09) but lower in data basis (3.77), completeness (3.68), and accuracy (3.66).
- Understandability was high (84.30%), but actionability was limited for treatment (64.58%) and recovery (60.64%) questions.
- GPT-4 showed the highest empathy (4.12), with readability scores indicating a high school reading level.
Conclusions:
- AI chatbots demonstrate potential for bone sarcoma care but face significant limitations in factual accuracy and completeness.
- Concerns regarding accessibility for patients with lower health literacy may impede the clinical adoption of current AI tools.
Related Concept Videos
01:14SBAR II: Application of SBAR
4.3K
SBAR is an effective communication tool used by healthcare professionals to communicate patient information accurately. SBAR stands for Situation, Background, Assessment, and Recommendation. For a better understanding, an example is given below.
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
4.3K
01:22Bone Marrow Sampling and Transplants
304
Bone marrow transplant is a potential cure for several diseases, including cancer and specific genetic disorders. Notably, this procedure is applicable for patients suffering from aplastic anemia, certain types of leukemia, severe combined immunodeficiency disease (SCID), Hodgkin's disease, non-Hodgkin's lymphoma, multiple myeloma, thalassemia, sickle-cell disease, and certain cancers.
The transplant begins with high doses of chemotherapy and radiation treatment, which aim to destroy...
The transplant begins with high doses of chemotherapy and radiation treatment, which aim to destroy...
304
01:29Bone Disorders
3.4K
Aging and its effect on bone remodeling is the most common cause of bone disorders. In young and healthy people, bone deposition and resorption happen at an equal rate to maintain optimal bone health.
Bone deposition is also affected by the levels of sex hormones like estrogen and testosterone that promote osteoblast activity and bone matrix synthesis. When the level of these hormones decreases due to aging, it causes a reduction in bone deposition. As a result, bone resorption by osteoclasts...
Bone deposition is also affected by the levels of sex hormones like estrogen and testosterone that promote osteoblast activity and bone matrix synthesis. When the level of these hormones decreases due to aging, it causes a reduction in bone deposition. As a result, bone resorption by osteoclasts...
3.4K
02:49Cancer Therapies
7.6K
Cancer therapies are various modes of treatment, such as surgery, radiation therapy, and chemotherapy that are administered to cancer patients.
However, cancer treatments can pose several challenges, as therapies used to kill cancer cells are generally also toxic to normal cells. Moreover, cancer cells mutate rapidly and can develop resistance to chemical agents or radiation therapy. Besides, all types of cancer cells may not respond to the same therapy. Some cancer cells respond to one...
However, cancer treatments can pose several challenges, as therapies used to kill cancer cells are generally also toxic to normal cells. Moreover, cancer cells mutate rapidly and can develop resistance to chemical agents or radiation therapy. Besides, all types of cancer cells may not respond to the same therapy. Some cancer cells respond to one...
7.6K
01:29Blood and Nerve Supply to the Bones
10.7K
Bones are dynamic organs that require a rich supply of oxygen and nutrients. Around 5% to 10% of the cardiac output supplies blood to the bones. A typical long bone has three main sources: the nutrient artery, the metaphyseal and epiphyseal arteries, and the periosteal arteries.
Nutrient Artery
The nutrient artery is the main blood vessel that enters the diaphysis via the nutrient foramen. While most long bones have only one nutrient foramen, large bones, such as the femur, may have two. This...
Nutrient Artery
The nutrient artery is the main blood vessel that enters the diaphysis via the nutrient foramen. While most long bones have only one nutrient foramen, large bones, such as the femur, may have two. This...
10.7K