Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 4, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Evaluating the Performance of Large Language Models on Palliative Care Test Questions: A Mixed Methods Study.

Isaac S Chua1,2,3, Yen-Ting Lo2, David Liu4

  • 1Department of Medicine, Division of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, Massachusetts, USA.

Journal of Palliative Medicine
|June 3, 2026
PubMed
Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Recurrent ZC3H18 mutations stabilize oncogenic endogenous retroviral RNA.

Cell reports·2026
Same author

Early Adoption of Thyroid Radiofrequency Ablation in Canada: Physician Experiences, Barriers, and Facilitators to Implementation.

Journal of otolaryngology - head & neck surgery = Le Journal d'oto-rhino-laryngologie et de chirurgie cervico-faciale·2026
Same author

Genomic, Clinical, and Spatial Predictors of Durable Response to BRAF/MEK Inhibition in <i>BRAF</i>-Mutant Melanoma.

bioRxiv : the preprint server for biology·2026
Same author

Similar performance with electrochemically deposited hydroxyapatite coating versus plasma porous spray in press-fit acetabular components for primary total hip arthroplasty: a randomised controlled study of early outcomes with DEXA.

Hip international : the journal of clinical and experimental research on hip pathology and therapy·2026
Same author

MonoUNet: A Robust Tiny Neural Network for Automated Knee Cartilage Segmentation on Point-of-care Ultrasound Devices.

Ultrasound in medicine & biology·2026
Same author

Expanding P-NET, a multi-purpose biologically informed deep learning framework.

bioRxiv : the preprint server for biology·2026
Same journal

The Compassion Algorithm: Large Language Models and the Future of Medicine.

Journal of palliative medicine·2026
Same journal

Help Is a Phone Call Away: A 24-Hour Nurse-Led Pediatric Hospice Clinical Care Line.

Journal of palliative medicine·2026
Same journal

The Role of Palliative Radiotherapy as Adjuvant Therapy for Pain Control in Pediatric Oncology Patients: A Systematic Review and Meta-Analysis.

Journal of palliative medicine·2026
Same journal

How Would Hospice Use Differ if Every Medicare Beneficiary Were in Medicare Advantage?

Journal of palliative medicine·2026
Same journal

Top Ten Tips Palliative Care Clinicians Should Know About Navigating Outpatient Opioid Prescribing.

Journal of palliative medicine·2026
Same journal

Impact of a Structured Pathway on Nausea and Vomiting Treatment in Palliative Care: A Before-After Study.

Journal of palliative medicine·2026
See all related articles
This summary is machine-generated.

Large language models (LLMs) accurately answered palliative care questions and provided better explanations than existing resources. This demonstrates LLMs

Area of Science:

  • Palliative Care Research
  • Artificial Intelligence in Medicine
  • Medical Education Technology

Background:

  • Limited understanding of large language model (LLM) capabilities in palliative care (PC).
  • Need to assess LLM performance on PC knowledge-based tasks.
  • Evaluation of LLMs for answering PC questions and explaining rationale.

Purpose of the Study:

  • To evaluate the performance of two large language models (LLMs) on palliative care (PC) knowledge-based questions.
  • To assess the quality of LLM-generated explanations for their answer choices.
  • To compare LLM-generated explanations with existing answer key explanations.

Main Methods:

  • Two LLMs were prompted to answer 25 questions from the Fast Facts Quiz.
  • LLMs provided rationale for their selected answer choices.
Keywords:
LLMschatbotlarge language modelsmixed methodspalliative care

Related Experiment Videos

Last Updated: Jun 4, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

  • Three PC educators rated and ranked LLM explanations against the Fast Facts Quiz answer key.
  • Statistical analysis using linear fixed-effect models and ordinal logistic regression.

    • Main Results:

    • Both LLMs achieved 96% accuracy in answering questions.
    • LLM-generated explanations were rated higher by reviewers than the Fast Facts Quiz explanations.
    • Reviewer feedback identified themes of perceived inaccuracies, clarity, educational value, linguistic style, and miscellaneous comments.

    Conclusions:

    • Large language models demonstrate high accuracy in answering palliative care questions.
    • LLM-generated explanations are preferable to the Fast Facts Quiz answer key.
    • LLMs show promise as tools for palliative care education and knowledge assessment.