Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Leaky Scanning02:28

Leaky Scanning

5.1K
During most eukaryotic translation processes, the small 40S ribosome subunit scans an mRNA from its 5' end until it encounters the first start AUG codon. The large 60S ribosomal subunit then joins the smaller one to initiate protein synthesis. The location of the translation initiation is largely determined by the nucleotides near the start codon as there may be multiple translation initiation sites present on the mRNA.  Marilyn Kozak discovered that the sequence RCCAUGG (where R...
5.1K
Genetic Lingo01:11

Genetic Lingo

102.2K
Overview
102.2K
Viral Mutations00:36

Viral Mutations

32.2K
A mutation is a change in the sequence of bases of DNA or RNA in a genome. Some mutations occur during replication of the genome due to errors made by the polymerase enzymes that replicate DNA or RNA. Unlike DNA polymerase, RNA polymerase is prone to errors because it is not capable of “proofreading” its work. Viruses with RNA-based genomes, like HIV, therefore accrue mutations faster than viruses with DNA-based genomes. Because mutation and recombination provide the raw material...
32.2K
Evolutionary Relationships through Genome Comparisons02:54

Evolutionary Relationships through Genome Comparisons

5.7K
Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...
5.7K
  1. Home
  3. Research Domains
  5. Information And Computing Sciences
  7. Artificial Intelligence
  9. Natural Language Processing
  11. The Performance Of Openai Chatgpt-4 And Google Gemini In Virology Multiple-choice Questions: A Comparative Analysis Of English And Arabic Responses.
  1. Home
  3. Research Domains
  5. Information And Computing Sciences
  7. Artificial Intelligence
  9. Natural Language Processing
  11. The Performance Of Openai Chatgpt-4 And Google Gemini In Virology Multiple-choice Questions: A Comparative Analysis Of English And Arabic Responses.

Related Experiment Video

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

523

The performance of OpenAI ChatGPT-4 and Google Gemini in virology multiple-choice questions: a comparative analysis of English and Arabic responses.

Malik Sallam1,2, Kholoud Al-Mahzoum3, Rawan Ahmad Almutawaa3

  • 1Department of Pathology, Microbiology and Forensic Medicine, School of Medicine, The University of Jordan, Amman, 11942, Jordan. malik.sallam@ju.edu.jo.

BMC Research Notes
|September 3, 2024

View abstract on PubMed

Summary
This summary is machine-generated.

Generative artificial intelligence (AI) tools like ChatGPT-4 and Gemini show promise in healthcare education, but performance varies by language. ChatGPT-4 generally outperformed Gemini in answering virology questions in both English and Arabic.

More Related Videos

In Vitro Selection of Aptamers to Differentiate Infectious from Non-Infectious Viruses
12:23

In Vitro Selection of Aptamers to Differentiate Infectious from Non-Infectious Viruses

Published on: September 7, 2022

1.6K
Preparation of Pseudo-Typed H5 Avian Influenza Viruses with Calcium Phosphate Transfection Method and Measurement of Antibody Neutralizing Activity
07:15

Preparation of Pseudo-Typed H5 Avian Influenza Viruses with Calcium Phosphate Transfection Method and Measurement of Antibody Neutralizing Activity

Published on: November 22, 2021

2.2K

Related Experiment Videos

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

523
In Vitro Selection of Aptamers to Differentiate Infectious from Non-Infectious Viruses
12:23

In Vitro Selection of Aptamers to Differentiate Infectious from Non-Infectious Viruses

Published on: September 7, 2022

1.6K
Preparation of Pseudo-Typed H5 Avian Influenza Viruses with Calcium Phosphate Transfection Method and Measurement of Antibody Neutralizing Activity
07:15

Preparation of Pseudo-Typed H5 Avian Influenza Viruses with Calcium Phosphate Transfection Method and Measurement of Antibody Neutralizing Activity

Published on: November 22, 2021

2.2K

Area of Science:

  • Medical Education
  • Artificial Intelligence in Healthcare
  • Computational Linguistics

Background:

  • The integration of artificial intelligence (AI) into healthcare education is rapidly advancing.
  • Evaluating the multilingual capabilities of generative AI is essential for global educational applications.
  • Assessing AI performance in specialized fields like virology is crucial for curriculum development.

Purpose of the Study:

  • To compare the performance of ChatGPT-4 and Gemini in answering virology multiple-choice questions (MCQs) in English and Arabic.
  • To evaluate the correctness and quality of AI-generated content using the CLEAR tool.
  • To analyze AI performance across different cognitive levels based on Bloom's taxonomy.

Main Methods:

  • 40 virology MCQs were administered to ChatGPT-4 and Gemini in English and Arabic.
  • Responses were assessed for correctness and quality using the CLEAR evaluation tool.
  • MCQs were categorized according to the revised Bloom's taxonomy (lower vs. higher cognitive levels).
  • Study design adhered to the METRICS checklist for AI-based research in healthcare.

    • Main Results:

    • Both AI models performed better in English than in Arabic.
    • ChatGPT-4 consistently outperformed Gemini in correctness and CLEAR scores across both languages.
    • ChatGPT-4 achieved 80% correctness in English vs. 62.5% for Gemini; Arabic scores were 65% vs. 55% respectively.
    • Both models demonstrated superior performance in lower cognitive domain questions compared to higher cognitive ones.

    Conclusions:

    • ChatGPT-4 and Gemini show potential for educational applications in virology.
    • Performance disparities across languages highlight the need for further AI development for equitable global integration.
    • Continued research is necessary to optimize AI tools for diverse linguistic and educational contexts in healthcare.