Related Experiment Video
Updated: Jan 17, 2026
10:26
Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
4.4K
ChatGPT's progress over time: A longitudinal enhancing biostatistical problem-solving in medical education
Aleksandra Ignjatović1,2, Marija Anđelković Apostolović1,2, Lazar Stevanović3
1Department of Medical Statistics and Informatics, Faculty of Medicine, University of Niš, Niš, Serbia.
Health Informatics Journal
|September 19, 2025
Summary
ChatGPT showed significant improvements in solving biostatistics problems over nine months. GPT-4 achieved perfect accuracy, suggesting its potential as a supplementary educational tool in medical training.
Area of Science:
- Biostatistics
- Medical Education
- Artificial Intelligence in Higher Education
Background:
- ChatGPT is recognized for its potential to transform higher education by improving teaching and learning.
- Previous evaluations have acknowledged ChatGPT's capabilities in educational settings.
- This study specifically assesses ChatGPT's utility in biostatistics education.
Purpose of the Study:
- To evaluate the accuracy, stability, and reproducibility of ChatGPT (GPT-3.5 and GPT-4) in solving biostatistical problems.
- To explore ChatGPT's potential as a reliable educational tool for medical students.
- To track the performance evolution of ChatGPT models over a nine-month period.
Main Methods:
- The correlation analysis task from "Statistics at Square One" was used as the benchmark biostatistical problem.
- GPT-3.5 and GPT-4 were tested for accuracy across 12 parameters.
- Performance was evaluated across three time points: October 2023, March 2024, and July 2024.
Main Results:
- Both GPT-3.5 and GPT-4 demonstrated statistically significant improvements in correct response rates over the study period (p < 0.001).
- GPT-4 achieved perfect accuracy by March 2024.
- Significant performance gains were observed for GPT-3.5 between March and July 2024, and for GPT-4 between October 2023 and March 2024.
Conclusions:
- GPT-4 exhibited rapid and consistent improvement in biostatistical problem-solving over nine months.
- ChatGPT's advancements highlight its growing potential in educational applications.
- ChatGPT should be utilized as a supplementary tool in higher education, under educator supervision, to enhance learning.
More Related Videos
13:44Project-Based Learning Guidelines for Health Sciences Students: An Analysis with Data Mining and Qualitative Techniques
Published on: December 9, 2022
4.2K
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
8.0K
Related Concept Videos
01:19Overview of Biostatistics in Health Sciences
4.7K
Biostatistics involves the application of statistical techniques to scientific research in health-related fields, including biology and public health. These techniques are essential for designing studies, collecting data, and analyzing it to draw meaningful conclusions. Given the complexity of biological processes, particularly in studies involving human subjects, biostatistical methods are crucial for effectively organizing and interpreting data that might otherwise obscure underlying patterns...
4.7K
01:20Biostatistics: Overview
732
Biostatistics plays a crucial role in understanding and analyzing data in healthcare and biology. Biostatisticians conduct experiments, gather evidence, and draw meaningful conclusions using statistical methods and techniques. Different variables form the foundation of biostatistical analysis, allowing researchers to understand and interpret data effectively. These variables are classified into different types, each serving a specific purpose in statistical analysis.
Discrete variables are...
Discrete variables are...
732
01:26Longitudinal Studies
481
Longitudinal studies are also widely used in other medical and social science fields. For instance, in cardiovascular research, they can monitor patients' health over decades to identify risk factors for heart disease, such as high cholesterol or smoking, and evaluate the long-term effectiveness of preventive measures. Similarly, in mental health studies, researchers might follow individuals from adolescence into adulthood to understand the development and progression of conditions like...
481
01:12Statistical Software for Data Analysis and Clinical Trials
1.4K
Statistical software is pivotal in data analysis and clinical trials by providing tools to analyze data, draw conclusions, and make predictions. These software packages range from simple data management applications to complex analytical platforms, supporting various statistical tests, models, and simulation techniques. Their significance lies in their ability to handle vast amounts of data with precision and efficiency, enabling researchers to validate hypotheses, identify trends, and make...
1.4K
01:18Introduction To Survival Analysis
752
Survival analysis is a statistical method used to study time-to-event data, where the "event" might represent outcomes like death, disease relapse, system failure, or recovery. A unique feature of survival data is censoring, which occurs when the event of interest has not been observed for some individuals during the study period. This requires specialized techniques to handle incomplete data effectively.
The primary goal of survival analysis is to estimate survival time—the time...
The primary goal of survival analysis is to estimate survival time—the time...
752
02:20Longitudinal Research
13.1K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
13.1K