Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Clinical Trials01:16

Clinical Trials

6.6K
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
6.6K
Introduction to Documentation and Reporting01:20

Introduction to Documentation and Reporting

1.9K
Documentation is the systematic process of formally recording, maintaining, and communicating information.
Nursing documentation records essential information and details regarding a patient's care and treatment in written or electronic form. It is a critical aspect of nursing practice that involves documenting assessments, interventions, outcomes, and other relevant details about a patient's health status.
Documentation maps the patient's health journey by creating a comprehensive...
1.9K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

110
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
110
Guidelines for Nursing Documentation I01:30

Guidelines for Nursing Documentation I

1.0K
Quality documentation and reporting share essential characteristics that ensure they are practical and valuable resources for those who use them. These characteristics are:
Factual:  
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
1.0K
Data Reporting and Recording01:24

Data Reporting and Recording

4.6K
Reporting and recording are crucial in data documentation. The timely, thorough, and accurate documentation of facts is essential when recording patient data. Failure to record findings during an assessment or interpretation of a problem will result in loss of information and make the patient document unreliable. The reader is left with general impressions if the information is not specific. A recording is documenting data of the individual's health information in a traceable, secure, and...
4.6K
Blind Procedures02:07

Blind Procedures

10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Infection prevention and control measures for Ebola and Marburg disease: a series of rapid reviews.

BMJ open·2026
Same author

Co-Creating an Intervention to Prevent Injuries in Police Force Recruits: A Concept Mapping Study of Police Force Recruits, Police Force Staff, Health Professionals, and Research Experts.

Sports medicine - open·2026
Same author

The data transparency crisis in research: Lessons from systematic reviews and meta-analyses.

PLoS medicine·2026
Same author

Reporting of Cohort and Routinely Collected Data in Randomised Controlled Trial Protocols (SPIRIT-ROUTINE): extension checklist with explanation and elaboration.

BMJ (Clinical research ed.)·2026
Same author

Does resistance training make a difference to the quality of life or heart health for older adults compared to aerobic exercise? A systematic review protocol from The People's Review.

PloS one·2026
Same author

What are the characteristics and impacts of a patient-led conference? A qualitative study.

BMJ open·2026

Related Experiment Video

Updated: May 21, 2025

Using Continuous Data Tracking Technology to Study Exercise Adherence in Pulmonary Rehabilitation
09:42

Using Continuous Data Tracking Technology to Study Exercise Adherence in Pulmonary Rehabilitation

Published on: November 8, 2013

13.4K

GPT for RCTs? Using AI to determine adherence to clinical trial reporting guidelines.

James G Wrightson1, Paul Blazey2, David Moher3

  • 1Department of Physical Therapy, The University of British Columbia Faculty of Medicine, Vancouver, British Columbia, Canada.

BMJ Open
|March 19, 2025
PubMed
Summary
This summary is machine-generated.

Large language models (AI-LLMs) show promise in evaluating clinical trial reporting guideline adherence. GPT-4 achieved 90% accuracy, while fine-tuned Llama 2 reached 83% accuracy in sports medicine trials.

Keywords:
Machine LearningSPORTS MEDICINESTATISTICS & RESEARCH METHODS

More Related Videos

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

413
The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
06:05

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time

Published on: February 19, 2021

1.2K

Related Experiment Videos

Last Updated: May 21, 2025

Using Continuous Data Tracking Technology to Study Exercise Adherence in Pulmonary Rehabilitation
09:42

Using Continuous Data Tracking Technology to Study Exercise Adherence in Pulmonary Rehabilitation

Published on: November 8, 2013

13.4K
Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

413
The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
06:05

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time

Published on: February 19, 2021

1.2K

Area of Science:

  • Medical research methodology
  • Artificial intelligence in healthcare
  • Clinical trial reporting standards

Background:

  • Adherence to reporting guidelines is crucial for clinical trial quality.
  • Previous attempts to improve adherence have yielded inconsistent results.
  • AI-LLMs offer a potential new approach to assess reporting guideline compliance.

Purpose of the Study:

  • To evaluate the accuracy of AI-LLMs in determining reporting guideline compliance.
  • To assess the performance of OpenAI GPT-4 and Meta Llama 2 models.
  • To analyze compliance in sports medicine and exercise science clinical trial reports.

Main Methods:

  • Retrospective data analysis of 113 clinical trial reports.
  • Utilized OpenAI GPT-4 Turbo, GPT-4 Vision, and Meta Llama 2 70B models.
  • Models were prompted to answer reporting guideline questions; Llama 2 was fine-tuned.

Main Results:

  • GPT-4 Turbo achieved 90% accuracy (F1-score=0.89) for article text.
  • Fine-tuned Llama 2 achieved 83% accuracy (F1-score=0.84).
  • GPT-4 Vision achieved 100% accuracy for participant flow diagrams but struggled with missing details (57% accuracy).

Conclusions:

  • Both GPT-4 and fine-tuned Llama 2 demonstrate potential for assessing reporting guideline adherence.
  • Further development of efficient, open-source AI-LLMs is recommended.
  • Methods to enhance AI-LLM accuracy in this domain require further exploration.