Jove
Visualize
Contact Us

Related Concept Videos

Random and Systematic Errors01:20

Random and Systematic Errors

11.0K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
11.0K
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

1.5K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.5K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

220
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
220
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.2K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.2K
Types of Errors: Detection and Minimization01:12

Types of Errors: Detection and Minimization

1.7K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
1.7K
Random Error01:04

Random Error

923
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
923

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Comparing conventional and alternative mechanisms of discovering and accessing the scientific literature.

Proceedings of the National Academy of Sciences of the United States of America·2025
Same author

The impact of free access to the scientific literature: a review of recent research.

Journal of the Medical Library Association : JMLA·2011
Same author

Disciplinary perspectives on later-life migration in the core journals of social gerontology.

The Gerontologist·2003
See all related articles
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jul 17, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

267

Fabrication and errors in the bibliographic citations generated by ChatGPT.

William H Walters1, Esther Isabelle Wilder2,3

  • 1Mary Alice & Tom O'Malley Library, Manhattan College, Riverdale, NY, USA. william.walters@manhattan.edu.

Scientific Reports
|September 7, 2023
PubMed
Summary

ChatGPT-4 significantly reduces fabricated citations compared to ChatGPT-3.5, but both AI language models still produce errors in scholarly literature reviews.

More Related Videos

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases
05:02

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases

Published on: October 24, 2019

31.5K
gP2S, an Information Management System for CryoEM Experiments
13:01

gP2S, an Information Management System for CryoEM Experiments

Published on: June 10, 2021

5.4K

Related Experiment Videos

Last Updated: Jul 17, 2025

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

267
Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases
05:02

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases

Published on: October 24, 2019

31.5K
gP2S, an Information Management System for CryoEM Experiments
13:01

gP2S, an Information Management System for CryoEM Experiments

Published on: June 10, 2021

5.4K

Area of Science:

  • Artificial Intelligence
  • Bibliometrics
  • Scholarly Communication

Background:

  • Large language models (LLMs) like ChatGPT offer efficient text generation but are prone to factual inaccuracies, known as hallucinations.
  • A critical hallucination type is the fabrication of non-existent scholarly citations, undermining research integrity.

Purpose of the Study:

  • To evaluate the prevalence of fabricated bibliographic citations generated by ChatGPT-3.5 and ChatGPT-4.
  • To assess the accuracy of non-fabricated citations and adherence to citation standards in AI-generated literature reviews.

Main Methods:

  • ChatGPT-3.5 and ChatGPT-4 were prompted to generate literature reviews across 42 diverse topics.
  • A total of 636 citations from 84 generated papers were systematically verified for fabrication and accuracy across multiple databases.
  • Adherence to the American Psychological Association (APA) citation format was also assessed.

Main Results:

  • ChatGPT-3.5 produced fabricated citations in 55% of instances, with 43% of real citations containing errors.
  • ChatGPT-4 demonstrated substantial improvement, with only 18% of citations being fabricated and 24% of real citations containing errors.
  • Despite advancements, both models exhibit significant citation inaccuracies.

Conclusions:

  • ChatGPT-4 represents a considerable improvement over ChatGPT-3.5 in generating accurate bibliographic citations.
  • Ongoing challenges with AI-generated citations necessitate careful verification in academic and research contexts.
  • Further development is required to enhance the reliability of LLMs for scholarly writing.