Related Experiment Video
Updated: Jul 5, 2026

Tools for the Real-Time Assessment of a Pseudomonas aeruginosa Infection Model
Published on: April 6, 2021
Diagnosis Unreliability of ChatGPT for Journal Evaluation
Mehdi Dadkhah1,2, Marilyn H Oermann3, Mihály Hegedüs4
1Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Amritapuri, Kerala, India.
Purpose:
Academic and other researchers have limited tools with which to address the current proliferation of predatory and hijacked journals. These journals can have negative effects on science, research funding, and the dissemination of information. As most predatory and hijacked journals are not error free, this study used ChatGPT, an artificial intelligence (AI) technology tool, to conduct an evaluation of journal quality.
Methods:
Predatory and hijacked journals were analyzed for reliability using ChatGPT, and the reliability of result have been discussed.
Results:
It shows that ChatGPT is an unreliable tool for journal quality evaluation for both hijacked and predatory journals.
Conclusion:
To show how to address this gap, an early trial version of Journal Checker Chatbot has been developed and is discussed as an alternative chatbot that can assist researchers in detecting hijacked journals.
Related Concept Videos
Reliability and Validity
Errors In Hypothesis Tests
Accuracy, limits, and approximation
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Detection of Gross Error: The Q Test
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...

