Related Experiment Video
Updated: Sep 17, 2025
05:47
Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
587
Automating content analysis of scientific abstracts using ChatGPT: A methodological protocol and use case
Adrián Domínguez-Diaz1, Manuel Goyanes2, Luis de-Marcos1
1Computer Science, Universidad de Alcalá, Madrid, Spain.
Methodsx
|July 4, 2025
Summary
This study introduces a protocol for using ChatGPT in content analysis, showing AI can improve coding efficiency. Clear definitions are crucial for AI accuracy, especially in complex research methods.
Area of Science:
- Artificial Intelligence
- Computational Social Science
- Research Methodology
Background:
- Content analysis is a crucial research method.
- Manual content analysis can be time-consuming and resource-intensive.
- The integration of Artificial Intelligence (AI) offers potential for automating and enhancing research processes.
Purpose of the Study:
- To present a validated protocol for employing ChatGPT in content analysis.
- To assess the efficacy and limitations of AI-driven content analysis.
- To explore the impact of methodological clarity on AI performance in research.
Main Methods:
- A structured protocol was developed to convert codebooks into AI-readable prompts for ChatGPT.
- The protocol was validated by analyzing 980 research articles to identify research approaches and data collection methods.
- Performance was evaluated using quantitative metrics, comparing AI results against established coding standards.
Main Results:
- ChatGPT demonstrated high accuracy in identifying data collection methods.
- Performance varied by research methodology: quantitative (0.96), qualitative (0.82), and mixed methods (0.60).
- Challenges were identified with poorly defined, underrepresented, or hierarchically complex categories.
Conclusions:
- The developed protocol enhances coding efficiency and shows AI's feasibility for content analysis.
- Clear methodological definitions are essential for optimizing AI performance, particularly in mixed-methods research.
- AI tools like ChatGPT show substantial potential for streamlining research coding, supported by interrater reliability metrics.
Keywords:
ChatGPTContent Analysis using ChatGPTContent analysisData collection methodLarge language modelProtocolResearch approachScientific abstractsMore Related Videos
Related Concept Videos
00:56Extraction: Advanced Methods
545
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
545
01:11Statistical Analysis: Overview
7.4K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
7.4K
02:22Overview of Advanced Functional Groups
25.8K
Functional groups are groups of atoms with specific chemical properties that occur within organic molecules and are sometimes denoted as “R”. Functional groups can “functionalize” a compound by enabling it to adopt different physical and chemical properties.
Types of Advanced Functional Groups
The table below summarizes some of the major functional groups in organic chemistry.
25.8K
01:07Scanning Electron Microscopy
4.4K
A scanning electron microscope (SEM) is used to study the surface features of a sample by using an electron beam that scans the sample surface in a two-dimensional manner. Typically, areas between ~1 centimeter to 5 micrometers in width can be imaged. SEM can be used to image bacteria, viruses, tissues as well as larger samples like insects. Conventional SEM gives a magnification ranging from 20X to 30,000X and spatial resolution of 50 to 100 nanometers.
Fundamental Principles
Accelerated...
Fundamental Principles
Accelerated...
4.4K
01:13Mass Analyzers: Overview
817
The mass analyzer is a crucial component of the mass spectrometer. In the ionization chamber, the vaporized sample is bombarded with a high-energy electron beam to generate a radical cation and further fragment into neutral molecules, radicals, and cations. A series of negatively charged accelerator plates accelerate the cations into the mass analyzer. The mass analyzer separates ions according to their mass-to-charge (m/z) ratios and then directs them to the detector. The common types of mass...
817
01:11Regression Analysis
6.1K
Regression analysis is a statistical tool that describes a mathematical relationship between a dependent variable and one or more independent variables.
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
In regression analysis, a regression equation is determined based on the line of best fit– a line that best fits the data points plotted in a graph. This line is also called the regression line. The algebraic equation for the regression line is called the regression equation. It is represented as:
6.1K