Related Experiment Video

Updated: Feb 23, 2026

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI

Published on: November 27, 2019

Overstatements in abstract conclusions claiming effectiveness of interventions in psychiatry: A meta-epidemiological

Kiyomi Shinohara¹, Aya M Suganuma¹, Hissei Imai¹

¹Department of Health Promotion and Human Behavior, Kyoto University Graduate School of Medicine / School of Public Health, Konoe-cho, Sakyo-ku, Kyoto, Japan.

|September 14, 2017

Abstract

Objective:

Abstracts of scientific reports are sometimes criticized for exaggerating significant results when compared to the corresponding full texts. Such abstracts can mislead the readers. We aimed to conduct a systematic review of overstatements in abstract conclusions in psychiatry trials.

Methods:

We searched for randomized controlled trials published in 2014 that explicitly claimed effectiveness of any intervention for mental disorders in their abstract conclusion, using the Cochrane Register of Controlled Trials. Claims of effectiveness in abstract conclusion were categorized into three types: superiority (stating superiority of intervention to control), limited superiority (intervention has limited superiority), and equal efficactiveness (claiming equal effectiveness of intervention with standard treatment control), and full text results into three types: significant (all primary outcomes were statistically significant in favor of the intervention), mixed (primary outcomes included both significant and non-significant results), or all results non-significant. By comparing these classifications, we assessed whether each abstract was overstated. Our primary outcome was the proportion of overstated abstract conclusions.

Results:

We identified and included 60 relevant trials. 20 out of 60 studies (33.3%) showed overstatements. Nine reports reported only significant results although none of their primary outcomes were significant. Large sample size (>300) and publication in high impact factor (IF>10) journals were associated with low occurrence of overstatements.

Conclusions:

We found that one in three psychiatry studies claiming effectiveness in their abstract conclusion, either superior to control or equal to standard treatment, for any mental disorders were overstated in comparison with the full text results. Readers of the psychiatry literature are advised to scrutinize the full text results regardless of the claims in the abstract.

Trial Registration:

University hospital Medical Information Network (UMIN) Clinical Trials Registry (UMIN000018668).

More Related Videos

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Published on: May 15, 2020

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

Related Concept Videos

Bias in Epidemiological Studies

Bias in Epidemiological Studies

Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:

Introduction to Epidemiology

Introduction to Epidemiology

Epidemiology, known as the cornerstone of public health, involves studying the distribution and determinants of health-related events in defined populations and applying these insights to control health issues. This is essential for understanding how diseases spread, identifying populations at greater risk, and implementing measures to control or prevent outbreaks. Epidemiology addresses not only infectious diseases but also non-communicable conditions like cancer and cardiovascular disease,...

Confounding in Epidemiological Studies

Confounding in Epidemiological Studies

Confounding in statistical epidemiology represents a pivotal challenge, referring to the distortion in the perceived relationship between an exposure and an outcome due to the presence of a third variable, known as a confounder. This variable is associated with both the exposure and the outcome but is not a direct link in their causal chain. Its presence can lead to erroneous interpretations of the exposure's effect, either exaggerating or underestimating the true association. This...

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...

Psychosurgery

Psychosurgery

Psychosurgery, the surgical alteration or permanent removal of brain tissue to alleviate severe psychological conditions, stands as one of the most radical and controversial treatments in the history of mental health care. Its development and application have evolved significantly, marked by dramatic shifts in scientific understanding and ethical perspectives.
Historical Development of Psychosurgery
In the 1930s, Portuguese neurologist Antonio Egas Moniz introduced a surgical procedure designed...

Psychosis: Goals of Pharmacotherapy

Psychosis: Goals of Pharmacotherapy

Antipsychotic drugs are a crucial treatment method for acute and chronic psychoses, bipolar illness, and behavioral disorders. The selection of these drugs depends on several factors, including the state of the disease, clinical judgment, possible drug interactions, and the patient's sensitivity to adverse effects. In immediate scenarios, such as delirium and dementia, short-term treatment with low doses of high-potency typical or atypical agents can effectively manage symptom exacerbation.

Articles linked to this work by shared authors, journal, and citation graph.

Developing a taxonomy of supportive psychotherapy techniques: Protocol for a systematic review and qualitative content analysis.

PCN reports : psychiatry and clinical neurosciences·2026

Comparative Efficacy and Acceptability of 21 Antidepressant Drugs for the Acute Treatment of Adults With Major Depressive Disorder: A Systematic Review and Network Meta-Analysis.

Focus (American Psychiatric Publishing)·2026

Movie- and mobile-therapy without therapist involvment for patients with obsessive-compulsive disorder: Protocol for a randomized controlled trial.

PCN reports : psychiatry and clinical neurosciences·2025

Antipsychotic drugs for anorexia nervosa.

The Cochrane database of systematic reviews·2024

Motivation and hesitation of healthcare workers to work during the H1N1 influenza and COVID-19 pandemics: An exploratory single-centered repeated cross-sectional study.

PCN reports : psychiatry and clinical neurosciences·2024

The short and long-term efficacy of nurse-led interventions for improving blood pressure control in people with hypertension in primary care settings: a systematic review and meta-analysis.

BMC primary care·2024

See all related articles