A propaganda index for reviewing problem framing in articles and manuscripts: an exploratory study

Area of Science:

• Scientific communication
• Research methodology

Background:

• Misleading problem framing is prevalent in scientific publications.
• Identifying propaganda in research reports is crucial for maintaining scientific integrity.

Purpose of the Study:

• To evaluate the effectiveness of a novel propaganda index in enhancing the recognition of misleading problem framing.
• To assess the index's utility in identifying propaganda within randomized controlled trials (RCTs).

Main Methods:

• A 32-item propaganda index was developed based on existing literature.
• Seventeen manuscript reviewers assessed five social anxiety RCT reports for propaganda indicators.
• Reviewers re-evaluated the articles using the developed propaganda index.

Main Results:

• Propagandistic framing, including obscured alternative views and vagueness, was frequent in social anxiety RCTs (117/160 instances).
• Without the index, reviewers identified only 4.5% of propaganda indicators.
• With the index, identification accuracy rose to 64%, though some instances remained undetected.

Conclusions:

• The developed propaganda index shows promise in improving the detection of misleading framing in scientific manuscripts.
• This index could serve as a valuable supplement to established reporting guidelines like CONSORT and PRISMA.