Related Experiment Video
Updated: May 15, 2026

Comparing Bibliometric Analysis Using PubMed, Scopus, and Web of Science Databases
Published on: October 24, 2019
[How to read critically a scientific paper]
Pavel Mohr1, Cyril Höschl, Jan Volavka
1Psychiatricke centrum Praha. mohr@pcp.lf3.cuni.cz
Background:
Effort to follow the development in various fields of medicine is being hindered by enormous growth of information output. The vast amount of data makes it difficult to figure out what is really important. Psychiatrists and other physicians tend to read scientific papers superficially, relying excessively on abstracts. We addressed this problem by teaching critical appraisal of individual articles.
Methods:
We developed a 23-item appraisal instrument to assess various aspects of papers on psychopharmacology. The appraisal form was used to evaluate individual articles during a series of workshops with psychiatric trainees. The results were collected with an electronic voting system and subsequently discussed with experienced tutors who also provided key ratings.
Results:
The total of 58 trainees participated at three workshops, six publications were analyzed. Evaluation of the papers yielded heterogeneous results reflecting variations of the participants theoretical background as well as varied quality of the publications. We present detailed analysis of one paper as an illustrative example.
Conclusions:
Our experience showed that the discussion format and the voting system with immediate feedback stimulate active involvement of the participants. Administration of the structured appraisal instrument that can be easily adapted for other medical publications may enhance understanding and critical appraisal of scientific texts.
Related Concept Videos
The Scientific Method
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...
The Scientific Method
The Scientific Method
Statistical Significance
Critical Region, Critical Values and Significance Level
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the test...
Scientific Nature of Social Psychology

