Related Experiment Videos
[Testing critical reading of medical journal articles: reliability and validity]
Patrice François1, Laurent Boyer, Laurence Nuiry
1Unité d'Evaluation Médicale, Pavillon Taillefer, CHU, Grenoble. pfrancois@chu-grenoble.fr
Objectives:
The aim of this study was to assess the reliability and validity of tests assessing medical students' ability to read medical journal articles critically.
Methods:
All third-year students at our medical school (n=125) took three tests between December 2004 and June 2005 as part of a program to teach critical appraisal of medical literature. Each test required students to write a 250-word structured abstract and to answer a set of 6 to 8 appraisal questions. Interrater reliability was assessed with the intra-class correlation coefficient for the first test. Validity was assessed 1) by calculating the correlation coefficient between the mean scores on the three critical appraisal tests and 2) by calculating the correlation coefficient between these tests and eight other tests in other subjects that the students took over the same period.
Results:
Interrater reliability was satisfactory for the overall score (ICC=0.72) and for the score for the questions alone (ICC=0.73). It was only moderate, however, for the structured abstract test (ICC=0.53) and varied markedly from question to question (ICC range: 0.29-0.86). Intertest correlations were all statistically significant (p<0.001) and the mean score on the critical reading tests was significantly correlated with the mean score on the tests for other subjects that year (r=0.60; p<0.001).
Conclusion:
The validity and reliability of the tests of critical reading of medical literature are satisfactory but can be improved by developing more explicit scoring templates.
Related Concept Videos
Reliability and Validity
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Data Validation
Key parameters for method validation include:
Bias in Epidemiological Studies
Errors occurring during blood pressure monitoring
Several factors...