Related Experiment Videos
Development and evaluation of a quality score for abstracts
Antje Timmer1, Lloyd R Sutherland, Robert J Hilsden
1Department of Internal Medicine I, University of Regensburg, 93042 Regensburg, Germany. antje.timmer@klinik.uni-regensburg.de
BMC Medical Research Methodology
|February 13, 2003
Summary
A new quality index improves the evaluation of scientific meeting abstracts, showing good reliability and validity. This tool enhances abstract assessment and aids in presentation acceptance.
Area of Science:
- Scientific Communication
- Medical Education
Background:
- Evaluating scientific meeting abstracts often lacks consistent scoring.
- Poor inter-observer reliability affects abstract quality assessment.
Purpose of the Study:
- To develop a standardized measure for assessing the formal quality of scientific abstracts.
- To improve the reliability and validity of abstract evaluation.
Main Methods:
- A 19-item index was created based on scoring systems for full reports and structured abstract guidelines.
- Interrater agreement was assessed using 100 American Gastroenterological Association abstracts (1992-1995).
- Construct validity was examined by correlating formal quality with acceptance for presentation.
Main Results:
- The developed index demonstrated good interrater agreement (intra-class coefficient 0.60–0.81).
- Higher abstract quality scores were significantly associated with acceptance for presentation.
- Expert reviewers found the instrument acceptable and useful.
Conclusions:
- A reliable, valid, and useful quality index for evaluating scientific meeting abstracts has been developed.
- This tool offers a standardized approach to enhance abstract assessment and selection processes.