Related Experiment Video
Updated: May 27, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Peer review of grant applications: a simple method to identify proposals with discordant reviews
Bruno Giraudeau1, Clémence Leyrat, Amélie Le Gouge
1Institut National de la Santé et de la Recherche Médicale, Tours, France. giraudeau@med.univ-tours.fr
Abstract:
Grant proposals submitted for funding are usually selected by a peer-review rating process. Some proposals may result in discordant peer-review ratings and therefore require discussion by the selection committee members. The issue is which peer-review ratings are considered as discordant. We propose a simple method to identify such proposals. Our approach is based on the intraclass correlation coefficient, which is usually used in assessing agreement in studies with continuous ratings.
Related Concept Videos
Quantifying and Rejecting Outliers: The Grubbs Test
Proofreading
Feedback Inhibition
Causes of Similarity-Dissimilarity Effect
Review and Preview
Percentiles are a type of fractile that partition data into...
Review and Preview
