Related Experiment Video
Updated: Sep 19, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Enhancing reliability in portfolio assessment: discussions between assessors
John Pitts1, Colin Coles, Peter Thomas
1NHS Executive South East Region (Wessex Deanery) Winchester, King Alfred's College Winchester, UK. jpitts@chilgrove.u-net.com
Abstract:
This paper reports the reliability in assessments of a series of portfolios assembled by a cohort of participants attending a course for prospective general practice trainers. Initial individual assessments are compared with open discussion between random pairs of assessors to produce paired composite scores, and analysed using kappa statistics. Overall reliability of a global pass/refer judgement improved from a kappa of 0.26 (fair) using individual assessment, to 0.5 (moderate) with paired discussants.
Related Concept Videos
Reliability and Validity
Self-Evaluation: Self-Enhancement and Self-Verification
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Self-Evaluation Maintenance Model
Halo Effect
Equity Theory
