Assessment methods in graduate medical education in critical care: a scoping review

As critical care medical education advances within a competency-based framework, effective assessment strategies are essential to ensure trainees acquire the necessary skills for high-stakes situations. Despite growing interest, assessment practices remain inconsistent, with significant variations in their application, although conceptual and technological innovations support this process. This scoping review aimed to map the literature on innovation in assessment within graduate and fellowship critical care medical education.

Following the Joanna Briggs Institute framework and PRISMA-ScR, a search of four databases (PubMed, Scopus, Web of Science, and LILACS) was conducted for articles published from January 2014 to June 2025.

Sixty-eight peer-reviewed articles were analyzed across four domains: assessment methods and tools, competency frameworks, innovation and technology, and ethics in assessment. Assessment in critical care is shifting toward a structured, multimodal, formative, and longitudinal model. Commonly used tools include workplace-based assessments and simulations. Milestones and entrustable professional activities are increasingly used to support entrustment decisions and track progress. Technology-enhanced strategies, including high-fidelity simulations, mobile apps, and artificial intelligence, improve feedback quality and real-time assessment. Ethical challenges, especially rater bias, underassessment of professionalism, and inequities, remain persistent concerns, highlighting the importance of fairness and transparency in evaluation.

Graduate critical care assessment is advancing towards a programmatic, multidimensional model that integrates clinical and professional competencies. Emerging frameworks and digital platforms support more equitable, formative, and trustworthy evaluations. Future efforts should focus on standardization, bias, and ethical practices throughout the assessment continuum.