A retrospective cohort study of differential attainment, COVID and chaos: taking the difference out of a terrible

Osian P James1,2, Katie Mellor1, Oliver Luton1

  • 1Health Education and Improvement Wales' School of Surgery, Tŷ Dysgu, Cefn Coed, Nantgarw.

Insights

Coronavirus disease 2019 (COVID-19) did not significantly impact core surgical training (CST) outcomes like Annual Review of Competency Progression Outcome (ARCPO) or Membership of the Royal College of Surgeons (MRCS) exam pass rates. However, National Training Number (NTN) appointments decreased during the pandemic.

Area of Science:

  • Medical Education
  • Surgical Training
  • Public Health

Background:

  • Core Surgical Training (CST) faced unprecedented challenges due to the COVID-19 pandemic.
  • Differential attainment in medical education requires ongoing evaluation, particularly concerning the pandemic's impact.
  • Previous hypotheses suggested COVID-19 negatively affected CST outcomes.

Purpose of the Study:

  • To evaluate the impact of COVID-19 on CST differential attainment.
  • To assess the influence of gender and ethnicity on training outcomes during the pandemic.
  • To analyze changes in Annual Review of Competency Progression Outcome (ARCPO), MRCS examination pass rates, and National Training Number (NTN) appointments.

Main Methods:

  • Retrospective cohort study of 271 anonymised CST records from a UK Statutory Education Body.
  • Analysis of primary outcome measures: ARCPO, MRCS pass rates, and NTN appointment.
  • Non-parametric statistical methods were employed using SPSS for data analysis.

Main Results:

  • No significant difference in ARCPO or MRCS pass rates between pre-COVID and peri-COVID training cohorts.
  • A notable decrease in NTN appointment rates was observed during the peri-COVID period (36.9% vs. 47.4%).
  • Multivariable analyses indicated associations between ARCPO and gender, MRCS pass and surgical theme, and NTN with specific training programmes.

Conclusions:

  • COVID-19 did not adversely affect ARCPO or MRCS pass rates in CST.
  • While NTN appointments declined, overall training outcome metrics remained resilient.
  • Differential attainment profiles showed significant variation, independent of the pandemic's direct impact on key metrics.
Abstract

Related Concept Videos

Confounding in Epidemiological Studies01:27

Confounding in Epidemiological Studies

Confounding in statistical epidemiology represents a pivotal challenge, referring to the distortion in the perceived relationship between an exposure and an outcome due to the presence of a third variable, known as a confounder. This variable is associated with both the exposure and the outcome but is not a direct link in their causal chain. Its presence can lead to erroneous interpretations of the exposure's effect, either exaggerating or underestimating the true association. This...
206
Causality in Epidemiology01:21

Causality in Epidemiology

Causality or causation is a fundamental concept in epidemiology, vital for understanding the relationships between various factors and health outcomes. Despite its importance, there's no single, universally accepted definition of causality within the discipline. Drawing from a systematic review, causality in epidemiology encompasses several definitions, including production, necessary and sufficient, sufficient-component, counterfactual, and probabilistic models. Each has its strengths and...
518
Longitudinal Studies01:26

Longitudinal Studies

Longitudinal studies are also widely used in other medical and social science fields. For instance, in cardiovascular research, they can monitor patients' health over decades to identify risk factors for heart disease, such as high cholesterol or smoking, and evaluate the long-term effectiveness of preventive measures. Similarly, in mental health studies, researchers might follow individuals from adolescence into adulthood to understand the development and progression of conditions like...
191
Bias in Epidemiological Studies01:29

Bias in Epidemiological Studies

Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:  
391
Cross-Sectional Research01:50

Cross-Sectional Research

In cross-sectional research, a researcher compares multiple segments of the population at the same time. If they were interested in people's dietary habits, the researcher might directly compare different groups of people by age. Instead of following a group of people for 20 years to see how their dietary habits changed from decade to decade, the researcher would study a group of 20-year-old individuals and compare them to a group of 30-year-old individuals and a group of 40-year-old...
11.4K
Censoring Survival Data01:09

Censoring Survival Data

Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
159