Association of individual item characteristics with faculty competitiveness rankings in emergency medicine standardized letters of evaluation

  • 0Rosemount Minnesota USA.
AEM education and training +

|

Abstract

Objective

Our objective was to compare the association between norm-referenced versus criterion-referenced items and faculty consensus ratings of applicant competitiveness based on the two most recent versions of the emergency medicine (EM) standardized letter of evaluation (SLOE).

Methods

Faculty consensus ratings of mock EM SLOE competitiveness were obtained from prior studies of the current (2022) and previous (2016) SLOE formats. Items from each SLOE version were categorized by scope as either (1) focused or (2) global and by their referencing as (1) norm-referenced, (2) criterion-referenced, or (3) mixed. We used a linear regression model to measure the association between individual items and consensus rankings of SLOE competitiveness. We then evaluated which item types were most associated with competitiveness rankings.

Results

Regarding scope, five items were focused and four were global in the 2016 SLOE compared to 11 focused items and two global items in the 2022 SLOE. The 2016 version of the SLOE contained eight norm-referenced items and one criterion-referenced item compared to four criterion-referenced items, two norm-referenced items, and seven mixed items in the 2022 version. Two items were significantly associated with competitiveness rankings in the 2016 SLOE. Both were global in scope and norm-referenced. Only one item was significantly associated with competitiveness rankings in the 2022 SLOE-the global norm-referenced item regarding the anticipated rank position.

Conclusion

Only global norm-referenced items were significantly associated with faculty competitiveness ratings across two versions of the EM SLOE, which place different emphasis on norm-referenced versus criterion-referenced items. If the ability to stratify applicants remains a priority of the EM SLOE, global norm-referenced assessments should continue to be included.

Related Concept Videos

Methods of Documentation VII: EMR 01:30

827

Electronic Medical Records (EMRs) primarily center around electronically documenting patients' health information within a single healthcare organization or practice. They contain essential clinical data related to a patient's medical history, diagnoses, medications, treatment plans, lab results, and other pertinent information relevant to the specific encounter or episode of care. EMRs are designed to streamline documentation and workflow processes within individual healthcare...

Methods of Documentation III: PIE 01:21

1.4K

Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:

Problem: Patient care is organized around issues identified or nursing diagnoses in the PIE system. Each problem is labeled with a "P" followed by a number....

Assessment of the Cardiovascular System III: Palpation 01:27

251

Palpation involves feeling the body to evaluate texture, size, consistency, and tenderness for assessing cardiovascular health. The following steps are organized in a head-to-toe order:
Jugular Venous Pressure (JVP) Measurement
Position the patient at a thirty- to forty-five-degree angle or in a semi-fowler's position. Look for the highest point of pulsation in the internal jugular vein and measure the vertical distance to the angle of Loius or sternal angle. A normal JVP is 3-4 cm above...

Review and Preview 01:10

6.9K

In statistics, several tools are used to interpret the data. Measures of central tendency represent the characteristics of the data, such as mean, median, and mode. Additionally, measures of variance like standard deviation and range are used to find the spread of data from the mean. Relative standing measures the distance between data locations. Commonly used measures of relative standings are percentile, z score, and quartiles.
Percentiles are a type of fractile that partition data into...

Ranks 01:02

231

Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...