Gender Differences in Work-Based Assessment Scores and Narrative Comments After Direct Observation
Janae K Heath1, Jennifer R Kogan2, Eric S Holmboe3
1Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA. Janae.heath@pennmedicine.upenn.edu.
Journal of General Internal Medicine
|January 30, 2024
Summary
This study found gender differences in work-based assessment (WBA) ratings and narrative comments, even when controlling for resident performance. Women residents received lower entrustment ratings and more feminine-coded language in feedback compared to men.
Area of Science:
- Medical Education
- Assessment in Healthcare
Background:
- Prior work-based assessment (WBA) studies have not consistently shown gender differences in numeric ratings.
- Previous research has not adequately controlled for resident performance or analyzed narrative feedback by gender.
Purpose of the Study:
- To investigate gender-based disparities in work-based assessment (WBA) entrustment ratings.
- To explore gender differences in narrative feedback, considering resident's known scripted performance.
Main Methods:
- Secondary analysis of 1527 rater assessment forms (RAFs) from a randomized controlled trial on rater training.
- Multivariable regression was used to assess gender differences in entrustment ratings, adjusting for performance and demographics.
- Natural language processing analyzed narrative comments for gendered language (masculine, feminine, agentic, communal).
Main Results:
- Women residents received significantly lower entrustment ratings (2.29) than men (2.54) in simulated WBA, even after adjusting for skill level (p < 0.001).
- Feminine terms were more prevalent in narrative comments describing areas where women residents performed poorly, compared to men (β 0.45, p=0.01).
- These linguistic differences persisted even after accounting for faculty entrustment ratings.
Conclusions:
- This study identified significant gender differences in simulated work-based assessment (WBA) entrustment ratings, contrary to some prior research.
- Linguistic analysis revealed gendered patterns in narrative feedback, with feminine terms more frequently associated with women residents' performance comments.
- Findings highlight potential biases in WBA and feedback, necessitating further investigation into equitable assessment practices.
Related Concept Videos
01:30Socioemotional Experience and Gender Development
30
Social-emotional experiences and cultural influences play significant roles in shaping gender development. During middle childhood, from ages 6 to 11, peer groups become dominant in reinforcing gender norms. Children in this age group often align with same-gender peer groups, which actively encourage behaviors that conform to traditional gender roles. For instance, boys may be discouraged from engaging in activities perceived as feminine, reinforcing culturally dictated norms about masculinity...
30
02:30Naturalistic Observations
15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K
01:31Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K
02:45Self-Discrepancy Theory
18.3K
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.
18.3K
02:55Stereotypes, Prejudice, and Discrimination
90.2K
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who...
90.2K
02:16Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K