Linguistic Differences by Gender in Letters of Recommendation for Maternal-Fetal Medicine Fellowship Applicants.

As in many realms of academia and medicine, in obstetrics and gynecology, women experience gender bias in residency evaluations and academic promotions. More specifically, women in Maternal-Fetal Medicine (MFM) are underrepresented within departmental leadership positions. As a means of identifying spaces where bias may exist, multiple investigators have previously reported on gender bias in letters of recommendation (LORs) for residency and subspecialty training programs. We aimed to determine if linguistic differences exist in LORs for self-identified male and female applicants to MFM fellowship at an academic institution. This was a retrospective single-site cohort study from 2019 to 2021. Data collected included applicant's age, self-reported race/ethnicity and gender, geographic region of residency, step 1 and 2 scores, scholarly and volunteer activities, and number of LORs. The Linguistic Inquiry and Word Count (LIWC) software, a validated text analysis program, was used to characterize LOR linguistic content. Multivariable analysis was used to compare letter characteristics to applicant demographics. A total of 212 applications were reviewed, including 808 LORs. Women comprised 76.9% of applicants, and men 23.1%. Most applicants identified as non-Hispanic White (52.8%). Men were more likely to be international medical graduates (20 vs. 6%, p ≤ 0.01), and women reported more volunteer activities (7.1 ± 5.1 vs. 5.5 ± 4.3, p = 0.04). There were no differences in step scores, number of research projects, or number of LORs. Multivariable analysis controlling for applicant race, step 1 score, and gender of letter writer revealed that letters written for males contained significantly more references to the word category cognitive processes (7.4 ± 0.2 vs. 7.1 ± 0.1, p = 0.046), specifically in reference to the subcategories of certainty and differentiation. We identified linguistic differences in LORs written for MFM applicants, suggesting potential bias in the style of writing for male and female physicians applying to this field. · Gender bias exists in the evaluation and promotion of women in medicine.. · We sought to determine whether it also exists in letters of recommendation for MFM fellowship.. · Previous studies have examined gender bias in letters of recommendation for other specialties.. · Linguistic bias was detected in letters of recommendation for MFM fellowship from 2019 through 2021.. · We found evidence of linguistic differences based on gender of applicant and letter writers..

Rosenthal E ，Tappy E ，Pan E ，Verma D ，Wang A ，Brown LS ，Santiago-Muñoz P ，Florian-Rodriguez M ... -  《-》

Linguistic Differences by Gender in Letters of Recommendation for Minimally Invasive Gynecologic Surgery Fellowship Applicants.

Various surgical specialties have reported gender bias in letters of recommendation (LOR). We aimed to determine if linguistic differences exist in LOR for female and male physicians applying to Fellowship in Minimally Invasive Gynecologic Surgery (FMIGS). Retrospective cohort study including application cycles 2019 and 2020. Academic university hospital. FMIGS applicants. Applicant demographic and baseline data included age, race, gender, geographical region of residency training, Step 1 and 2 scores, number of research and volunteer activities, Alpha Omega Alpha and Gold Humanism status and number of LOR, as well as the gender and academic rank of the letter writer. The Linguistic Inquiry and Word Count software, a validated text analysis program, was used to characterize LOR linguistic content. A total of 118 applications, including 391 letters, were analyzed. Seventy-six (64.4%) applicants were female and 42 (35.6%) were male. Most female applicants were white (46% vs. 36%, p = 0.04), had Alpha Omega Alpha status (13% vs. 0%, p = 0.01), higher Step 2 scores (239.7 vs. 230.4, p < 0.01), and more service activities (7.7 vs. 4.7, p < 0.01), compared to male applicants. Male applicants were more likely to graduate from international medical schools (45% vs. 16%, p < 0.01). Female authors wrote 159 LOR, and male authors wrote 232. Following multivariable analysis controlling for race, Step 1 score and letter writer gender, no significant differences in average LOR word count for female and male applicants (406.7 ± 24.2 words vs. 340.1 ± 35.4 words), or differences in Linguistic Inquiry and Word Count linguistic categories existed. Although Baseline differences were noted between female and male FMIGS applicants, no differences in LOR length or linguistic categories were noted. These results likely reflect the impact of female predominance and increased efforts to address gender bias within Obstetrics and Gynecology.

Tappy E ，Pan E ，Verma D ，Wang A ，Brown LS ，Chang S ，Florian-Rodriguez M ... -  《-》

Do gender and racial differences exist in letters of recommendation for obstetrics and gynecology residency applicants?

Studies in several fields demonstrate gender and racial differences in descriptions of applicants in letters of recommendation. However, gender and racial biases in obstetrics and gynecology residency letters of recommendation are understudied. This study aimed to determine whether there are differences in the letters of recommendation written for medical students applying for obstetrics and gynecology residency based on applicant gender and underrepresented in medicine status. We analyzed all letters of recommendation submitted to a single obstetrics and gynecology residency program during the 2019-2020 application cycle using a computerized text analysis software to evaluate the presence of 25 word categories. Multivariable regression was used to compare differences in the frequency of word categories by gender and underrepresented in medicine status. Concurrently, we performed a qualitative content analysis of letters from a random sample of applicants balanced for gender and underrepresented in medicine status and explored emerging themes until thematic saturation was reached. We analyzed 3060 letters written for 834 applicants, 721 (87%) of whom were women and 198 (24%) of whom were underrepresented in medicine. Men authored 1605 letters (53%). There was no difference in word categories used in letters written for men and women applicants on multivariable analysis. Similarly, there was no word category difference between letters written for applicants who were underrepresented in medicine compared with White and Asian applicants. However, women letter writers used more communal (relationship-oriented) words compared with men letter writers (P<.001). Moreover, on the qualitative analysis of letters from a random sample of 30 applicants, comments about personality traits were frequent in all letters. Comments on surgical skills, work ethic, and leadership were found more in letters for White and Asian applicants, and phrases that were doubt raisers were found more in letters written for underrepresented medicine applicants. On linguistic analysis, letters of recommendation written for obstetrics and gynecology residency applicants were similar overall compared with applicant race and gender.

Brown O ，Mou T ，Lim SI ，Jones S ，Sade S ，Kwasny MJ ，Mueller MG ，Kenton K ... -  《-》

Gender Differences in Letters of Recommendation for Gynecology Surgical Fellowship Applicants: Analysis of One Program's Recruitment Cycle.

To examine whether there are gender differences in letters of recommendation (LORs) written for residents applying to gynecology surgical fellowships. Retrospective study. Single, academic institution. LORs for applicants to gynecology oncology, urogynecology, and minimally invasive gynecology fellowships during the 2019-2020 application cycle. Not applicable. We analyzed the linguistic content of the letters for the presence of 4 summary variables and 21 word categories based on previous studies using validated computerized text analysis software. We used multivariable analysis using linear mixed models to compare linguistic characteristics of letters by applicant gender. We performed qualitative content analysis on letters and compared the frequency of code themes by gender. The mixed-method design was planned to allow for analysis of domains not captured in text analysis. Among 680 letters written for 186 applicants, 124 (18.2%) were written for men, and 556 (81.8%) were written for women. There were no differences in the least square mean (standard error) word counts for LORs written for men and women applicants, 465 (20.0) vs 458(9.4) words, p = .74. In multivariable analysis, LORs written for men were found to have higher authentic tone and more risk words (p = .005 and p = .03, respectively). LORs written for women contained more communal (relationship-oriented) words (p = .006). The qualitative analysis demonstrated that ability, interpersonal traits, surgical skills, and research were the most often mentioned themes. Comments about compassion/empathy, leadership potential, teaching, interpersonal skills, and patient rapport were found more often in letters for men. More doubt raisers (words that raise doubt or concern) were present in letters for men, but letters for both genders had similar levels of negative criticism. In contrast, comments on ability, being "drama-free," and self-awareness were found more often in letters for women. There were gender differences in LORs written for obstetrics and gynecology surgical subspecialty fellowship applicants indicating the presence of gender bias.

Lim SI ，Mueller M ，Mou T ，Jones S ，Tanner E ，Chaudhari A ，Kenton K ，Brown O ... -  《-》

Linguistic Differences by Gender in Letters of Recommendation for Female Pelvic Medicine and Reconstructive Surgery Fellowship Applicants From 2010 to 2020.

Linguistic differences suggestive of gender bias have been detected in letters of recommendation (LOR) for female and male residency and fellowship program applicants within multiple medical specialties. The aim of the study was to determine whether linguistic differences exist in LOR for female and male physicians applying to female pelvic medicine and reconstructive surgery (FPMRS) fellowship. A retrospective analysis of FPMRS fellowship applications submitted to a university-affiliated academic center from 2010 to 2020 was performed. Linguistic Inquiry and Word Count, a text analysis software, was used to characterize the linguistic content of letters. Multivariable analysis was used to compare letter characteristics with applicant and letter writer demographics. Of 306 applications reviewed, 221 (72.2%) applicants were female and 85 (27.8%) were male. Of the 1,062 letters analyzed, 457 (43.0%) were written by female letter writers, 586 (55.2%) by males, and 19 (1.8%) were a combination. Multivariable analysis controlling for race, Step 1 score, and letter writer gender demonstrated more frequent use of affiliation words for female applicants compared with males (3.1% ± 0.3 vs. 2.9% ± 0.3, P = 0.02). No additional differences were noted in average letter length or all other linguistic categories analyzed. Multiple differences were detected between writing styles of female and male letter writers, including average letter length, use of multiple word categories, and use of communal (relationship-oriented) language. Data were stratified into 2-year periods and no longitudinal trends in linguistic differences were detected. No linguistic differences, suggestive of gender bias, were found between female and male applicants to FPMRS fellowship.

Tappy E ，Pan E ，Brown LS ，Wang A ，Verma D ，Florian-Rodriguez M ... -  《-》