Published on in Vol 3 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/38676, first published .
State and Federal Legislators’ Responses on Social Media to the Mental Health and Burnout of Health Care Workers Throughout the COVID-19 Pandemic: Natural Language Processing and Sentiment Analysis

State and Federal Legislators’ Responses on Social Media to the Mental Health and Burnout of Health Care Workers Throughout the COVID-19 Pandemic: Natural Language Processing and Sentiment Analysis

State and Federal Legislators’ Responses on Social Media to the Mental Health and Burnout of Health Care Workers Throughout the COVID-19 Pandemic: Natural Language Processing and Sentiment Analysis

Original Paper

1Department of Emergency Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States

2Center for Digital Health, University of Pennsylvania, Philadelphia, PA, United States

3Center for Emergency Care Policy and Research, Department of Emergency Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States

4Leonard Davis Institute of Health Care Economics, University of Pennsylvania, Philadelphia, PA, United States

5Department of Public Health Policy & Management, School of Global Public Health, New York University, New York, NY, United States

Corresponding Author:

Matthew P Abrams, BA

Department of Emergency Medicine

Perelman School of Medicine

University of Pennsylvania

8th Fl

3600 Civic Center Blvd

Philadelphia, PA, 19104

United States

Phone: 1 619 227 9228

Email: mattpabrams@knights.ucf.edu


Background: Burnout and the mental health burden of the COVID-19 pandemic have disproportionately impacted health care workers. The links between state policies, federal regulations, COVID-19 case counts, strains on health care systems, and the mental health of health care workers continue to evolve. The language used by state and federal legislators in public-facing venues such as social media is important, as it impacts public opinion and behavior, and it also reflects current policy-leader opinions and planned legislation.

Objective: The objective of this study was to examine legislators’ social media content on Twitter and Facebook throughout the COVID-19 pandemic to thematically characterize policy makers’ attitudes and perspectives related to mental health and burnout in the health care workforce.

Methods: Legislators’ social media posts about mental health and burnout in the health care workforce were collected from January 2020 to November 2021 using Quorum, a digital database of policy-related documents. The total number of relevant social media posts per state legislator per calendar month was calculated and compared with COVID-19 case volume. Differences between themes expressed in Democratic and Republican posts were estimated using the Pearson chi-square test. Words within social media posts most associated with each political party were determined. Machine-learning was used to evaluate naturally occurring themes in the burnout- and mental health–related social media posts.

Results: A total of 4165 social media posts (1400 tweets and 2765 Facebook posts) were generated by 2047 unique state and federal legislators and 38 government entities. The majority of posts (n=2319, 55.68%) were generated by Democrats, followed by Republicans (n=1600, 40.34%). Among both parties, the volume of burnout-related posts was greatest during the initial COVID-19 surge. However, there was significant variation in the themes expressed by the 2 major political parties. Themes most correlated with Democratic posts were (1) frontline care and burnout, (2) vaccines, (3) COVID-19 outbreaks, and (4) mental health services. Themes most correlated with Republican social media posts were (1) legislation, (2) call for local action, (3) government support, and (4) health care worker testing and mental health.

Conclusions: State and federal legislators use social media to share opinions and thoughts on key topics, including burnout and mental health strain among health care workers. Variations in the volume of posts indicated that a focus on burnout and the mental health of the health care workforce existed early in the pandemic but has waned. Significant differences emerged in the content posted by the 2 major US political parties, underscoring how each prioritized different aspects of the crisis.

JMIR Infodemiology 2023;3:e38676

doi:10.2196/38676

Keywords



Health care workers have been disproportionately affected by burnout and mental health symptoms, including depression and anxiety [1-3]. The COVID-19 pandemic has exacerbated mental health symptoms, disorders, and burnout across the workforce [4-14]. Health care workers continue to experience rapid shifts in case volume, critical supply shortages (eg, of personal protective equipment), vaccination rates, death rates, and public health measures [12,15-17]. The emotions and mental health symptoms experienced by workers continue to fluctuate dramatically [14,17,18]. Depression, anxiety, and burnout continue to rise at alarming rates across the health care workforce [19] and have public-facing consequences, such as worse patient outcomes and higher costs [20,21].

State and federal policy responses to the pandemic continue to change across the nation [22,23]. These policy changes have been debated in the public forum by health experts, physicians, and politicians [24]. The link between these policies and case count may lead to hospital-based capacity strain and impact the mental health of the workforce. Ultimately, state COVID-19 policies and political trends are shaping national legislation. For example, President Joe Biden recently signed the Dr. Lorna Breen Health Care Provider Protection Act, inspired by Dr Breen’s death by suicide from the strain of providing care during the COVID-19 pandemic. This reflects how national legislators are starting to recognize the urgent need for improved behavioral health among health care providers.

Social media provides state and federal legislators the opportunity to directly communicate health-related information—including mental health information—to the public and to gauge public interest in a topic [25]. A recent systematic review identified that Twitter can be used to promote public health in 6 main ways, including analysis of shared content and public engagement [26], ultimately informing how governments and health care organizations shape appropriate responses to the COVID-19 pandemic [27]. Social media has also been analyzed to provide insights about the mental health of the general public during the COVID-19 pandemic [28].

The content and language used by state legislators in public-facing venues such as social media reflect their opinions and priorities [23,24,29]. Legislators’ social media posts may also signal attention toward legislation and policy engagement in real time, in addition to their priorities [29-31]. Understanding what policy makers and legislators are saying in these forums is also important, as they have influence over public opinion and impact behavior [32,33]. This may be of particular interest during the COVID-19 pandemic, as US legislators connect with their constituents and influence behaviors related to COVID-19 prevention, safety, and exposure [33,34].

As burnout and mental health symptoms increase among health care workers, the support and opinions of legislators displayed on social media are also important in understanding the message being relayed to the public. Legislators interact on social media broadly, to a greater extent than they share legislative votes or cosponsorship [35]. The growing body of social media exposure on platforms such as Twitter and Facebook between legislators and the general public creates a repository of political opinion and indicators of key policy shifts and messaging. Further, prior studies have found differences reflect a growing divide between Republican and Democratic legislators’ priorities regarding COVID-19 policies [34,36] and, overall, more partisanship than cosponsorship among online interactions between legislators [35]. However, no studies, to our knowledge, have examined possible differences in the views legislators have expressed online regarding the mental health and burnout of the health care workforce.

The objective of this study was to examine state and federal legislators’ social media posts on Twitter and Facebook throughout the COVID-19 pandemic to identify and understand themes related to mental health and burnout of the health care workforce and look for indicators of temporal shifts in political priorities regarding mental health. Specifically, we sought to describe variations in content over time, differences in language and sentiment used across parties, and party-specific theme prevalence. This content is important to analyze in order to understand the public discourse, opinions of the legislature, and the overall response from legislators to burnout and the mental health of the health care workforce.


Data Source

We identified state legislators’ Facebook and Twitter posts related to mental health and burnout in the health care workforce from January 2020 to November 2021 using Quorum (Quorum Analytics) [37], a software platform that collects policy-related documents, including social media content, from politicians during their time in office. For context, there are about 7312 state legislators [38] and 600 federal legislators [39] in the United States. Posts from all members of the upper and lower houses, as applicable, of the 50 US state legislature with 1 or more terms from each of the following keyword groups were selected for analysis: [“healthcare worker,” “doctor,” “physician,” “nurse”] AND [“wellness,” “wellbeing,” “burnout,” “resilience,” “compassion,” “fatigue,” “depression,” “suicide,” “mental health,” “anxiety,” “sad,” “depressed,” “stress,” “stressed,” “tired,” “frustrated,” “frustration”]. Of note, the 4 keywords in the first string of search terms were carefully selected by the research team to capture the health care workers perceived to be most discussed by legislators online and were not inclusive of all frontline workers. Retweets and other posts duplicating the content of another user were also included in the analysis, as these posts indicate the significance of the original content and intent to propagate to a larger audience. This study was conducted in partnership with the Research-to-Policy Collaboration, which is affiliated with Pennsylvania State University's Edna Bennett Pierce Prevention Research Center.

Descriptive Analysis

Summary statistics were used to describe the volume of relevant burnout-related posts on each social media platform and across parties and legislative bodies. The monthly volume of social media posts related to mental health and burnout between January 2020 and November 2021, stratified by social media platform and political party, was compared with monthly COVID-19 case volume during the same time period. Differences between themes expressed in Democratic and Republican posts were estimated using the Pearson chi-square test. Themes expressed by legislators with independent or unknown affiliations were excluded from the analyses and assessments due to small sample size. Likewise, social media posts from government entities (rather than individual legislators) were excluded from the analyses due to small sample size.

Natural Language Processing

Preprocessing

Post text was converted to lowercase, extraneous white space was stripped, and link URLs, email addresses, user mentions, hashtags, and stop words were removed. Remaining terms were lemmatized to group-inflected forms with the same word stem, and the relative frequency of single words and phrases was extracted to build a baseline set of language features (rows indicated posts, and columns indicated word/phrase frequency), from which the top 50 most frequent words posted by Republicans and Democrats were identified. These methods have been used in prior work characterizing legislator discourse on social media [36,40,41].

Theme Modeling

We applied latent Dirichlet allocation (LDA), an unsupervised clustering algorithm, to the baseline set of language features to identify 20 data-driven word clusters (ie, topics) and constructed a topic feature set (rows indicated posts, and columns indicated topic prevalence); LDA assumes that posts have a small number of topics (ie, themes) and that topics are composed of groups of frequently co-occurring words and phrases across posts [42,43]. The topic model was trained using the Machine Learning for Language Toolkit 2.0 [44], and the optimal number of themes was selected via analysis of model coherence scores, visual inspection of topic separation with principal component analysis, and manual evaluation of topic interpretability.

Topic features were correlated (Pearson r) with political party (coded as a binary variable, where 0 indicated a Democratic post and 1 indicated a Republican post) to further distinguish linguistic differences across political parties in social media posts about mental health and burnout in the health care workforce. Significant correlations with a Benjamini-Hochberg–corrected P value of <.001 and their 95% CIs are reported. Authors AKA and MPA independently evaluated each topic for thematic meaning by reviewing the 10 words and 10 social media posts most associated with each topic [45,46].

Sentiment

We applied the Valence Aware Dictionary and Sentiment Reasoner (VADER) [47], a lexicon and rule-based sentiment analysis tool that is specifically attuned to sentiments expressed in social media, to the baseline set of language features to identify weekly changes in post sentiment over time across political parties. Post sentiment scores were calculated as the mean sentence sentiment in each post (as suggested in the VADER documentation), and weekly sentiment scores were calculated as the mean post sentiment for all posts in a given week stratified by party. Sentiment data were visualized via weekly sentiment means overlaid with the exponentially weighted mean of weekly sentiment means. This was repeated to identify monthly changes in sentiment.

All statistical analyses were performed using Python (version 3.7.7).

Ethical Considerations

This study is exempt from ethical review under University of Pennsylvania Institutional Review Board guidelines, as it does not meet the criteria for human-subject research and utilizes publicly available social media posts.


The search criteria resulted in 4165 health care workforce burnout–related social media posts, including 1400 tweets and 2765 Facebook posts, that met the inclusion criteria (Table 1).

These posts were generated by 2047 unique social media accounts, consisting of 2009 state and federal legislator accounts (1257 Facebook accounts and 752 Twitter accounts owned by 1685 unique individuals) and 38 government entity accounts, such as state health departments (n=38 Twitter accounts). The majority of the social media posts (2319/4165, 55.68%) were generated by Democrats. Republicans were responsible for 40.34% (1600/4165) of health care–associated burnout-related social media posts and all other legislators were responsible for 3.58% of posts (166/4165). The most common legislators were representatives (2139/4165, 51.36%) followed by senators (1259/4165, 29.52%). The mean word count was 43.47 (SD 18.87) words for Twitter posts and 422.72 (SD 277.15) words for Facebook posts. Variation in volume of posts generated varied over time, with the majority occurring during the initial surge (Figure 1). This general waning of the volume of burnout-related posts as the pandemic progressed was similar among legislators from both major political parties.

Notable differences were observed between platform use and political party affiliation. Democrats made the majority of Twitter posts (1033/1400, 73.79%) and Republicans made the slight majority of Facebook posts (1425/2765, 51.54%). Additionally, there were notable geographic differences along party lines in the volume of Facebook posts, with Democrats posting more often than Republicans in the Northeast (n=505 vs n=378), and Republicans posting more often from the South (n=727 vs n=418) and Midwest (n=246 vs n=91). However, these regional differences may partially reflect differences in the size and partisan composition of state legislatures across these geographies.

Thematic content generated from the natural-language processing and LDA approaches revealed varying content themes between the 2 major political parties (Figures 2 and 3).

The top 4 themes from social media posts most significantly correlated with the Democratic Party were (1) frontline care and burnout, (2) vaccines, (3) COVID outbreaks, and (4) mental health services. The top 4 themes associated with the Republican Party social media posts were (1) legislation, (2) call for local action, (3) government support, and (4) health care worker testing and mental health. Table 2 shows themes, words, and correlation strength with party.

Figures 4 and 5 show word clouds for each of the top 4 themes across party affiliation. Full post content and the list of themes are available in Multimedia Appendix 1, Table S1.

Sentence-level sentiment analyses also revealed differential sentiment patterns by political party throughout the timeline of the study (Multimedia Appendix 1, Figure S1A). The mean monthly post sentiment analysis found that both parties’ posts remained within the slightly positive to positive sentiment range when mean sentiment scores were averaged per month and exponentially weighted. However, the more granular weekly post sentiment analysis by party revealed that during most spikes in COVID-19 case counts, the weekly exponentially weighted mean sentiment scores of Democratic posts more often entered the neutral or negative range compared to Republican posts (Multimedia Appendix 1, Figure S1B).

Table 1. Characteristics of social media posts.
CharacteristicTwitter (n=1400), n (%)Facebook (n=2765), n (%)
Party

Democratic1033 (73.79)1286 (46.51)

Republican255 (18.21)1425 (51.54)

Independent5 (0.36)3 (0.11)

Unknown107 (7.64)51 (1.84)
Regiona

Northeast445 (31.79)897 (32.64)

South365 (26.07)1170 (42.58)

Midwest285 (20.36)446 (16.23)

West304 (21.71)235 (8.55)
Status

Current1338 (95.57)2535 (91.68)

Designate1 (0.07)3 (0.11)

Former61 (4.36)227 (8.21)
Government titleb

Representative623 (22.53)1516 (54.83)

Senator439 (15.88)820 (29.66)

Assembly115 (4.16)158 (5.71)

Delegate54 (1.95)118 (4.27)

Governor54 (1.95)73 (2.64)

Speaker9 (0.33)40 (1.45)

Member0 (0)14 (0.51)

Other18 (0.65)26 (0.94)

aPosts from Guam, the Virgin Islands, and the Northern Mariana Islands were not included.

bPosts from government entities (n=88 Twitter posts) were not included.

Figure 1. COVID-19 case counts and volume of social media posts by party over time. D: Democratic; I: independent; R: Republican; U: unknown.
Figure 2. Words most frequently used in Democratic social media posts.
Figure 3. Words most frequently used in Republican social media posts.
Table 2. Themes associated with Democratic or Republican posts.
ThemeTop wordsPearson r (95% CI)
Themes associated with Democratic posts

Frontline care burnout and stressworker, nurse, healthcare, work, doctor, community, fight, stress, pandemic, frontline, first_responder, social, tired, year, life, month, support, serve, front_line, proud–0.2615a (–0.31 to –0.21)

Vaccinevaccine, call, covid, vaccination, receive, week, information, vaccinate, appointment, online, local, office, meal, website, free, visit, find, pm, question, age–0.1278a (–0.18 to –0.08)

COVID outbreakscounty, people, governor, test, work, state, back, continue, school, number, outbreak, rate, testing, day, make, positive, move, system, good, lot–0.1118a (–0.16 to –0.06)

Mental health serviceshealth, mental, care, service, access, support, patient, provider, treatment, physician, professional, insurance, crisis, practice, resource, behavioral, medical, provide, system, network–0.1102a (–0.16 to –0.06)

COVID testingcovid, testing, health, information, state, include, public, update, test, site, department, community, today, member, resident, contact, resource, day, announce, visit–0.0582 (–0.11 to –0.01)

State informationcase, covid, county, health, statewide, update, coronavirus, individual, state, home, death, total, patient, provide, stay, information, report, number, continue, resident–0.0398 (–0.09 to 0.01)

Schools and educationschool, child, student, education, year, district, teacher, high, parent, family, plan, learn, person, work, board, adult, college, staff, opportunity, ensure–0.0348 (–0.09 to 0.02)

Masking to slow spreadvirus, people, spread, mask, risk, coronavirus, medical, disease, sick, doctor, prevent, stay, condition, symptom, show, time, flu, avoid, slow, wear–0.0243 (–0.08 to 0.03)

Frontline/essential service support and volunteersservice, include, provide, medical, support, public, community, food, individual, provider, essential, work, worker, center, company, care, supply, volunteer, health, equipment–0.0116 (–0.06 to 0.04)

Family/support systemsworker, nurse, healthcare, work, doctor, community, fight, stress, pandemic, frontline, first_responder, social, tired, year, life, month, support, serve, front_line, proud–0.0019 (–0.05 to 0.05)
Themes associated with Republican posts

Legislationbill, pass, vote, house, legislation, state, require, law, week, committee, session, public, year, create, act, law_enforcement, veteran, legislative, establish, make0.1647a (0.11 to 0.21)

Call for local actionstate, governor, work, continue, pandemic, government, make, issue, important, address, action, local, crisis, leader, response, concern, protect, community, citizen, time0.1430a (0.09 to 0.19)

Governmental supportstate, fund, budget, increase, funding, program, provide, federal, include, year, support, tax, grant, cut, plan, education, pay, revenue, cost, rural0.1098a (0.06 to 0.16)

Health care worker testing and mental healthtest, health, total, positive, pm, facility, day, testing, additional, worker, state, begin, staff, mental, today, healthcare, recover, information, include, covid0.0752a (0.02 to 0.13)

Business/economybusiness, order, home, public, health, stay, guidance, follow, close, guideline, essential, open, social_distance, employee, issue, reopen, continue, activity, remain, limit0.0676a (0.02 to 0.12)

Pandemic time coursetime, day, people, make, work, give, place, put, today, good, week, call, happen, start, month, understand, long, point, post, end0.0675a (0.02 to 0.12)

Emergency public health measuresemergency, state, provide, program, public, benefit, federal, assistance, business, payment, requirement, covid, extend, pay, department, governor, sign, receive, apply, require0.0379 (–0.01 to 0.09)

Debate surrounding public policieswoman, mandate, decision, government, protect, policy, force, doctor, fail, power, lead, lose, sadly, life, abortion, hearing, drug, speak, freedom, science0.0302 (–0.02 to 0.08)

Case countscase, death, positive, covid, active, test, change, report, yesterday, number, week, hospital, total, bed, patient, update, day, increase, confirm, rate0.0268 (–0.03 to 0.08)

Long-term care facilitiescare, facility, home, family, nursing, health, hospital, resident, nursing home, staff, visit, long-term, member, patient, visitation, vulnerable, person, senior, hour, individual0.0197 (–0.03 to 0.07)

aThese values were significant at the P<.001 level after applying the Benjamini-Hochberg correction for multiple tests.

Figure 4. Word clouds representing the top 20 most representative words for each of the 4 themes most correlated with Democratic social media posts.
Figure 5. Word clouds representing the top 20 most representative words for each of the 4 themes most correlated with Republican social media posts.

Principal Findings

This study investigated the social-media posts of US legislators throughout the COVID-19 pandemic with a focus on content related to health care–associated burnout and the mental health of the workforce. It has 3 key findings. First, state and federal legislators are actively using social media to discuss the pandemic and burnout. Second, the focus on burnout and the mental health of the health care workforce was primarily seen in the early surge of the pandemic and then dramatically waned. Third, key differences emerged in the social media content posted by the 2 major US political parties. Addressing the overlapping nature of the COVID-19 pandemic and health care–associated burnout is a national priority for health systems, payers, clinicians, and patients [7], yet the 2 parties appear to highlight and prioritize different aspects of the crisis.

State and federal legislators are increasingly using social media as a platform to discuss health care and medicine [31,35,36,40]. Previous literature has investigated the relationship between Democrats’ and Republicans’ social media content within the context of the opioid epidemic, showing that overall partisanship across topics increased from 2016 to 2019 [40]. In the setting of the COVID-19 pandemic, a recent study also showed that Republican legislators who were previously less engaged in discussion of vaccination on social media became significantly more publicly engaged following the arrival of COVID-19 compared to their Democratic counterparts, suggesting a possible convergence of priorities in light of the COVID-19 pandemic [41]. The content posted on Twitter and Facebook is public facing, and given the rise of digital technology and social media, the content posted by legislators in the United States provides a window into political thoughts, agendas, and priorities. The pandemic has certainly worsened the mental health strain and burnout faced by health care providers and is projected to continue despite improvements in case volume [7]. This is among the first studies to discover and investigate the social media content from US legislators specific to burnout and mental health of the workforce. Perhaps less surprising is the rise in these social media posts early in the pandemic, as attention was keenly focused on the workforce. Unfortunately, this data set shows that after the initial wave, there has been less attention over time despite recurrent surges (eg, Delta variants). In line with Kingdon’s multiple streams model [48], this may indicate that the “policy window” for mental health–related legislation regarding the health care workforce was open early in the pandemic. That said, there remains a persistent, yet small, discussion across parties, but ultimately it is low.

The themes and words that state and federal legislators used in these mental health–related social media posts were notably different between the 2 major political parties, including in their emphasis. This is consistent with another recent analysis of tweets from legislators that found differences in health care–related themes according to party lines [36]. In our study, Republican-affiliated legislator posts revealed a greater representation of themes central to public policies and legislation. The themes indicated a focus on local and federal action as seen through 2 of the top 4 most strongly correlated themes, “call for local action” and “governmental support.” This may reflect support for implementing broader policies to help support health care workers. Republican posts also included a focus on COVID-19 testing for the workforce. In contrast, Democratic social media posts more specifically focused on the mental health services and acute strain on the workers themselves. The thematic analysis showed that 2 of the top 4 themes focused on “frontline care and burnout/stress” and “mental health services.” In addition, Democratic posts were varied in their overall content, with other themes emerging related to capacity strain on health systems related to outbreaks and vaccines and vaccinations themselves. These themes appear to be much more granular and focused on the workers themselves and the stress and burnout they face throughout the pandemic surges.

This is among the first studies to use natural language processing of state and federal legislators’ social media content to measure and describe trends in content and posting issues over time with specific attention to health care worker burnout and mental health. State and federal legislators’ word choices on social media carry great influence, and their reach is broad. The posts generated by legislators reflect the immense initial concern and the seeming loss of focus as the public response evolved over the course of the pandemic. Discussing mental health and burnout in public forums is important in health care, where significant stigmas exist and the consequences are grave, as seen by the high relative rate of physician suicide [49-51]. State and federal legislators carry power in their voices, whether they are live or on social media, and their words can lead to important action to help support and sustain the workforce. Recognizing the urgent need for improved behavioral health among health care providers, President Joe Biden recently signed the Dr. Lorna Breen Health Care Provider Protection Act, inspired by Dr Breen’s death by suicide from the strain of providing care during the COVID-19 pandemic. Highlighting the important role of legislators’ social media, the post on the President’s Instagram account (@Potus) about this new act’s aim of “reducing and preventing suicide, burnout, and mental health and substance use conditions among healthcare professionals” received over 330,000 likes and 7200 comments, suggesting social media is an important tool for legislators to interface with constituents about the mental health of the workforce.

Limitations

This study has several limitations. Quorum does not report state or federal legislators’ years in office, only whether they are a current or former legislator at the time of data download. We therefore were unable to stratify for years in office in our measures of legislators’ number of social media posts related to burnout or mental health. Similarly, Quorum does not report the gender of legislators. It is possible that the content may be different based on the gender of legislators, so future studies should aim to analyze legislators’ posts by gender. We also did not have access to the total number of social media posts for each legislator. We were therefore also unable to stratify for a legislator’s general social media activity in our analysis. Another limitation is that social media posts from both state and federal legislators were aggregated and analyzed together. However, it is possible that variations in the content and sentiment of social media posts may differ based on whether a legislator works at the state or federal level.

Moreover, cross-party comparisons in post volume are impacted by the size and partisan composition of state and federal legislatures, which are often not evenly distributed along party lines; therefore, regional differences in attention to burnout within these geographical regions should be interpreted with caution, since there may be different numbers of Democratic versus Republican legislators in a given region. Another limitation is that changes in the content of social media posts in relation to major changes in pandemic prevention and control, such as lockdowns, the introduction of vaccines, vaccine mandates, and masking, were not considered in the analyses. Given it is possible that the content in posts may vary based on these major events, more granular analyses that look at how social media content was influenced by prevention efforts should be conducted in the future.

Finally, social media language does not necessarily lead to specific votes or policy decisions. Identifying relationships between state and federal legislator social media content and legislator voting patterns was beyond the scope of this project.

Conclusion

Health care–associated burnout and mental health strain has grown tremendously throughout the pandemic. Public and legislative response and attention is key to ensuring those working in health care are supported and cared for, as burnout impacts clinicians and the care they provide. Social media can provide valuable insight into trends in state and federal legislators’ burnout and mental health–related content. We found an initial surge in the volume of posts that has diminished throughout the pandemic and, perhaps unsurprisingly, a divide in how Democrats and Republicans think about the issues. Democrats increasingly post content related to individuals and stress and Republicans increasingly post content related to legislation. As the pandemic case count diminished, we found an unfortunate similar decrease in attention from legislators to the issue of supporting the mental health of health care workers and combating burnout.

Acknowledgments

This study was conducted in partnership with the Research-to-Policy Collaboration, which is affiliated with Pennsylvania State University’s Edna Bennett Pierce Prevention Research Center.

RMM receives funding from the National Institute of Mental Health (NIMH; grant number R01MH127686) and the National Heart, Lung, and Blood Institute (grant number K24 HL157621). JP receives funding from NIMH (grant number P50MH113662).

Data Availability

The data sets generated during and/or analyzed during the current study are available publicly from the Quorum database, as well as from the corresponding author on reasonable request.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Supplemental Figure 1: Mean Social Media Post Sentiment Scores by Political Party Affiliation and Supplemental Table 1: Representative Social Media Posts Associated with Each Theme.

DOCX File , 471 KB

  1. Slavin S. Mental health from medical school to medical practice: finding a path forward. Mo Med 2021;118(1):7-12 [FREE Full text] [Medline]
  2. Amir M, Dahye K, Duane C, Wendy L W. Medical student and resident burnout: a review of causes, effects, and prevention. J Fam Med Dis Prev 2018 Dec 31;4(4):1-8 [FREE Full text] [CrossRef]
  3. West C, Dyrbye L, Shanafelt T. Physician burnout: contributors, consequences and solutions. J Intern Med 2018 Jun;283(6):516-529 [FREE Full text] [CrossRef] [Medline]
  4. Shin HS, Park H, Lee Y. The relationship between medical students' empathy and burnout levels by gender and study years. Patient Educ Couns 2022 Feb;105(2):432-439. [CrossRef] [Medline]
  5. Kelsey E, West C, Cipriano P, Peterson C, Satele D, Shanafelt T, et al. Original research: suicidal ideation and attitudes toward help seeking in U.S. nurses relative to the general working population. Am J Nurs 2021 Nov 01;121(11):24-36. [CrossRef] [Medline]
  6. Galanis P, Vraka I, Fragkou D, Bilali A, Kaitelidou D. Nurses' burnout and associated risk factors during the COVID-19 pandemic: A systematic review and meta-analysis. J Adv Nurs 2021 Aug;77(8):3286-3302 [FREE Full text] [CrossRef] [Medline]
  7. Sharifi M, Asadi-Pooya A, Mousavi-Roknabadi R. Burnout among healthcare providers of COVID-19; a systematic review of epidemiology and recommendations. Arch Acad Emerg Med 2021;9(1):e7 [FREE Full text] [CrossRef] [Medline]
  8. Chor W, Ng W, Cheng L, Situ W, Chong J, Ng L, et al. Burnout amongst emergency healthcare workers during the COVID-19 pandemic: A multi-center study. Am J Emerg Med 2021 Aug;46:700-702 [FREE Full text] [CrossRef] [Medline]
  9. Holmes MR, Rentrope CR, Korsch-Williams A, King JA. Impact of COVID-19 pandemic on posttraumatic stress, grief, burnout, and secondary trauma of social workers in the United States. Clin Soc Work J 2021;49(4):495-504 [FREE Full text] [CrossRef] [Medline]
  10. Stone KW, Kintziger KW, Jagger MA, Horney JA. Public health workforce burnout in the COVID-19 response in the U.S. Int J Environ Res Public Health 2021 Apr 20;18(8):4369 [FREE Full text] [CrossRef] [Medline]
  11. Prasad K, McLoughlin C, Stillman M, Poplau S, Goelz E, Taylor S, et al. Prevalence and correlates of stress and burnout among U.S. healthcare workers during the COVID-19 pandemic: A national cross-sectional survey study. EClinicalMedicine 2021 May;35:100879 [FREE Full text] [CrossRef] [Medline]
  12. Hall H. The effect of the COVID-19 pandemic on healthcare workers' mental health. JAAPA 2020 Jul;33(7):45-48. [CrossRef] [Medline]
  13. Pearman A, Hughes ML, Smith EL, Neupert SD. Mental health challenges of United States healthcare professionals during COVID-19. Front Psychol 2020;11:2065 [FREE Full text] [CrossRef] [Medline]
  14. Walton M, Murray E, Christian M. Mental health care for medical staff and affiliated healthcare workers during the COVID-19 pandemic. Eur Heart J Acute Cardiovasc Care 2020 Apr;9(3):241-247 [FREE Full text] [CrossRef] [Medline]
  15. Ranney ML, Griffeth V, Jha AK. Critical supply shortages - the need for ventilators and personal protective equipment during the Covid-19 pandemic. N Engl J Med 2020 Apr 30;382(18):e41. [CrossRef] [Medline]
  16. Cao J, Wei J, Zhu H, Duan Y, Geng W, Hong X, et al. A study of basic needs and psychological wellbeing of medical workers in the fever clinic of a tertiary general hospital in Beijing during the COVID-19 outbreak. Psychother Psychosom 2020;89(4):252-254 [FREE Full text] [CrossRef] [Medline]
  17. Sumner R, Kinsella E. "It's like a kick in the teeth": the emergence of novel predictors of burnout in frontline workers during Covid-19. Front Psychol 2021;12:645504 [FREE Full text] [CrossRef] [Medline]
  18. Bender AE, Berg KA, Miller EK, Evans KE, Holmes MR. "Making sure we are all okay": healthcare workers' strategies for emotional connectedness during the COVID-19 pandemic. Clin Soc Work J 2021;49(4):445-455 [FREE Full text] [CrossRef] [Medline]
  19. Chirico F, Ferrari G, Nucera G, Szarpak L, Crescenzo P, Ilesanmi O. Prevalence of anxiety, depression, burnout syndrome, and mental health disorders among healthcare workers during the COVID-19 pandemic: a rapid umbrella review of systematic reviews. J Health Soc Sci 2021;6(2):209-220 [FREE Full text] [CrossRef]
  20. Forrest C, Xu H, Thomas L, Webb L, Cohen L, Carey T, HERO Registry Research Group. Impact of the early phase of the COVID-19 pandemic on US healthcare workers: results from the HERO Registry. J Gen Intern Med 2021 May;36(5):1319-1326 [FREE Full text] [CrossRef] [Medline]
  21. Chin E, Huynh B, Lo N, Hastie T, Basu S. Projected geographic disparities in healthcare worker absenteeism from COVID-19 school closures and the economic feasibility of child care subsidies: a simulation study. BMC Med 2020 Jul 15;18(1):218 [FREE Full text] [CrossRef] [Medline]
  22. Andraka-Christou B, Bouskill K, Haffajee RL, Randall-Kosich O, Golan M, Totaram R, et al. Common themes in early state policy responses to substance use disorder treatment during COVID-19. Am J Drug Alcohol Abuse 2021 Jul 04;47(4):486-496 [FREE Full text] [CrossRef] [Medline]
  23. Baccini L, Brodeur A. Explaining governors’ response to the COVID-19 pandemic in the United States. American Politics Research 2020 Dec 01;49(2):215-220 [FREE Full text] [CrossRef]
  24. Kushner Gadarian S, Goodman S, Pepinsky T. Partisanship, Health Behavior, and Policy Attitudes in the Early Stages of the COVID-19 Pandemic. SSRN Journal 2020:1-23 [FREE Full text] [CrossRef]
  25. Abd-Alrazaq A, Alhuwail D, Househ M, Hamdi M, Shah Z. Top concerns of Tweeters during the COVID-19 pandemic: infoveillance study. J Med Internet Res 2020 Apr 21;22(4):e19016 [FREE Full text] [CrossRef] [Medline]
  26. Sinnenberg L, Buttenheim AM, Padrez K, Mancheno C, Ungar L, Merchant RM. Twitter as a tool for health research: A systematic review. Am J Public Health 2017 Jan;107(1):e1-e8. [CrossRef] [Medline]
  27. Chandrasekaran R, Mehta V, Valkunde T, Moustakas E. Topics, trends, and sentiments of tweets about the COVID-19 pandemic: temporal infoveillance study. J Med Internet Res 2020 Oct 23;22(10):e22624 [FREE Full text] [CrossRef] [Medline]
  28. Valdez D, Ten Thij M, Bathina K, Rutter L, Bollen J. Social media insights into US mental health during the COVID-19: longitudinal analysis of Twitter data. J Med Internet Res 2020 Dec 14;22(12):e21418 [FREE Full text] [CrossRef] [Medline]
  29. Hemphill L, Russell A, Schöpke‐Gonzalez AM. What drives U.S. congressional members’ policy attention on Twitter? Policy Internet 2020 Jun 28;13(2):233-256. [CrossRef]
  30. Barberá P, Casas A, Nagler J, Egan PJ, Bonneau R, Jost JT, et al. Who leads? Who follows? Measuring issue attention and agenda setting by legislators and the mass public using social media data. Am Polit Sci Rev 2019 Jul 12;113(4):883-901 [FREE Full text] [CrossRef] [Medline]
  31. Casas A, Payson J, Nagler J, Bonneau R, Tucker JA. Social Media Data Reveal Patterns of Policy Engagement in State Legislatures. SSRN Journal 2020:1-37. [CrossRef]
  32. Milligan M, Hoyt D, Gold A, Hiserodt M, Otto M. COVID-19 vaccine acceptance: influential roles of political party and religiosity. Psychol Health Med 2022 Oct;27(9):1907-1917. [CrossRef] [Medline]
  33. Mheidly N, Fares J. Leveraging media and health communication strategies to overcome the COVID-19 infodemic. J Public Health Policy 2020 Dec;41(4):410-420 [FREE Full text] [CrossRef] [Medline]
  34. Grossman G, Kim S, Rexer JM, Thirumurthy H. Political partisanship influences behavioral responses to governors' recommendations for COVID-19 prevention in the United States. Proc Natl Acad Sci U S A 2020 Sep 29;117(39):24144-24153 [FREE Full text] [CrossRef] [Medline]
  35. Cook JM. Are American politicians as partisan online as they are offline? Twitter networks in the U.S. Senate and Maine State Legislature. Policy Internet 2016;8(1):55-71. [CrossRef]
  36. Guntuku S, Purtle J, Meisel Z, Merchant R, Agarwal A. Partisan differences in Twitter language among US legislators during the COVID-19 pandemic: cross-sectional study. J Med Internet Res 2021 Jun 03;23(6):e27300 [FREE Full text] [CrossRef] [Medline]
  37. Quorum.   URL: https://www.quorum.us/ [accessed 2023-01-25]
  38. List of United States state legislatures. Wikipedia.   URL: https://en.wikipedia.org/w/index.php?title=List_of_United_States_state_legislatures&oldid=1135333667 [accessed 2023-01-26]
  39. Members of the U.S. Congress. U.S. Congress.   URL: http://www.congress.gov/ [accessed 2023-01-26]
  40. Stokes D, Purtle J, Meisel Z, Agarwal A. State legislators' divergent social media response to the opioid epidemic from 2014 to 2019: longitudinal topic modeling analysis. J Gen Intern Med 2021 Nov;36(11):3373-3382 [FREE Full text] [CrossRef] [Medline]
  41. Engel-Rebitzer E, Stokes DC, Buttenheim A, Purtle J, Meisel ZF. Changes in legislator vaccine-engagement on Twitter before and after the arrival of the COVID-19 pandemic. Hum Vaccin Immunother 2021 Sep 02;17(9):2868-2872 [FREE Full text] [CrossRef] [Medline]
  42. Blei DM, Ng AY, Jordan MI. Latent Dirichlet allocation. J Mach Learn Res 2003;3:993-1022 [FREE Full text] [CrossRef]
  43. Julia S, David R. Text Mining with R - A Tidy Approach. Tidytextmining.   URL: https://www.tidytextmining.com/ [accessed 2023-02-15]
  44. McCallum A. Mallet: A machine learning for language toolkit. University of Massachusetts. 2002.   URL: https://mallet.cs.umass.edu/index.php/Main_Page [accessed 2023-02-15]
  45. Agarwal AK, Wong V, Pelullo AM, Guntuku S, Polsky D, Asch DA, et al. Online reviews of specialized drug treatment facilities-identifying potential drivers of high and low patient satisfaction. J Gen Intern Med 2020 Jun;35(6):1647-1653 [FREE Full text] [CrossRef] [Medline]
  46. Ranard BL, Werner RM, Antanavicius T, Schwartz HA, Smith RJ, Meisel ZF, et al. Yelp reviews of hospital care can supplement and inform traditional surveys of the patient experience of care. Health Aff (Millwood) 2016 Apr;35(4):697-705 [FREE Full text] [CrossRef] [Medline]
  47. Hutto C, Gilbert E. VADER: a parsimonious rule-based model for sentiment analysis of social media text. In: Proceedings of the International AAAI Conference on Web and Social Media. 2014 May 16 Presented at: Eighth International AAAI Conference on Weblogs and Social Media (ICWSM-14); June 1-4, 2014; Ann Arbor, MI p. 216-225. [CrossRef]
  48. Kingdon J, Stano E. Agendas, Alternatives, and Public Policies. Boston, MA: Little, Brown; 1984.
  49. Gold K, Schwenk T, Sen A. Physician suicide in the United States: updated estimates from the National Violent Death Reporting System. Psychol Health Med 2022 Aug;27(7):1563-1575. [CrossRef] [Medline]
  50. Ye GY, Davidson JE, Kim K, Zisook S. Physician death by suicide in the United States: 2012-2016. J Psychiatr Res 2021 Feb;134:158-165. [CrossRef] [Medline]
  51. Kalmoe M, Chapman M, Gold J, Giedinghagen A. Physician suicide: a call to action. Mo Med 2019;116(3):211-216 [FREE Full text] [Medline]


LDA: latent Dirichlet allocation
VADER: Valence Aware Dictionary and Sentiment Reasoner


Edited by A Mavragani; submitted 12.04.22; peer-reviewed by Z Butt, D Lambert; comments to author 18.01.23; revised version received 26.01.23; accepted 10.02.23; published 24.02.23

Copyright

©Matthew P Abrams, Arthur P Pelullo, Zachary F Meisel, Raina M Merchant, Jonathan Purtle, Anish K Agarwal. Originally published in JMIR Infodemiology (https://infodemiology.jmir.org), 24.02.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Infodemiology, is properly cited. The complete bibliographic information, a link to the original publication on https://infodemiology.jmir.org/, as well as this copyright and license information must be included.