Internal Medicine Residents’ Exposure to and Confidence in Managing Hospital Acute Clinical Events
BACKGROUND: Internal Medicine (IM) residency graduates should be able to manage hospital emergencies, but the rare and critical nature of such events poses an educational challenge. IM residents’ exposure to inpatient acute clinical events is currently unknown.
OBJECTIVE: We developed an instrument to assess IM residents’ exposure to and confidence in managing hospital acute clinical events.
METHODS: We administered a survey to all IM residents at our institution assessing their exposure to and confidence in managing 50 inpatient acute clinical events. Exposures assessed included mannequin-based simulation or management of hospital-based events as a part of a team or independently in a leadership role. Confidence was rated on a five-point scale and dichotomized to “confident” versus “not confident.” Results were analyzed by multivariable logistic regression to assess the relationship between exposure and confidence accounting for year in training.
RESULTS: A total of 140 of 170 IM residents (82%) responded. Postgraduate year 1 (PGY-1) residents had managed 31.3% of acute events independently vs 71.7% of events for PGY-3/4 residents (P < .0001). In multivariable analysis, residents’ confidence increased with level of training (PGY-1 residents were confident to manage 24.9% of events vs 72.5% of events for PGY-3/4 residents, P < .0001) and level of exposure, independent of training year (P = .001). Events with the lowest levels of exposure and confidence for graduating residents were identified.
CONCLUSIONS: IM residents’ confidence in managing inpatient acute events correlated with level of training and clinical exposure. We identified events with low levels of resident exposure and confidence that can serve as targets for future curriculum development.
© 2019 Society of Hospital Medicine
METHODS
Survey Development
We reviewed the Massachusetts General Hospital (MGH) IM residency program curriculum (including simulation, conferences, and other didactics), the American Board of Internal Medicine certification requirements (primarily related to Advanced Cardiac Life Support [ACLS]), and the MGH inpatient rapid response events and gained input from the IM program leadership to develop a list of 50 acute clinical events that a graduating resident may be expected to manage independently (Box 1, Supplementary Appendix).7-9 We then developed a survey assessing residents’ exposure to and confidence in managing such events. To classify the level of exposure, residents were asked to distinguish whether they had managed these events during a simulation session, inpatient as a part of a team, or inpatient independently. At our institution, IM postgraduate year 1 (PGY-1) interns manage a floor of patients overnight under a senior resident’s supervision, PGY-2 residents manage a team of several interns often without attending presence on ward rounds,10 and senior PGY-3 or -4 residents are expected to lead the hospital’s rapid response and code team and triage decompensating patients to the intensive care unit. Therefore, there are ample opportunities for IM residents to manage conditions independently (ie, in a direct leadership role) with attending supervision. House officers’ role in medical management, including calling appropriate subspecialty consultation, depends on the clinical condition; for example, a graduating senior resident would be expected to evaluate comprehensively a hypotensive patient and diagnose tension pneumothorax (while calling interventional pulmonary support for needle decompression and chest tube placement) and independently run an ACLS algorithm in the case of an unstable arrhythmia or cardiac arrest.
Residents were also asked to rate their perceived confidence in managing each condition independently on a five-point scale (ranging from “definitely cannot manage this condition independently” to “definitely can manage this condition independently”). We refined the survey instrument through a collaborative, iterative review process, including cognitive interviews and piloting with IM subspecialty fellows.
Participants and Data Collection
All IM residents at the Massachusetts General Hospital were invited to participate in the study. The study was conducted in May 2015 to reflect training throughout the prior academic year(s) and allow us to evaluate graduating residents’ exposures across all prior years of training. The instrument was administered anonymously via a web-based survey tool, Qualtrics (Provo, Utah). The study was approved as exempt by the Partners Institutional Review Board.
Data Analysis
Residents’ self-reported exposure to hospital acute events was classified into the following six ordinal categories: (1) never seen (have never seen the condition under any circumstances); (2) simulation alone (have managed the condition only during a mannequin-simulated patient case); (3) team alone (have managed the condition inpatient as a part of a team of providers, not in a primary leadership role); (4) team plus simulation; (5) independently (have managed the condition inpatient alone or in a primary leadership role); and (6) independently plus simulation. Residents’ self-reported exposure was examined for each postgraduate year (PGY) class both in aggregate and for each individual acute event. We sought to identify events that the majority of residents had managed independently (85% of residents or greater) and less common events that at least 15% of residents had never experienced.
