SimLEARN Musculoskeletal Training for VHA Primary Care Providers and Health Professions Educators

Participants

Opportunity to attend was communicated through national, regional, and local VHA organizational networks. Participants self-registered online through the VHA Talent Management System, the main learning resource for VHA employee education, and registration was open to both PCPs and clinician educators. Class size was limited to 10 to facilitate detailed faculty observation during skill acquisition experiences, simulations, and assessment exercises.

Program Evaluation

A standard process for evaluating and measuring learning objectives was performed through VHA EES. Self-assessment surveys and OSCEs were used to assess the activity.

Self-assessment surveys were administered at the beginning and end of the program. Content was adapted from that used in the national MSK Mini-Residency initiative and revised by experts in survey design.^18,24,25 Pre- and postcourse surveys asked participants to rate how important it was for them to be competent in evaluating shoulder and knee pain and in performing related joint injections, as well as to rate their level of confidence in their ability to evaluate and manage these conditions. The survey used 5 construct-specific response options distributed equally on a visual scale. Participants’ learning goals were collected on the precourse survey.

Participants’ competence in performing and interpreting a systematic and thorough physical examination of the shoulder and in suggesting a reasonable plan of management were assessed using a single-station OSCE. This tool, which presented learners with a simulated case depicting rotator cuff pathology, has been described in multiple educational settings, and validity evidence supporting its use has been published.^18,19,23 Course faculty conducted the OSCE, one as the simulated patient, the other as the rater. Immediately following the examination, both faculty conducted a debriefing session with each participant. The OSCE was scored using the validated checklist for specific elements of the shoulder exam, followed by a structured sequence of questions exploring participants’ interpretation of findings, diagnostic impressions, and recommendations for initial management. Scores for participants’ differential diagnosis were based on the completeness and specificity of diagnoses given; scores for management plans were based on appropriateness and accuracy of both the primary and secondary approach to treatment or further diagnostic efforts. A global rating (range 1 to 9) was assigned, independent of scores in other domains.

Following the OSCE, participants rotated through a 3-cycle OSTE where they practiced the roles of simulated patient, learner, and educator. Faculty observed each OSTE and led focused debriefing sessions immediately following each rotation to facilitate participants’ critical reflection of their involvement in these elements of the course. This exercise was formative without quantitative assessment of performance.

Statistical Analysis

Pre- and postsurvey data were analyzed using a paired Student t test. Comparisons between multiple variables (eg, OSCE scores by years of experience or level of credentials) were analyzed using analysis of variance. Relationships between variables were analyzed with a Pearson correlation. All statistical analyses were conducted using IBM SPSS, Version 24 (Armonk, NY).

This project was reviewed by the institutional review board of the University of Utah and the Salt Lake City VA and was determined to be exempt from review because the work did not meet the definition of research with human subjects and was considered a quality improvement study.