Using Objective Structured Clinical Examinations to Assess Intern Orthopaedic Physical Examination Skills: A Multimodal Didactic Comparison.

Patient care is 1 of the 6 core competencies defined by the Accreditation Council for Graduate Medical Education (ACGME). The physical examination (PE) is a fundamental skill to evaluate patients and make an accurate diagnosis. The purpose of this study was to investigate 3 different methods to teach PE skills and to assess the ability to do a complete PE in a simulated patient encounter. Prospective, uncontrolled, observational. Northeastern academic medical center. A total of 32 orthopedic surgery residents participated and were divided into 3 didactic groups: Group 1 (n = 12) live interactive lectures, demonstration on standardized patients, and textbook reading; Group 2 (n = 11) video recordings of the lectures given to Group 1 and textbook reading alone; Group 3 (n = 9): 90-minute modules taught by residents to interns in near-peer format and textbook reading. The overall score for objective structured clinical examinations from the combined groups was 66%. There was a trend toward more complete PEs in Group 1 taught via live lectures and demonstrations compared to Group 2 that relied on video recording. Near-peer taught residents from Group 3 significantly outperformed Group 2 residents overall (p = 0.02), and trended toward significantly outperforming Group 1 residents as well, with significantly higher scores in the ankle (p = 0.02) and shoulder (p = 0.02) PE cases. This study found that orthopedic interns taught musculoskeletal PE skills by near-peers outperformed other groups overall. An overall score of 66% for the combined didactic groups suggests a baseline deficit in first-year resident musculoskeletal PE skills. The PE should continue to be taught and objectively assessed throughout residency to confirm that budding surgeons have mastered these fundamental skills before going into practice.

Phillips D ，Pean CA ，Allen K ，Zuckerman J ，Egol K ... -  《-》

Implementation of an objective structured clinical exam (OSCE) into orthopedic surgery residency training.

While the musculoskeletal (MSK) physical examination (PE) is an essential part of a patient encounter, we believe it is an underemphasized component of orthopedic residency education and that resident PE skills may be lacking. The purpose of this investigation was to (1) assess the attitudes regarding PE teaching in orthopedic residencies today; (2) develop an MSK objective structured clinical examination (OSCE) to assess the MSK PE knowledge and skills of our orthopedic residents. Prospective, uncontrolled, observational. A major Midwestern tertiary referral center and academic medical center. The orthopedic surgery residents in our program. Twenty-two of 24 completed the OSCE. Surveys showed that residents agreed that although learning the PE is important, there is not enough time in clinic to actually observe and critique a resident examining a patient. For the 22 residents (postgraduate year [PGY] 2-5) who participated in the OSCE, the overall score was 66%. Scores were significantly better for the trauma scenario (78%; p < 0.05) than for the shoulder (67%), spine (64%), and knee (59%) encounters. The overall scores for each component of the OSCE were: (1) history 53%; (2) PE 60%; (3) 5-question posttest 64%; and (4) communication skills 90%. We have exposed a deficiency in the PE knowledge and skills of our residents. Clinic time alone may be insufficient to both teach and learn the MSK PE. The use of a MSK OSCE, while novel in orthopedics, will allow more direct observation of our residents MSK PE skills and also allow us to follow resident skills longitudinally through their training. We hope that our efforts will encourage other programs to assess their PE curriculum and perhaps prompt change.

Griesser MJ ，Beran MC ，Flanigan DC ，Quackenbush M ，Van Hoff C ，Bishop JY ... -  《-》

Examination to assess the clinical examination and documentation of spine pathology among orthopedic residents.

The Accreditation Council for Graduate Medical Education (ACGME) guidelines requires residency programs to teach and evaluate residents in six overarching "core competencies" and document progress through educational milestones. To assess the progress of orthopedic interns' skills in performing a history, physical examination, and documentation of the encounter for a standardized patient with spinal stenosis, an objective structured clinical examination (OSCE) was conducted for 13 orthopedic intern residents, following a 1-month boot camp that included communications skills and curriculum in history and physical examination. Interns were objectively scored based on their performance of the physical examination, communication skills, completeness and accuracy of their electronic medical record (EMR), and their diagnostic conclusions gleaned from the patient encounter. The purpose of this study was to meaningfully assess the clinical skills of orthopedic post-graduate year (PGY)-1 interns. The findings can be used to develop a standardized curriculum for documenting patient encounters and highlight common areas of weakness among orthopedic interns with regard to the spine history and physical examination and conducting complete and accurate clinical documentation. A major orthopedic specialty hospital and academic medical center. Thirteen PGY-1 orthopedic residents participated in the OSCE with the same standardized patient presenting with symptoms and radiographs consistent with spinal stenosis. Videos of the encounters were independently viewed and objectively evaluated by one investigator in the study. This evaluation focused on the completeness of the history and the performance and completion of the physical examination. The standardized patient evaluated the communication skills of each intern with a separate objective evaluation. Interns completed these same scoring guides to evaluate their own performance in history, physical examination, and communications skills. The interns' documentation in the EMR was then scored for completeness, internal consistency, and inaccuracies. The independent review revealed objective deficits in both the orthopedic interns' history and the physical examination, as well as highlighted trends of inaccurate and incomplete documentation in the corresponding medical record. Communication skills with the patient did not meet expectations. Further, interns tended to overscore themselves, especially with regard to their performance on the physical examination (p<.0005). Inconsistencies, omissions, and inaccuracies were common in the corresponding medical notes when compared with the events of the patient encounter. Nine of the 13 interns (69.2%) documented at least one finding that was not assessed or tested in the clinical encounter, and four of the 13 interns (30.8%) included inaccuracies in the medical record, which contradicted the information collected at the time of the encounter. The results of this study highlighted significant shortcomings in the completeness of the interns' spine history and physical examination, and the accuracy and completeness oftheir EMR note. The study provides a valuable exercise for evaluating residents in a multifaceted, multi-milestone manner that more accurately documents residents' clinical strengths and weaknesses. The study demonstrates that orthopedic residents require further instruction on the complexities of the spinal examination. It validates a need for increased systemic support for improving resident documentation through comprehensive education and evaluation modules.

Haglin JM ，Zeller JL ，Egol KA ，Phillips DP ... -  《-》

Implementation of an intern boot camp curriculum to address clinical competencies under the new Accreditation Council for Graduate Medical Education supervision requirements and duty hour restrictions.

Krajewski A ，Filippa D ，Staff I ，Singh R ，Kirton OC ... -  《-》

Finding Value in Surgical Didactics: Longitudinal Resident Feedback From Case-Based and Traditional Lectures in an Orthopaedic Residency.

To evaluate orthopedic resident perceptions of a didactic curriculum presented in traditional and case-based formats. Prospective cohort study using anonymous web-based survey after each conference evaluating resident perceptions of faculty participation, didactic delivery, content, and overall conference value. Conferences were structured as primarily case-based or traditional lecture. Logistic analysis was performed to determine factors predictive of rating a conference as valuable time spent. Orthopedic residency training program at single institution over an academic year. Orthopedic residents in postgraduate training year 1 to 5 attending mandatory didactic conference. Cased-based conferences received higher Likert ratings on residents' perception of faculty participation, instructor delivery, and improvement in topic understanding when compared to traditional lecture-based conferences (p < 0.0001 for each factor). Residents also were more likely to rate case-based conferences as valuable time spent (p < 0.0001). In our logistic model, factors associated with a negative likelihood of rating a conference as valuable were lecture format (odds ratio [OR] = 0.155, 95% CI: 0.115-0.208), PGY-2 level presenter (OR = 0.288, 95% CI: 0.169-0.490), and PGY-3 level presenter (OR = 0.433, 95% CI: 0.269-0.696). Timing in the year, surgical subspeciality, and conference identity were not significant predictors of conference value rating. Longitudinal resident feedback demonstrates highly favorable resident perceptions toward case-based formats in didactic sessions. Junior levels residents are not perceived as effective as senior residents and faculty in presenting material in either format. These methods allow for a dynamic approach to identifying strengths and weaknesses in a resident curriculum as a well as a means for more focused and real-time improvements.

Barnwell JC ，Halvorson JJ ，Teasdall RD ，Carroll EA ... -  《-》