Year one outcomes assessment of a masters suturing and knot-tying program for surgical interns.

We implemented and evaluated the outcomes of a proficiency-based program to enhance basic suturing and knot-tying skills in surgical interns. A suturing and knot-tying "masters program" was implemented for 9 surgical interns. Assessment consisted of timed and videotaped technical performance (TP) of 6 suturing (simple interrupted, subcuticular, and vertical mattress) and tying tasks (1-handed, 2-handed, and tie on pass) preinstruction (baseline) and at 4 months. Feedback and remediation were done after 4 months, and interns were retested until goals were met. TP was scored on a 1-5 scale (1 = novice, 3 = proficient, and 5 = expert). The results were compared with 6 end of PGY2 year residents and rotation evaluations, case numbers, and American Board of Surgery In-Training Examination (ABSITE) scores. The data are mean ± standard deviation (SD); statistical analysis was by 1-way ANOVA, Kruskal-Wallis test, and Pearson correlation. The total combined task times improved significantly from initial (1289 ± 301 seconds) to final assessment (770 ± 139 seconds, p = 0.0003) and between 4-month assessment (1092 ± 253 seconds) and final assessment (p = 0.0237), but not baseline to 4-month assessment (p = 0.213). Final TP scores were improved significantly (baseline, 1.87 ± 0.81; 4-month assessment, 2.63 ± 0.75; and final assessment 3.51 ± 0.39 [p < 0.001]. All interns reached proficiency on 6/6 tasks but not until 10.1 months (range, 4-12 months) and 2.4 assessment sessions (range, 1-3). No significant differences in final total task times or TP scores were found between interns (770 ± 139 seconds and TP, 3.51 ± 0.39) and end of PGY-2 residents (677 ± 109 seconds and TP, 3.6 ± 0.43). The total task time and rotation technical comments were associated significantly, but TP scores, case numbers, and ABSITE scores were not. Training, feedback, and remediation are necessary to reach proficiency in basic suturing and knot tying. This program provides an objective assessment of interns' skills not discernible by conventional measures.

Schill M ，Tiemann D ，Klingensmith ME ，Brunt LM ... -  《-》

Boot cAMP: educational outcomes after 4 successive years of preparatory simulation-based training at onset of internship.

Preparatory training for new trainees beginning residency has been used by a variety of programs across the country. To improve the clinical orientation process for our new postgraduate year (PGY)-1 residents, we developed an intensive preparatory training curriculum inclusive of cognitive and procedural skills, training activities considered essential for early PGY-1 clinical management. We define our surgical PGY-1 Boot Camp as preparatory simulation-based training implemented at the onset of internship for introduction of skills necessary for basic surgical patient problem assessment and management. This orientation process includes exposure to simulated patient care encounters and technical skills training essential to new resident education. We report educational results of 4 successive years of Boot Camp training. Results were analyzed to determine if performance evidenced at onset of training was predictive of later educational outcomes. Learners were PGY-1 residents, in both categorical and preliminary positions, at our medium-sized surgical residency program. Over a 4-year period, from July 2007 to July 2010, all 30 PGY-1 residents starting surgical residency at our institution underwent specific preparatory didactic and skills training over a 9-week period. This consisted of mandatory weekly 1-hour and 3-hour sessions in the Simulation Center, representing a 4-fold increase in time in simulation laboratory training compared with the remainder of the year. Training occurred in 8 procedural skills areas (instrument use, knot-tying, suturing, laparoscopic skills, airway management, cardiopulmonary resuscitation, central venous catheter, and chest tube insertion) and in simulated patient care (shock, surgical emergencies, and respiratory, cardiac, and trauma management) using a variety of high- and low-tech simulation platforms. Faculty and senior residents served as instructors. All educational activities were structured to include preparatory materials, pretraining briefing sessions, and immediate in-training or post-training review and debriefing. Baseline cognitive skills were assessed with written tests on basic patient management. Post-Boot Camp tests similarly evaluated cognitive skills. Technical skills were assessed using a variety of task-specific instruments, and expressed as a mean score for all activities for each resident. All measurements were expressed as percent (%) best possible score. Cognitive and technical performance in Boot Camp was compared with subsequent clinical and core curriculum evaluations including weekly quiz scores, annual American Board of Surgery In-Training Examination (ABSITE) scores, program in-training evaluations (New Innovations, Uniontown, Ohio), and operative assessment instrument scores (OP-Rate, Baystate Medical Center, Springfield, Massachusetts) for the remainder of the PGY-1 year. Performance data were available for 30 PGY-1 residents over 4 years. Baseline cognitive skills were lower for the first year of Boot Camp as compared with subsequent years (71 ± 13, 83 ± 9, 84 ± 11, and 86 ± 6, respectively; p = 0.028, analysis of variance; ANOVA). Performance improved between pretests and final testing (81 ± 11 vs 89 ± 7; p < 0.001 paired t test). There was statistically significant correlation between Boot Camp final cognitive test results and American Board of Surgery In-Training Examination scores (p = 0.01; n = 22), but not quite significant for weekly curriculum quiz scores (p = 0.055; n = 22) and New Innovations cognitive assessments (p = 0.09; n = 25). Statistically significant correlation was also noted between Boot Camp mean overall skills and New Innovations technical skills assessments (p = 0.002; n = 25) and OP-Rate assessments (p = 0.01; n = 12). Individual simulation-based Boot Camp performance scores for cognitive and procedural skills assessments in PGY-1 residents correlate with subjective and objective clinical performance evaluations. This concurrent correlation with multiple traditional evaluation methods used to express competency in our residency program supports the use of Boot Camp performance measures as needs assessment tools as well as adjuncts to cumulative resident evaluation data.

Fernandez GL ，Page DW ，Coe NP ，Lee PC ，Patterson LA ，Skylizard L ，St Louis M ，Amaral MH ，Wait RB ，Seymour NE ... -  《-》

Video self-assessment of basic suturing and knot tying skills by novice trainees.

Self-assessment is important to learning but few studies have utilized video self-assessment of basic surgical skills. We compared a video self-assessment of suturing and knot tying skills by novice trainees to the assessment by a senior attending surgeon. Sixteen senior medical students and 7 beginner surgical interns were video-recorded while performing five suturing and knot tying tasks. All videos were analyzed using an objective structured assessment of technical skills (OSATS) metrics (1-5 scale; 1 = novice, 5 = expert). Video self-assessment was carried out within 4 weeks of an instructional session and subsequently by one senior surgery instructor (blinded to the individual). Both a Global score and total combined OSATS scores were analyzed. Total possible OSATS scores were: interrupted suture-30, subcuticular closure-30, one and two-handed knot tying-25 each, tying in a restricted space 20; maximum combined score-130 points). Confidence levels in performing the tasks pre-test and the value of video self-assessment were rated on a 1-5 Likert scale (1 = low and 5 = high). Data are mean±SD and statistical significance was evaluated using Friedman's test. Self-assessment scoring was significantly higher than the assessment by a senior instructor for three tasks by global score and all five tasks by combined OSATS score (self-assessment 71.8±16.7 vs attending assessment 56.7±11.0, p = 0.007). Mean self-assessment Global scores ranged from 2.5 to 2.8 for all tasks performed compared to 1.8-2.3 for attending surgeon assessment (p<0.05). Confidence levels demonstrated no correlation to performance speed or proficiency. The video self-assessment was rated as a highly valuable (mean 4.3±0.8) component to skills training. Novice trainees over-estimate their basic technical skills performance compared to the assessment by a senior surgeon. Video self-assessment may be a valuable addition to a pre-residency and surgical internship preparatory curriculum in basic suturing and knot tying.

Hu Y ，Tiemann D ，Michael Brunt L 《-》

Accelerated skills preparation and assessment for senior medical students entering surgical internship.

Brunt LM ，Halpin VJ ，Klingensmith ME ，Tiemann D ，Matthews BD ，Spitler JA ，Pierce RA ... -  《-》

Residents can successfully teach basic surgical skills in the simulation center.

Basic surgical skills are frequently taught to surgical interns in simulation centers. Faculty recruitment for teaching of these sessions can be difficult. The goal of this study was to determine whether senior surgical residents can effectively teach basic surgical skills to provide an alternative to faculty-led instruction. Academic medical center. Twenty-eight surgical interns. In this randomized controlled trial, interns were randomized to receive teaching by either faculty or senior residents. Two-hour teaching sessions for each group consisted of modeling and guided practice. All interns underwent baseline knot-tying and suturing skill assessment using a previously validated standardized task scoring scheme and completed a confidence survey. After teaching sessions, both groups underwent repeated skill testing and were again surveyed. Twenty-eight interns started in the surgery program at our institution during the year of this study. Seventeen of 27 (62.9%) interns participated in both teaching sessions and completed all skill assessments and surveys; 7 (41.2%) interns were taught by faculty, 10 (58.8%) by residents. Overall, skills training improved in both groups for knot-tying, running suture, and subcuticular suture performance. Confidence performing knot-tying tasks also improved. Interns taught by faculty members and residents demonstrated similar levels of improvement in speed and accuracy, although faculty instruction improved speed of performing the simple suturing task (-144 vs -27 s, p = 0.04). In the simulation center, teaching by senior surgical residents and faculty members resulted in comparable improvement in interns' basic surgical skills. These findings could increase the skill instructor pool for teaching in the simulation center, potentially easing recruitment and providing senior residents with teaching opportunities.

Pernar LI ，Smink DS ，Hicks G ，Peyre SE ... -  《-》