ASSESSMENT OF OTOLARYNGOLOGY RESIDENTS" SURGICAL PERFORMANCE WITH THE TYMPANOMASTOIDECTOMY OBJECTIVE STRUCTURED ASSESSMENT OF TECHNICAL SKILLS

Material and Methods: For the task-based checklist (G-CBC), the researchers reviewed existing OSATS tools in the literature. They then developed the G-CBC by creating items that reflected the surgical steps of the tympanomastoidectomy procedure. For the global rating component (B-CBC), the relevant section of the OSATS developed by Francis et al. was utilized. The surgical performance of five otolaryngology residents was observed across 36 tympanomastoidectomy procedures and evaluated using the TM-OSATS. The validity and reliability of the TM-OSATS were subsequently assessed.

Results: To evaluate the validity of the tool, the scores of the resident with the highest number of assessments were ordered chronologically by procedure date. The first 10 evaluation scores were statistically compared with the last 10. For the task-specific checklist (G-CBC), which constitutes the first part of the TM-OSATS, the result was p = 0.445 (p > 0.05), while for the global rating scale (B-CBC), the second part, the result was p = 0.008 (p < 0.05).

To assess the reliability of both sections of the TM-OSATS, Cronbach's alpha was calculated. The Cronbach's alpha was α=0.943 for the G-CBC and α=0.959 for the B-CBC. These results indicate a high level of internal consistency and reliability for both components of the TM-OSATS.

Conclusion: In this study, the TM-OSATS was developed to assess the tympanomastoidectomy performance of otolaryngology residents. The limitations identified should be taken into consideration in future multicenter investigations. Keywords : Surgical skills, workplace-based assessment, residency training, objective structurel assessment of technical skills