OSATS assessment and its use in otorhinolaryngology

Czech version

Authors: Z. Mateášiková; R. Salzman
Authors‘ workplace: Klinika otorinolaryngologie a chirurgie hlavy a krku LF UP a FN Olomouc
Published in: Otorinolaryngol Foniatr, 75, 2026, No. 2, pp. 157-162.
Category: Review Article
doi: https://doi.org/10.48095/ccorl2026-005

Overview

The objective structured assessment of technical skills (OSATS) is a validated, objective, and reproducible tool designed to evaluate surgical skills across a wide range of procedures. Beyond assessing the level of technical proficiency and competence, OSATS also provides structured, actionable feedback that can be instrumental in identifying and addressing specific areas for improvement in surgical performance. In light of the growing emphasis on quality and safety in surgical care, there is a clear and increasing need for reliable and standardized methods of skill assessment. This study explores the application of the OSATS framework within specialty training in otorhinolaryngology. It provides a comprehensive overview of the current literature, discusses the potential benefits of OSATS in both clinical practice and research, and presents findings from a pilot study conducted in the Czech Republic.

Keywords:

surgery – Education – Otorhinolaryngology – assessment – OSATS – skill

Sources

Marglani O, Alherabi A, Al-Andejani T et al. Development of a tool for global rating of endoscopic surgical skills (GRESS) for assessment of otolaryngology residents. B-ENT 2012; 8(3): 191–195. Doi: 10.5152/B-ENT.2012.006.
Martin JA, Regehr G, Reznick R et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 1997; 84(2): 273–278. Doi: 10.1046/j.1365-2168.1997.02502.x.
Tang B, Cuschieri A. Objective assessment of surgical operative performance by observational clinical human reliability analysis (OCHRA): a systematic review. Surg Endosc 2020; 34(4): 1492–1508. Doi: 10.1007/s00464-019-07365-x.
Datta V, Bann S, Beard J et al. Comparison of bench test evaluations of surgical skill with live operating performance assessments. J Am Coll Surg 2004; 199(4): 603–606. Doi: 10.1016/j.jamcollsurg.2004.05.269.
Vaidya A, Aydin A, Ridgley J et al. Current status of technical skills assessment tools in surgery: a systematic review. J Surg Res 2020; 246 : 342–378. Doi: 10.1016/j.jss.2019.09.006.
Swift SE, Carter JF. Institution and validation of an observed structured assessment of technical skills (OSATS) for obstetrics and gynecology residents and faculty. Am J Obstet Gynecol 2006; 195(2): 617–621. Doi: 10.1016/j.ajog.2006.05.032.
Vernez SL, Huynh V, Osann K et al. C-SATS: assessing surgical skills among urology residency applicants. J Endourol 2017; 31(S1): S95–S100. Doi: 10.1089/end.2016.0569.
Jakubowski L, Leader BA, Ishman SL et al. Validation of an Objective Assessment Tool for Tonsillectomy in Otolaryngology Resident Training. Laryngoscope 2021; 131(2): E359–E366. Doi: 10.1002/lary.28739.
Francis HW, Masood H, Chaudhry KN et al. Objective assessment of mastoidectomy skills in the operating room. Otol Neurotol 2010; 31(5): 759–765. Doi: 10.1097/MAO.0b013e3181e3d385.
Suzuki M, Miyaji K, Watanabe R et al. Repetitive simulation training with novel 3D-printed sinus models for functional endoscopic sinus surgeries. Laryngoscope Investig Otolaryngol 2022; 7(4): 943–954. Doi: 10.1002/lio2.873.
American Medical Association. Competency-based medical education [online]. Available from: https://www.ama-assn.org/ed- ucation/changemeded-initiative/competencybased-medical-education. Accessed: 14 June 2023.
Bhatti NI. Assessment of Surgical Skills and Competency. Otolaryngol Clin North Am 2017; 50(5): 959–965. Doi: 10.1016/j.otc.2017.05.007.
Propst EJ, Wolter NE, Ishman SL et al. Competency-based assessment tool for pediatric tracheotomy: international modified Delphi consensus. Laryngoscope 2019; 130(11): 2700–2707. Doi: 10.1002/lary.27861.
Darzi A, Mackay S. Assessment of surgical competence. Qual Health Care 2001 Dec; 10 Suppl 2(Suppl 2): ii64–ii69. Doi: 10.1136/qhc.0100064.
Undre S, Healey AN, Darzi A et al. Observational assessment of surgical teamwork: a feasibility study. World J Surg 2006; 30(10): 1774–1783. Doi: 10.1007/s00268-005-0488-9.
Wiet GJ, Deutsch ES, Malekzadeh S et al. SimTube: A National Simulation Training and Research Project. Otolaryngol Head Neck Surg 2020; 163(3): 522–530. Doi: 10.1177/0194599820920833.
Curry M, Malpani A, Li R et al. Objective assessment in residency-based training for transoral robotic surgery. Laryngoscope 2012; 122(10): 2184–2192. Doi: 10.1002/lary.23369.
Dzan L, Mamiňák K, Čapek L et al. Využití 3D tisku v chirurgii hlavy a krku. Otorinolaryngol Foniatr 2024; 73(3): 176–181. Doi: 10.48095/ccorl2024176.
Crafts TD, Ellsperman SE, Wannemuehler TJ et al. Three-dimensional printing and its applications in otorhinolaryngology –⁠ head and neck surgery. Otolaryngol Head Neck Surg 2017; 156(6): 999-1010. Doi: 10.1177/0194599816678372.
Francis HW, Masood H, Chaudhry KN et al. Objective assessment of mastoidectomy skills in the operating room. Otol Neurotol 2010; 31(5): 759–765. Doi: 10.1097/MAO. 0b013e3181e3d385.
Ramazani F, Wright ED, Randall DR et al. Developing an objective structured assessment of technical skills (OSATS) for microlaryngoscopy. Laryngoscope 2023; 133(10): 2719–2724. Doi: 10.1002/lary.30610.
Alcalá Rueda I, Villacampa Aubá JM, Encinas Vicente A et al. A live porcine model for surgical training in tracheostomy, neck dissection, and total laryngectomy. Eur Arch Otorhinolaryngol 2021; 278(8): 3081–3090. Doi: 10.1007/s00405-021-06613-y.
Payen C, Carsuzaa F, Gallet P et al. Porcine model for tracheostomy training: evaluation of the content and construct validity. Eur Arch Otorhinolaryngol 2023; 280(12): 5631–5636. Doi: 10.1007/s00405-023-08232-1.
Payen C, Carsuzaa F, Kucharczak F et al. Swine model for total laryngectomy training: assessment of the face, content, and construct validity. Eur Arch Otorhinolaryngol 2025 Apr 25. Doi: 10.1007/s00405-025-09408-7.
Sethia R, Kerwin TF, Wiet GJ. Performance assessment for mastoidectomy. Otolaryngol Head Neck Surg 2017; 156(1): 61–69. Doi: 10.1177/0194599816670886.