Using a Comprehensive Examination to Assess Multiple Competencies in Surgical Residents: Does the Oral Examination Still Have a Role? - 21/08/11
Résumé |
Background |
While specialty-level evaluations evolve from traditional examinations to objective structured clinical examination-like assessments, a broader range of competencies are tested; consequently, examiners are forced to integrate results when making a determination of competency. The aim of this study was to describe how experts weigh relative performances on specific components of a comprehensive examination to make decisions of overall competency.
Study design |
The Patient Assessment and Management Examination is a standardized patient-based assessment of general surgery in which each 25-minute station encompasses four components: history and physical examination, investigation interpretation, diagnosis and treatment discussion with the patient, and a structured oral examination (SOE). A six-station Patient Assessment and Management Examination was administered to 21 senior surgery residents. Surgeons marked each station with global rating scales and, in addition, provided an end-of-station overall global assessment of performance. A “gold-standard” examination pass-or-fail decision was determined through videotape review of each candidate’s performance across six stations by two blinded surgeons. Multiple linear regression analysis was used to determine which components were associated with the end-of-station overall global assessments. Multivariable logistic regression was used to determine which components were associated with the final “gold-standard” pass-or-fail assessment.
Results |
The only component notably (p < 0.005) associated with end-of-station global assessment for all six stations was the SOE. Mean SOE score was the only notable independent variable associated with the gold-standard pass-or-fail decision (R2 = 0.63, p < 0.001).
Conclusions |
Performance on the SOE section of a multicompetency examination is markedly associated with the final determination of competency. These results have implications for the design and implementation of comprehensive specialty-level assessments.
Le texte complet de cet article est disponible en PDF.Abbreviations and Acronyms : GRS, OSCE, PAME, SOE, SP
Plan
Competing Interests Declared: None. Supported by a grant from the Royal College of Physicians and Surgeons of Canada. Dr Regehr is supported as the Richard and Elizabeth Currie Chair in Health Professions Education Research. |
Vol 201 - N° 5
P. 754-758 - novembre 2005 Retour au numéroBienvenue sur EM-consulte, la référence des professionnels de santé.
L’accès au texte intégral de cet article nécessite un abonnement.
Déjà abonné à cette revue ?