USING DOPS (DIRECTLY OBSERVED PROCEDURAL SKILLS) FOR PRE CALL ASSESSMENT OF ULTRASOUND PROFICIENCY OF FIRST YEAR RADIOLOGY RESIDENTS: DEVELOPMENT AND INITIAL ANALYSIS.

Abstract

Imaad ur Rehman, Rustam Alam Shah,  Ahmed Kamal, Mobeen Ahmed.

 Department of Radiology, Shifa International Hospital, H-8/4, Islamabad, Pakistan.

Address correspondence to : e-mail: imaadur@gmail.com

Rationale and Objectives: DOPS (Directly Observed Procedural Skills) is a relatively new educational technique for assessment of practical skills assessment of radiology residents. We conducted 2 DOPS session over two years for ultrasound proficiency assessment of first year radiology residents.  The purpose of this study was to assess  feasibility and potential benefits of DOPS and to decide its future implementation in our department.

Material and Methods: Each first year junior radiology resident was rotated in the department of ultrasound at initiation of training for  2 months programmed ultrasound rotation. At the end of the rotation, a  senior  radiologist, with more than 4 years post fellowship experience in ultrasound, carried out DOPS assessment session of these residents. A single station was made with ultrasound performed on a mock patient (healthy volunteer). A  DOPS Proforma was designed and assessment was marked in four areas (approach to patient, knobology of machine, theoretical knowledge and technique) and performance was graded according to a set scale. A post DOPS questionnaire was given to participating junior residents to give their opinion on this newer system. Another questionnaire was given to the senior residents to assess outcome of this exercise in terms of improvement in ultrasound skills of first year residents during call hours. 

Results: Over two years, 7 of 8 first year residents (87%) passed the exam on first attempt. The one who failed was remediated after attending extra ultrasound sessions and passed the exam a week later. All were put on night call subsequently.  A post implementation survey was conducted  from all the junior (n=8) and senior (n=7) radiology residents with 100% response rate. Eighty percent (n=12) of the residents thought that this new tool was effective in improving their ultrasound proficiency and should be implemented in future . Hundred percent (n=15) thought it to be better than conventional end of rotation written feedback. Eighty five  percent (n=6) of  senior residents felt that there was improvement in junior resident ultrasound skills during call hours as compared to previous years.

Conclusions: Compared to our conventional  end of rotation written feedback,  using DOPS for proficiency assessment of  ultrasound of  first year radiology  residents has been  judged to be a  useful assessment tool  prior to starting call.

Keywords: DOPS ( Directly Observed Procedural Skills), ultrasound proficiency, radiology residents.