Imaad Rehman, Rustam Alam Shah, Ahmed Kamal, Mobeen Ahmed


Imaad ur Rehman, Rustam Alam Shah,  Ahmed Kamal, Mobeen Ahmed.


 Department of Radiology, Shifa International Hospital, H-8/4, Islamabad, Pakistan.

Address correspondence to : e-mail:


Rationale and Objectives: DOPS (Directly Observed Procedural Skills) is a relatively new educational technique for assessment of practical skills assessment of radiology residents. We conducted 2 DOPS session over two years for ultrasound proficiency assessment of first year radiology residents.  The purpose of this study was to assess  feasibility and potential benefits of DOPS and to decide its future implementation in our department.


Material and Methods: Each first year junior radiology resident was rotated in the department of ultrasound at initiation of training for  2 months programmed ultrasound rotation. At the end of the rotation, a  senior  radiologist, with more than 4 years post fellowship experience in ultrasound, carried out DOPS assessment session of these residents. A single station was made with ultrasound performed on a mock patient (healthy volunteer). A  DOPS Proforma was designed and assessment was marked in four areas (approach to patient, knobology of machine, theoretical knowledge and technique) and performance was graded according to a set scale. A post DOPS questionnaire was given to participating junior residents to give their opinion on this newer system. Another questionnaire was given to the senior residents to assess outcome of this exercise in terms of improvement in ultrasound skills of first year residents during call hours. 

Results: Over two years, 7 of 8 first year residents (87%) passed the exam on first attempt. The one who failed was remediated after attending extra ultrasound sessions and passed the exam a week later. All were put on night call subsequently.  A post implementation survey was conducted  from all the junior (n=8) and senior (n=7) radiology residents with 100% response rate. Eighty percent (n=12) of the residents thought that this new tool was effective in improving their ultrasound proficiency and should be implemented in future . Hundred percent (n=15) thought it to be better than conventional end of rotation written feedback. Eighty five  percent (n=6) of  senior residents felt that there was improvement in junior resident ultrasound skills during call hours as compared to previous years.

Conclusions: Compared to our conventional  end of rotation written feedback,  using DOPS for proficiency assessment of  ultrasound of  first year radiology  residents has been  judged to be a  useful assessment tool  prior to starting call.


Keywords: DOPS ( Directly Observed Procedural Skills), ultrasound proficiency, radiology residents.

Full Text:




Monsky, W. L., Levine, D., Mehta, T, S., Kane, R. A., Ziv, A., Kennedy, B. & Nisenbaum. Using a Sonographic Simulator to Assess Residents before Overnight Call. AJR, 2002 ;178(1): 35-39.

Hertzberg BS, Kliewer MA, Bowie JD, et al. Physician training requirements in sonography: how many cases are needed for competence? AJR 2000; 174:1221-1227

Ganguli S, Camacho M, Yam C-S, et al. Preparing first –year residents and assessing their readiness for on-call responsibilities. Acad Radiol 2006; 13:764-769.

Bari V.(2010). Direct Observation of procedural skills in Radiology. AJR Am J Roentgenol. 2010 ; 195(1):W14-8. doi: 10.2214/AJR.09.4068

Royal college of Radiologists. Clinical radiology pilot: radiology direct observation of procedural skills (RAD-Dops). Accessed March 3, 2010.

K.Augustine, P.McCoubrie, J.R.Wilkinson, L.McKnight. Workplace-based assessment in radiology—where to now? Clinical Radiology 2010; 65:325-332.

Naghma Naeem. Validity, Reliability, Feasibility, Acceptability and Educational Impact of Direct Observation of Procedural Skills (DOPS). Journal of the College of Physicians and Surgeons Pakistan. Jan 2013; Vol. 23 (1).

The Royal Australian and New Zealand College of Radiologists. Direct Observation of Procedural Skills (DOPS), TIMS March 2014. April 9, 2014.

The Royal Australian and New Zealand College of Radiologists®. 2009. Radiodiagnosis Training Program Curriculum. Sydney: The Royal Australian and New Zealand College of Radiologists. Accessed April 9, 2014.

Royal College of Radiologists. Rad-DOPS Guidance for Assessors v5.0.doc. Accessed April 9, 2014.

G.J.C. Burkill. Work-based assessment for trainees — more than just a few new tools? Clinical Radiology. Jan 2008; 63,1:12–14.


  • There are currently no refbacks.

© Copyright PJR 2008-