journal article May 22, 2008

Quantitative and individualized assessment of the learning curve using LC-CUSUM

Abstract
Abstract

Background
Current methods available for assessing the learning curve, such as a predefined number of procedures or direct observation by a tutor, are unsatisfactory. A new tool, the cumulative summation test for learning curve (LC-CUSUM), has been developed that allows quantitative and individual assessment of the learning curve.


Methods
Some 532 endoscopic retrograde cholangiopancreatographies (ERCPs) performed by one endoscopist over 8 years were analysed retrospectively using LC-CUSUM to assess the learning curve. The procedure was new to the endoscopist and monitored prospectively in the initial study. Success of the procedure was defined as cannulation and proper visualization of the duct(s) selected before the examination.


Results
Fifty ERCPs were considered unsuccessful. There was a gradual improvement in performance over time from a success rate of 82·0 per cent for the first 100 procedures to 96·1 per cent for the last 129 procedures. The LC-CUSUM signalled at the 79th procedure, indicating that sufficient evidence had accumulated to prove that the endoscopist was competent.


Conclusion
LC-CUSUM allows quantitative monitoring of individual performance during the learning process.
Topics

No keywords indexed for this article. Browse by subject →

References
26
[1]
The Inquiry into the management of care of children receiving complex heart surgery at the Bristol Royal Infirmary
[2]
Institute of Medicine (2001)
[3]
de Leval "Analysis of a cluster of surgical failures. Application to a series of neonatal arterial switch operations" J Thorac Cardiovasc Surg (1994) 10.1016/s0022-5223(94)70350-7
[4]
Spiegelhalter "Risk-adjusted sequential probability ratio tests: applications to Bristol, Shipman and adult cardiac surgery" Int J Qual Health Care (2003) 10.1093/intqhc/15.1.7
[5]
Nizard "Use of the Cusum technique for evaluation of a CT-based navigation system for total knee replacement" Clin Orthop Relat Res (2004) 10.1097/01.blo.0000136902.01368.69
[6]
Establishing Learning Curves for Surgical Residents Using Cumulative Summation (CUSUM) Analysis

Amy Young, Joseph P. Miller, Kenneth Azarow

Current Surgery 2005 10.1016/j.cursur.2004.09.016
[7]
Dagash "When can I be proficient in laparoscopic surgery? A systematic review of the evidence" J Pediatr Surg (2003) 10.1016/jpsu.2003.50192
[8]
Sloan "The Objective Structured Clinical Examination. The new gold standard for evaluating postgraduate clinical performance" Ann Surg (1995) 10.1097/00000658-199512000-00007
[9]
Schlup "ERCP: a review of technical competency and workload in a small unit" Gastrointest Endosc (1997) 10.1016/s0016-5107(97)70209-8
[10]
Van Rij "Cusum as an aid to early assessment of the surgical trainee" Br J Surg (1995) 10.1002/bjs.1800821117
[11]
Elliot "Evaluation of physical examination skills. Reliability of faculty observers and patient instructors" JAMA (1987) 10.1001/jama.1987.03400230065033
[12]
Bolsin "The use of the Cusum technique in the assessment of trainee competence in new procedures" Int J Qual Health Care (2000) 10.1093/intqhc/12.5.433
[13]
Van Dobben de Bruyn (1968)
[14]
Williams "Quality control: an application of the cusum" BMJ (1992) 10.1136/bmj.304.6838.1359
[15]
Biau "Quality control of surgical and interventional procedures: a review of the CUSUM" Qual Saf Health Care (2007) 10.1136/qshc.2006.020776
[16]
Kohn (2000)
[17]
Archibeck "Learning curve for the two-incision total hip replacement" Clin Orthop Relat Res (2004) 10.1097/01.blo.0000150272.75831.2f
[18]
Schauer "The learning curve for laparoscopic Roux-en-Y gastric bypass is 100 cases" Surg Endosc (2003) 10.1007/s00464-002-8857-z
[19]
Schlachta "Defining a learning curve for laparoscopic colorectal resections" Dis Colon Rectum (2001) 10.1007/bf02234296
[20]
Ahlberg "Is the learning curve for laparoscopic fundoplication determined by the teacher or the pupil?" Am J Surg (2005) 10.1016/j.amjsurg.2004.06.043
[21]
Reichenbach "Laparoscopic colon resection early in the learning curve: what is the appropriate setting?" Ann Surg (2006) 10.1097/01.sla.0000220039.26524.fa
[22]
Kestin "A statistical approach to measuring the competence of anaesthetic trainees at practical procedures" Br J Anaesth (1995) 10.1093/bja/75.6.805
[23]
Shehab "Applying quality control charts to the analysis of single-subject data sequences" Hum Factors (2000) 10.1518/001872000779698033
[24]
Tekkis "Evaluation of the learning curve in ileal pouch–anal anastomosis surgery" Ann Surg (2005) 10.1097/01.sla.0000152018.99541.f1
[25]
Sismanidis "Properties of the cumulative risk-adjusted mortality (CRAM) chart, including the number of deaths before a doubling of the death rate is detected" Med Decis Making (2003) 10.1177/0272989x03023003006
[26]
Matz "The learning curve" JAMA (1994) 10.1001/jama.1994.03510350032026