Take a look at the Recent articles

Assessing fellow competence in esophagogastroduodenoscopy (EGD): A pilot study

Vilas R. Patwardhan

Department of Medicine, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA

E-mail : vpatward@bidmc.harvard.edu

Niharika Mallepally

Department of Medicine, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA

Joseph D. Feuerstein

Department of Medicine, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA

Tyler M. Berzin

Department of Medicine, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA

Mandeep S. Sawhney

Department of Medicine, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA

Daniel A. Leffler

Department of Medicine, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA

Sunil G. Sheth

Department of Medicine, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA

DOI: 10.15761/GHE.1000128

Article
Article Info
Author Info
Figures & Data

Abstract

Goals: To objectively assess when gastroenterology fellows achieve technical competency to perform upper endoscopy independently

Background: Trainees are expected to achieve competence in esophagogastroduodenoscopy (EGD) by completion of their fellowship. The procedure experience needed to achieve competence in upper endoscopy is not known and has not been studied.

Study: We performed a prospective pilot study examining consecutive EGDs performed by gastroenterology fellows from July 2014 through January 2015 at an academic medical center. Using a brief post-procedure questionnaire, fellows were graded by their attendings and themselves on the amount of verbal coaching and technical assistance required to complete each EGD. Diagnostic and interventional portions of each case were graded separately. Fellows were graded on a 1-5 scale with a score of 1 equivalent to needing 100% assistance and a score of 5 equivalents to requiring no assistance. The primary outcome was independent EGD completion rate, measured as a percentage of the last 20 EGDs performed. Secondary outcomes were attending assessments and fellow self-assessments of the level of attending assistance required to complete each EGD. 

Results: A total of 496 EGDs performed by 12 gastroenterology fellows were analyzed. First (n=5), second (n=4), and third year (n=3) GI fellows had performed a median of 26, 337, and 592 EGDs, respectively, prior to the start of the study period. After performing 95 EGDs, fellows transiently achieved an independent completion rate of >80% for every 20 procedures performed. After completing 159 EGDs, the independent completion rate did not fall below 80%. The independent completion rate among 2nd and 3rd year fellows never fell below 95%. The mean attending assessment and fellow self-assessment scores at 50, 100, and 150 procedures were 3.2 and 2.80, 4.0 and 3.5, and 4.11 and 3.7, respectively. Mean attending assessment scores for 2nd and 3rd year fellows were 4.9 and 5, respectively at the start of the study period.

Conclusion: Skills in diagnostic EGD improve over the course of the first year in GI training. In this small pilot study, technical competence in diagnostic EGD appeared to occur between the 160th and 340th EGD performed during training.

Key words

competency, EGD, gastroenterology fellowship, training

Introduction

Guidelines for procedure exposure and training during gastroenterology (GI) fellowship have been set forth by the Gastroenterology Core Curriculum (GCC) and American Society for Gastrointestinal Endoscopy (ASGE) [1]. The GCC is guided by the four major American gastrointestinal societies including the ASGE, American Gastroenterological Association (AGA), American Association for the Study of Liver Diseases (AASLD), and the American College of Gastroenterology (ACG), and is aimed to guide best practices in gastroenterology training. The GCC describes the threshold numbers of standard endoscopic procedures that fellows should meet by the time of fellowship graduation [2]. While studies have examined the procedural experience required for fellows to achieve technical competency in procedures such as colonoscopy and endoscopic retrograde cholangiopancreatography (ERCP) [3,4], studies on the procedure experience needed to attain competence in esophagogastroduodenoscopy (EGD) are lacking.

Therefore, we performed a prospective pilot study of EGDs performed by GI fellows to determine the procedural experience required to attain technical competence in upper endoscopy.

Methods

We performed a single center, prospective pilot study examining esophagogastroduodenoscopies (EGDs) performed by gastroenterology fellows at an academic medical center, Beth Israel Deaconess Medical Center (BIDMC), in Boston, Massachusetts. All EGDs performed by a general gastroenterology (GI) fellow from July 2014 through January 2015 were included. All general GI fellows (n=12) were asked to participate. Fellow EGDs performed while rotating through the advanced endoscopy unit were excluded from analysis. Advanced fellows were excluded as well. Consent was indicated by willingness of the fellow to fill out the procedure assessment form and submit it for inclusion in our study. At any point in time fellows were able to withdraw from the study.

To collect data on independent procedure completion, as well as fellow, attending, and nursing assessments, all fellows, attendings, and nurses were asked to fill out a brief questionnaire following each upper endoscopy performed (Figure 1). The questionnaire included the following information: 1) Whether the procedure was completed without attending assistance 2) If the procedure was not completed independently, which aspects required assistance 3) Fellow self assessment 4) Nursing comfort assessment 5) Attending assessment 6) Whether an intervention was performed 7) Whether intervention(s) required attending assistance. Attending assistance was defined as the attending physically handling the scope at any point during the procedure. Verbal coaching was permitted and graded on a Likert scale from 1-5 as follows: 1= procedure could not be completed without attending assistance 2= verbal coaching required for >50% of the procedure 3=verbal coaching required for <50% but >25% of the procedure 4= verbal coaching required for less than 25% of the procedure 5=no verbal coaching required. All procedures completed independently required a score of >1 in the fellow and attending assessments. The scores for fellow self-assessment and attending assessment reflected only the diagnostic portion of the EGD. Interventions were graded separately as indicated in the questionnaire (Figure 1). Additional information was gathered from the endoscopy report and medical record and included the following information: location of the procedure (i.e. inpatient vs. outpatient), patient age, gender, indication for procedure, type of sedation, procedure count of the fellow in training, and year of training. Procedure counts were obtained from the electronic medical record endoscopy software (G-Care, gMed Florida), which tabulates trainee’s procedure count continuously.

Figure 1. Fellow questionnaire

Patient comfort was assessed by the nurse using a Likert score from 1-5 (5 being most comfortable and 1 being most uncomfortable as follows: 1= Patient comfortable for <20% of procedure 2= Patient comfortable for <50% of procedure 3=Patient comfortable for >50% but less than 80% of procedure 4=Patient comfortable for >80% of the procedure, but not the entire procedure 5=Patient comfortable during the entire procedure). Moderate sedation was administered using midazolam and fentanyl and cetacaine spray. Cases with monitored anesthesia care (MAC) employed propofol for sedation. Since sedative medications used for endoscopy have amnestic properties i.e. midazolam and propofol, comfort measured by those witnessing the procedure was felt to be more reflective of patient comfort than that recollected by the patient following administration of procedural sedation. The standard of practice at our institution is to use a 180o Olympus high-definition adult gastroscope except in rare cases when an adult therapeutic gastroscope or pediatric gastroscope was required. This study was approved by the BIDMC Institution Review Board.

Statistical analysis

The primary outcome was independent EGD completion rate, measured as a percentage of the last 20 EGDs performed. All EGDs were analyzed. However, independent completion was determined based solely on the ability to perform the diagnostic portion of the EGD even in the cases where interventions were performed. Secondary outcomes were attending assessments and fellow self-assessments of the level of attending assistance required to complete each EGD. Since the independent completion rate was close to 100% for fellows in year 2 and 3 of training, statistical analysis was restricted to fellows in their first year of training. Descriptive statistics are displayed as mean + standard deviation, median [range], or as otherwise indicated.

Results

Demographics

See Table 1 for patient demographics and fellow characteristics. Twelve gastroenterology fellows were eligible and included in this study. In total, 496 fellow EGDs were performed between July 31, 2014 and January 12, 2015. At the start of the study, the median number of EGDs performed during the entire fellowship to date by first year trainees (FY1) was 26 (range 20-51), 337 (range 314-393) for second year trainees (FY2), and 592 (range 542-700) for third year trainees (FY3). At the end of the study period, the median number of procedures performed in total during fellowship was 161 (range 95-176) for first years, 358 (range 344-428) for second years and 809 (range 631-827) for third year fellows. FY1 trainees performed 254 EGDs, FY2 107, and FY3 135 during the study period. The most common indication for upper endoscopy was bleeding (n=135; 27%) followed by abdominal pain (n=106; 21%). The following interventions were performed: Biopsy (n=200), Endoclip (n=4), BICAP electrocautery (n=3), esophageal band ligation (n=15), Argon Plasma Coagulation (n=4). MAC anesthesia was used for 32% of the procedures and 37% of the procedures were performed on inpatients.

Table 1. Baseline characteristics of 496 fellow EGDs

Patient characteristics

 

Patient age (years; mean +/- SD)

57.5 +/- 16.6

Female gender (n; %)

250 (50.4)

% Inpatient (inpatient + ICU)

37.3

% MAC anesthesia

32.3

Indications (n, %)

 

Bleeding (overt and occult)

135 (27.2)

Dysphagia/Odonyphagia

78 (15.7)

Diarrhea

13 (2.6)

Varices screening

89 (17.9)

Abdominal pain

106 (21.4)

Nausea and/or vomiting

32 (6.5)

GERD

52 (10.5)

Fellow characteristics

 

Independent completion rate (%; median [range])

 

FY1 (N=5 fellows)

69.4 (55.2-84.6)

FY2 (N=4 fellows)

100 (93.8-100)

FY3 (N=3 fellows)

100 (98.2-100)

MAC= monitored anesthesia care, GERD=gastroesophageal reflux disease, SD=standard deviation, FY=fellow year, ICU=intensive care unit

Independent fellow EGD completion rates

Rates of independent fellow completion (verbal coaching allowed) varied significantly by fellow year, with the most significant learning curve occurring in the fellow year 1(Figure 2). All fellows consistently achieved greater than 95% independent completion by the start of their second year of fellowship. In the first year of training, fellows first achieved an independent completion rate of >80% by their 95th EGD. However, they did not consistently achieve greater than 80% independent completion rate by their 160th. Fellows had over 90% independent completion after their 170th EGD.

Figure 2. Independent EGD completion rate by first year fellows.

Assessments of fellow performance

Both attending assessments of fellows and fellow self-assessments varied with procedural experience (Figure 3). The mean (SD) attending assessment and fellow self-assessment scores at 50, 100, and 150 procedures were 3.2 (0.92) and 2.80 (0.93), 4.0 (0.90) and 3.5 (0.95), and 4.11 (0.99) and 3.7 (0.98), respectively. Mean (SD) attending assessment scores for 2nd and 3rd year fellows and fellow self-assessments were 4.9 (0.23) and 5 (0), 4.9 (0.26) and 5 (0), respectively at the start of the study period. Nursing assessments of patient comfort were consistently high even at the start of training with mean scores of 4.15 (1.12), 4.8 (0.41), and 4.38 (0.61) at the 50th, 100th, and 150th EGD marks, respectively.

Figure 3. First2021 Copyright OAT. All rights reservd fellow self-assessments of EGD performance. The solid line represents the fellow self-assessment. The dashed line represents the attending assessment.

Given the limited number of Interventions performed, the study was not felt to be sufficiently powered to analyze the relationship between procedural training and interventional EGDs. Similarly, analysis of the effect of inpatient procedures and MAC anesthesia was restricted to FY1 procedures based on the nearly 100% independent completion rates among FY2s and FY3s and attending and fellows assessments starting off near 5.  Among the procedures performed by FY1s, there was no significant difference in independent completion rates based on procedure location, with 67% of inpatient procedures and 75% of outpatient EGDs being completed independently (P=0.52). Similarly, there was no difference in independent completion rates by type of sedation used. The independent completion rate was 67% in cases where MAC was employed and 73% in those employing moderate sedation (P=0.58).

Discussion

In this pilot study of GI fellow technical competency to perform independent EGD, we found that the benchmark of 130 EGDs set forth by the GCC may underestimate the procedural experience required before fellows are ready to enter independent practice. In our study, fellows required over 170 procedures to perform independent EGD in greater than 90% of cases. However, while this benchmark of 90% independent procedure completion has been used in prior studies of fellow cecal intubation in colonoscopy, it is likely not adequate for independent GI practice [5-6].

Additionally, independent procedure completion alone does not take into account the importance of attending coaching that may be pivotal to a fellow completing a procedure independently. This was evident in our cohort, in which fellows who had completed 170 EGDs, and achieved >90% independent completion, had a mean self-assessment score of 4. This suggests that even in those procedures completed independently, verbal coaching may have been needed for up to 25% of each procedure. When accounting for verbal coaching, it was not until the start of second year of fellowship, after fellows had completed a median of 337 EGDs, that no verbal coaching was required.

A recent survey of graduating third year gastroenterology fellows found that while 98% of respondents met the required number of diagnostic EGDs put forth by the GCC (130), fewer numbers of respondents had met the interventional goals for treatment of variceal and non-variceal hemorrhage and esophageal dilation (75%, 40%, and 43%, respectively) [7]. These data are consistent with the findings of our study, in which 26 interventions were completed for 135 EGDs performed for GI bleeding. When combined with the fact that fellows may have more limited opportunities to perform interventional endoscopy (i.e. treatment of peptic ulcer disease bleeding, upper GI AVMs, and esophageal varices) in training, the current benchmark of performing 130 EGDs over the course of GI fellowship training may be inadequate. Previous study in colonoscopy have similarly shown that greater procedural experience is needed to attain technical proficiency in interventions such as polypectomy over and above that needed for cecal intubation [8].

To our knowledge, this type of real world experience in fellow EGD training has not been reported previously nor has the role of verbal coaching in endoscopy training. As demonstrated in this pilot study, assessing a fellow’s need for verbal coaching during training may be as important an indicator of progress as a trainee’s ability to technically complete procedures independently. Fellow self-assessments, though similar in scoring to the attending assessments in this study, may add further knowledge to deciphering when fellows themselves feel competent to perform endoscopy independently. Self-assessments have been used in surgical training to guide the benchmarks for flexible endoscopy training and have also been used to make GI fellows’ progress transparent relative to their peers [9,10]. Optimizing the use of fellow self-assessments in GI endoscopy training is an area for future research.

Our results should be interpreted in the context of the study design. This was a single center pilot study, without prior publications in the literature in GI EGD fellowship training. Hence, our study may not have been powered to detect the role of covariables such as procedure location, procedure indications, and type of sedation used on trainee learning and success. Additionally, all fellows in our center became technically proficient in EGD by the start of their second year, thus reducing the number of fellows actively “learning” EGD during the study period. Similarly, since this study was conducted at a single center, we cannot account for differences in programmatic training between institutions that may affect trainee procedural competency. We should also note, that during the study period, a relatively few number of interventions were performed, thus limiting analysis of competency in endoscopic interventions. However, the procedure exposure in the study period does appear to mirror graduating trainee survey responses from across the US. Future studies of EGD training should focus not only diagnostic, but also interventional aspects of upper endoscopy. Lastly, although this study focuses on technical competency, recently published guidelines fellow procedural competency focus not only on technical, but also cognitive, and integrative competencies [11,12], which are central to independent gastroenterology practice.

Conclusion

In this pilot study of GI fellowship EGD training, skills in diagnostic EGD improved over the first year in GI training. Fellows achieved technical competency in EGD between the 160th and 340th EGD performed. Larger longitudinal studies are needed to clarify the optimal EGD exposure in GI fellowship.

References

  1. American Association for the Study of Liver Diseases, American College of Gastroenterology, American Gastroenterological Association (AGA) Institute, American Society for Gastrointestinal Endoscopy (2007) The gastroenterology core curriculum, third edition. Gastroenterology 132: 2012-2018.
  2. Gastroenterology Leadership Council: American Association for the Study of Liver Disease, American College of Gastroenterology, American Gastroenterological Association, American Society for Gastrointestinal Endoscopy (2003) Training the gastroenterologist for the future: the gastroenterology core curriculum.124: 1055-1104.
  3. Adler DG, Lieb JG 2nd, Cohen J, Pike IM, Park WG, et al. (2015) Quality indicators for ERCP. Gastrointest Endosc 81: 54-66. [Crossref]
  4. Wani S, Hall, M, Wang AY, DiMaio CJ, Muthusamy VR, et al. (2016) Variation in learning curves and competence for ERCP among advanced endoscopy trainees by using cumulative sum analysis. Gastrointest Endosc 83: 711-9.e11. [Crossref]
  5. Lee S-H, Chung I-K, Kim SJ, Kim JO, Ko BM, et al. (2008) An adequate level of training for technical competence in screening and diagnostic colonoscopy: a prospective multicenter evaluation of the learning curve. Gastrointest Endosc 67: 683–689. [Crossref]
  6. Ward ST, Mohammed MA, Walt R, Valori R4, Ismail T3, et al. (2014) An analysis of the learning curve to achieve competency at colonoscopy using the JETS database. Gut 63: 1746-1754. [Crossref]
  7. Jirapinyo P, Imaeda AB, Thompson CC (2015) Endoscopic training in gastroenterology fellowship: adherence to core curriculum guidelines. Surg Endosc 29: 3570-3578. [Crossref]
  8. Patwardhan VR, Feuerstein JD, Sengupta N, Lewandowski JJ, Tsao R, et al. (2016) Fellowship Colonoscopy Training and Preparedness for Independent Gastroenterology Practice. J Clin Gastroenterol 50: 45-51. [Crossref]
  9. Fonseca AL, Reddy V, Yoo PS, Gusberg RJ, Longo WE (2016) Senior surgical resident confidence in performing flexible endoscopy: what can we do differently?. J Surg Educ 73: 311-316. [Crossref]
  10. Koch AD, Haringsma J, Schoon EJ, De Man Ra, Kuipers EJ (2012) Competence measurement during colonoscopy training: the use of self-assessment of performance measures. Am J Gastroenterol 107: 971-975. [Crossref]
  11. Walsh CM, Ling SC, Khanna N, Cooper MA, Grover SC, et al. (2014) Gastrointestinal Endoscopy Competency Assessment Tool: development of a procedure-specific assessment tool for colonoscopy. Gastrointest Endosc 79: 798-807. [Crossref]
  12. ASGE Training Committee, Sedlack RE, Coyle WJ, Obstein KL, Al-Haddad MA, et al. (2014) ASGE's assessment of competency in endoscopy evaluation tools for colonoscopy and EGD. Gastrointest Endosc 79: 1-7. [Crossref]

Editorial Information

Editor-in-Chief

Marcel C C Machado
Department of Clinical Emergencies
University of São Paulo School of Medicine
Brazil

Article Type

Research Article

Publication history

Received date: October 01, 2016
Accepted date: October 18, 2016
Published date: October 21, 2016

Copyright

© 2016 Patwardhan VR. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Citation

Patwardhan VR (2016) Assessing fellow competence in esophagogastroduodenoscopy (EGD): A pilot study. Gastroenterol Hepatol Endosc 1: DOI: 10.15761/GHE.1000128.

Corresponding author

Vilas R. Patwardhan

Department of Medicine, Division of Gastroenterology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA; Tel: 617-632-1070; Fax: 617-632-1065.

E-mail : vpatward@bidmc.harvard.edu

Figure 1. Fellow questionnaire

Table 1. Baseline characteristics of 496 fellow EGDs

Patient characteristics

 

Patient age (years; mean +/- SD)

57.5 +/- 16.6

Female gender (n; %)

250 (50.4)

% Inpatient (inpatient + ICU)

37.3

% MAC anesthesia

32.3

Indications (n, %)

 

Bleeding (overt and occult)

135 (27.2)

Dysphagia/Odonyphagia

78 (15.7)

Diarrhea

13 (2.6)

Varices screening

89 (17.9)

Abdominal pain

106 (21.4)

Nausea and/or vomiting

32 (6.5)

GERD

52 (10.5)

Fellow characteristics

 

Independent completion rate (%; median [range])

 

FY1 (N=5 fellows)

69.4 (55.2-84.6)

FY2 (N=4 fellows)

100 (93.8-100)

FY3 (N=3 fellows)

100 (98.2-100)

MAC= monitored anesthesia care, GERD=gastroesophageal reflux disease, SD=standard deviation, FY=fellow year, ICU=intensive care unit

Figure 2. Independent EGD completion rate by first year fellows.

Figure 3. First year fellow attending assessments and fellow self-assessments of EGD performance. The solid line represents the fellow self-assessment. The dashed line represents the attending assessment.