Take a look at the Recent articles

Direct comparison of ASGE, EPAGE and alarm-based appropriateness criteria for endoscopic procedures: A retrospective audit

Linedale EC

The University of Adelaide, South Australia

E-mail : aa

Rizvi Q

Lyell McEwin Hospital, South Australia

Mikocka-Walus A

The University of Adelaide, South Australia

Deakin University, Victoria, Australia

Gibson PR

Royal Adelaide Hospital, South Australia

Andrews JM

The University of Adelaide, South Australia

Royal Adelaide Hospital, South Australia

DOI:10.15761/GHE.1000161

Article
Article Info
Author Info
Figures & Data

Abstract

Background and aim: With a heavy referral burden on endoscopic services worldwide, careful selection of patients is needed to optimize limited healthcare resources. This study aimed to directly compare the performance of the ASGE, EPAGE, and alarm-based criteria and to determine the local rate of inappropriate endoscopies.

Methods: A retrospective audit of consecutive medical records of patients with completed endoscopy at one Australian public hospital were reviewed (December 2014–October 2014). Indications were categorised by appropriateness using ASGE, EPAGE and alarm-based criteria, and clinical yield determined.

Results: A total of 147 endoscopies (63% male, 67% outpatients) and 196 colonoscopies (50% male, 88% outpatients) were reviewed. Four percent (4%) of UGIEs and 2% of colonoscopies were inappropriate per ASGE, and 7% (UGIEs) and 10% (colonoscopies) inappropriate per EPAGE.

Custom alarms-based criteria in patients suspected of FGID exhibited greater specificity than ASGE or EPAGE (Z = 3.53, p < 0.001 for each), and were as sensitive as both ASGE and EPAGE (p < 0.001 each) for UGIEs. Similarly, alarm-based criteria had greater specificity than ASGE (53% vs 11%, Z = 2.37, p = 0.018), and comparable specificity to EPAGE (55% vs 20%, p = 0.052) for colonoscopy.

Conclusion: A low rate of inappropriate endoscopies was observed. Although ASGE and EPAGE performed similarly, they had different limitations. In patients with suspected functional symptoms neither ASGE or EPAGE-I appear to perform adequately. The use of an alarm-based criteria in patients with clinically suspected FGIDs may further reduce the rate of unnecessary investigations and warrants larger scale evaluation.

key words

functional gastrointestinal disorders, endoscopy, appropriateness criteria, ASGE, EPAGE

Abbreviations

FGID: Functional Gastrointestinal Disorders; UGIE: Upper Gastrointestinal Endoscopy; ASGE: American Society for Gastrointestinal Endoscopy; EPAGE: European Panel on the Appropriateness of Gastrointestinal Endoscopy; M: Mean; SD: Standard Deviation; CI: Confidence Interval

Introduction

There is a heavy referral burden in endoscopic services worldwide, as referrals continue to increase, at least in part due to colorectal cancer screening programs. It is well recognised that the yield of relevant findings is high for some indications, such as positive faecal occult blood test [1,2], whilst in other scenarios such as likely functional gastrointestinal disorders (FGIDs), there is a low relevant endoscopic yield [3].

Although current recommendations are for minimal use of invasive tests for establishing a diagnosis of a FGID, current practice is at odds with the recommendations [4], with most clinicians adopting an exclusionary approach and continuing to refer for invasive procedures [2,5–11]. While fear of missed pathology is a recognised driving factor for the over-use of endoscopy [12], this approach cannot be endorsed as a sustainable model of service delivery. It is not efficient, necessary or affordable, and carries avoidable risk to otherwise healthy people. Careful selection of patients for endoscopic procedures is needed to optimise limited healthcare resources [1].

Endoscopic “appropriateness” guidelines have been developed by the American Society for Gastrointestinal Endoscopy (ASGE) [13] and the European Panel on the appropriateness of Gastrointestinal Endoscopy (EPAGEI and EPAGEII) [14], to better target endoscopic procedures, increase diagnostic yield and improve the quality of patient care. However, both sets of criteria are recommended as monitoring/decision-making rather than screening tools [15–17]. The validity of these guidelines has not been evaluated in randomised controlled trials, but a consistent substantial rate of inappropriate upper gastrointestinal endoscopies (UGIEs) and colonoscopies has been documented in observational studies worldwide [18–20].

Rates of inappropriate endoscopic procedures vary significantly (10–40%) according to procedure type, patient age, healthcare setting (in- vs. out-patients), the criteria used and the health system of the country [19,21–23]. Direct comparison of “inappropriate” endoscopic rates is, therefore, difficult. By way of example, a prospective observational study of 21 centres in 11 European countries (2000-2002, n = 5213) found 27% of colonoscopy indications to be inappropriate according to EPAGE, with values ranging from 12–43% across centres [24]. Two recent Italian studies in an open access facility, found approximately 10% of gastroenterologist referred colonoscopies (n = 2454) and 14% of UGIEs to be inappropriate (n = 1777) according to ASGE [25,26].

There have been only three studies which directly compare ASGE and EPAGE criteria; one in UGIE [27] and two in colonoscopy [28,29], with only one published in full [27]. Bersani et al. [27] found that the diagnostic yield for clinically relevant endoscopic findings was slightly better using ASGE than EPAGE criteria for UGIE. However, these findings have been debated due to significant methodological issues [30]. Using the same methods, Bersani et al. [29] found that the criteria performed similarly to each other for colonoscopy [29]. Adler et al. [28] report a 5–10% higher yield of relevant colonoscopy findings in ASGE and EPAGE appropriate categories, but full comparative data are not presented in the abstract and cannot be further evaluated [28].

Although the ASGE and EPAGE criteria agree on colonoscopy appropriateness in 80% of indications, disagreement occurs in a few frequently encountered indications such as uncomplicated abdominal pain and constipation [30]. Such symptoms occur frequently in people with FGID and are, in general, low-yield indications for colonoscopy. Consistent with this, a simple predictive rule based on age, alarm features and family history has been shown to be as effective as ASGE guidelines in identifying appropriate indications for UGIE (n = 8252) [21].

The rate of ‘inappropriate’ UGIEs and colonoscopies in Australia has yet to be assessed. The aims of this study are therefore to: 1) compare the performance ASGE, EPAGE and alarm-based criteria 2) evaluate the rate of unindicated endoscopic procedures, and 3) determine what proportion of these “inappropriate” endoscopic procedures are performed in patients clinically suspected of having a FGID.

Methods

Consecutive medical records of patients with completed diagnostic and therapeutic colonoscopies and endoscopies (Oct-Dec 2014) in one metropolitan Australian public hospital were retrospectively reviewed. Liver-related procedures were excluded. The indications for each procedure as documented on the booking form were judged appropriate/inappropriate according to ASGE [13], and necessary/appropriate or uncertain/inappropriate using EPAGE criteria (www.epage.ch). EPAGE categories were combined and reported as appropriate (including necessary and appropriate procedures) or inappropriate (uncertain or inappropriate procedures). Where a booking form was not found, medical notes, outside referral, or procedure reports were used in lieu, in that order of priority. The clinical relevance of endoscopic findings was assessed by a gastroenterology registrar and senior gastroenterologist, and endoscopic findings classified as normal, non-contributory abnormality or relevant abnormality. Patient demographics, symptoms, symptom duration main indications, previous tests, and endoscopic/histological findings were also recorded. Referral demographics included initial source of referral (gastroenterologist, intern, surgeon, primary healthcare provider) and admission status (inpatient/outpatient). A sample size of 139 colonoscopies and 186 UGIEs was powered to detect a prevalence of inappropriate indications of 10% and 14% for colonoscopies and UGIEs respectively, with 5% precision.

A subset of procedures performed in patients judged clinically likely to have FGID were selected for further analysis. Likely FGID was defined as the presence of longstanding (≥ 6 months), non-specific gastrointestinal symptoms (abdominal/epigastric pain/discomfort, with or without accompanied bloating, flatulence, altered bowel habit, nausea or vomiting). Procedures performed in this subset of patients were additionally categorized as appropriate/inappropriate according to locally developed custom alarms-based criteria (Table 1). Procedures were judged as appropriate where one or more clinical alarms were present, and inappropriate in the absence of any alarms, and the subsequent yield of relevant abnormalities was determined.

Table 1. Locally Developed Algorithm-based Alarm Criteria for the Appropriateness of Endoscopies.

Upper GI Endoscopy

 Colonoscopy

Abnormal physical exam

Abnormal Imaging

New onset symptoms if > 50 years of age (within 6 months)

Unexplained weight loss (> 3 kg or 5% body weight)

Iron deficiency ± anaemia

Haematemesis

Melena, faecal occult blood, overt rectal bleeding

Dysphagia/odynophagia

Abdominal pain awaking patient from sleep

Family History of Coeliac Disease in symptomatic patient (1 FDR)

Nocturnal diarrhoea/faecal incontinence

Unexplained fever

Family history of colon cancer (1 FDR* < 60, or > 1 FDR any age)

Family History of IBD in symptomatic patient (1 FDR)

*FDR: first-degree relative

Data analysis

Data were analysed using SPSS 24, and expressed as frequencies and counts. Confidence limits for the sample proportion of inappropriate indications were calculated using the Wilson method [31]. Z-scores were calculated to test for significant differences between these proportions, with significance set at p < 0.05 (two-sided). Pearson’s Chi square test and Fischer’s exact test were used to test for associations between appropriateness categories and clinical relevance of findings, with significance set at p < 0.05 (two-sided). Sensitivity (the ability of the criteria to identify those with clinically relevant findings) and specificity (the ability of the criteria to correctly identify those without clinically relevant findings) of the criteria were calculated for the performance of the criteria using the online calculator (http://vassarstats.net). All authors had access to the study data and reviewed and approved the final manuscript.

Ethics

As this was a clinical audit conducted retrospectively with the purpose of quality assurance/evaluation, ethical review was not necessary.

Results

Sample description

The records of 288 patients who underwent either colonoscopy (n = 141, M 61y, SD 16), UGIE (n = 92, M 61y, SD 18) or both (n = 55, M 60y, SD 18) were reviewed. Full demographics are detailed in Table 2. Patients were mostly outpatients referred by gastroenterologists. Most UGIE and colonoscopy booking forms/medical records (60%, 61%) did not state whether prior endoscopic procedures had been performed. The procedure was specifically noted to be the initial procedure in only 8% and 7% of UGIEs and colonoscopies respectively. At least one prior endoscopic investigation was noted in 32% of UGIEs and colonoscopies. The status of the remaining procedures was unable to be determined from the medical records.

Table 2. Demographics of patients undergoing UGIE and colonoscopy

Demographics

UGIE

Colonoscopy

Number of procedures

n (%)

n (%)

147

196

Gender

Female

69 (47)

97 (50)

Male

78 (53)

99 (50)

Admission Status

Outpatient

98 (67)

172 (88)

In-patient

43 (29)

18 (9)

In-patient/for the procedure

6 (4)

6 (3)

Referral Source

Gastroenterologist

99 (67)

101(52)

Primary healthcare provider

4 (3)

3 (1)

Surgeons

19 (13)

80 (41)

Other

25 (17)

12 (7)

Prior procedures

Multiple prior

25 (17)

11 (6)

At least one prior

22 (15)

53 (27)

No prior

12 (8)

15 (8)

Not stated

88 (60)

117 (60)

Appropriateness and yield of UGIEs & colonoscopies by EPAGE and ASGE

The majority of UGIEs were judged to be appropriate by both ASGE (89%) and EPAGE (80%) criteria with only 4% [95% CI (2%, 9%)] and 7% [95% CI (4%, 13%)] inappropriate, respectively (Table 3). Although we were unable to categorize a numerically larger number of UGIEs using EPAGE (19 vs 10), the proportions were not statistically different (Z = 1.76, p = 0.078). UGIE indications unable to be coded by ASGE or EPAGE are provided in Table 1. On clinician review, 1 ASGE-inappropriate, 5 ASGE-uncodeable, and 2 EPAGE‑uncodeable UGIE indications were judged appropriate. There were no instances where EPAGE-inappropriate indications were subsequently judged appropriate. Summaries of the categorization of clinical indications for UGIE and colonoscopy according to ASGE and EPAGE criteria are presented in Tables 2–5.

Table 3. Comparison of the performance of ASGE, EPAGE for UGIE and Colonoscopy.

AGSE n(%)

EPAGE n(%)

A

I

X

A/N

I/U

X

UGIE Indications

131 (89%)

6 (4%)

10 (7%)

117 (80%)

11 (7%)

19 (13%)

Clinical Alarms (88)

86

0

2

83

0

5

Persistent Symptoms/No Alarms (21)

17

2

2

14

4

3

Surveillance (20)

14

2

4

8

3

9

Post-operative assessment/complications (3)

3

0

0

2

0

1

Pre-operative Assessment (2)

0

1

1

1

1

0

Metastatic cancer-seeking primary (3)

2

1

0

2

1

0

Persistent symptoms despite treatment (3)

3

0

0

3

0

0

Achalasia (2)

2

0

0

2

0

0

Operative endoscopy (2)

1

0

1

1

1

0

Diarrhoea/Immunocompromised (2)

2

0

0

0

1

1

Food bolus (1)

1

0

0

1

0

0

Clinical Relevance of Findings

Clinically Relevant

64 (49%)

2 (33%)

3 (30%)

53 (45%)

6 (55%)

10 (53%)

Non-contributory abnormality

28 (21%)

2 (33%)

2 (20%)

27 (23%)

3 (27%)

2 (11%)

Normal

39 (30%)

2 (33%)

5 (50%)

37 (32%)

2 (18%)

7 (37%)

AGSE n (%)

EPAGE n (%)

A

I

X

A/N

I/U

X

Colonoscopy Indications

173 (88%)

4 (2%)

19 (10%)

141 (72%)

20 (10%)

35 (18%)

Clinical Alarms (124)

121

0

3

95

10

19

Persistent Symptoms/No Alarms (13)

4

1

8

10

1

2

Surveillance (27)

21

2

4

13

4

10

IBD Follow Up (12)

12

0

0

9

2

1

Pre-operative Assessment (5)

4

0

1

5

0

0

Metastatic cancer-seeking primary (4)

3

0

1

3

1

0

Persistent symptoms despite treatment (2)

2

0

0

1

0

1

Completion colonoscopy (3)

2

0

1

2

0

1

Operative colonoscopy (2)

2

0

0

1

1

0

Diarrhoea/Immunocompromised (2)

2

0

0

1

0

1

Unindicated (2)

1

0

1

1

0

1

Clinical Relevance of Findings

Clinically Relevant

70 (40)

2 (50%)

2 (11%)

62 (44%)

4 (21%)

8 (22%)

Non-contributory abnormality

46 (24%)

1 (25%)

4 (22%)

35 (25%)

4 (21%)

12 (33%)

Normal

58 (33)

1 (25%)

12 (67%)

44 (31%)

11 (58%)

16 (44%)

A: appropriate, I: inappropriate, X: un-codeable, A/N: appropriate or necessary, I/U: inappropriate or uncertain. UGIE Surveillance (Barrett’s oesophagus n = 12, varices n = 6, stricture n = 1, gastric ulcer n = 1), post-operative assessment for complications (fundoplication n = 2, gastric bypass n = 1), Preoperative assessment (gastric bypass surgery n = 2). 3/10 ASGE-uncodeable and 3/11 EPAGE-uncodeable UGIEs, were unable to be coded due to insufficient information in the medical records. Colonoscopy IBD Follow Up (active disease n = 4, cancer n = 6, post-operative n = 3), Surveillance (benign disease n = 2, colorectal cancer n = 3, polyps n = 14, post colorectal cancer n = 8), Preoperative assessment (benign disease n = 2, colorectal cancer n = 2, fistula n = 1). 4/18 ASGE-uncodeable and 11/36 EPAGE-uncodeable colonoscopies, were unable to be coded due to insufficient information in the medical records.

Similarly, most colonoscopies were appropriate using ASGE (88%) and EPAGE (72%) with 2% [95% CI (1%, 5%)] and 10% [95% CI (7%, 15%)] inappropriate, respectively (Table 3). Again, a larger number of colonoscopies (36/196, 18%) were unable to be categorized with EPAGE as compared to ASGE, and here the difference was significant (19/196, Z = 2.64, p = 0.008). On clinical review 5/19 ASGE-uncodeable indications were deemed appropriate as were 6/19 ASGE-inappropriate; 11/36 EPAGE-uncodeable indications. There were no instances of EPAGE-inappropriate indications being subsequently judged appropriate.

A finding of clinical relevance was not significantly related to the appropriateness category in either ASGE-UGIE [Χ2 (4, n = 147) =2.566, p = 0.633], ASGE-Colonoscopy [Χ(2, n = 177) = 0.097, p = 0.755], or EPAGE-UGIE [Χ2 (2, n = 147) = 2.477, p = 0.649]. However, the appropriateness of EPAGE-Colonoscopy was related to clinical relevance; a higher negative yield was found in the inappropriate colonoscopies (79% vs 69%) and higher positive yield in appropriate colonoscopy indications (44% vs 21 %) [Χ(4, n =196) = 10.261, p = 0.036]}. These results should be interpreted with caution, however, due to the small number of inappropriate procedures in this sample.

Performance of custom-alarm based criteria, EPAGE and ASGE in clinically suspected FGID

Likely functional GI symptoms were identified on the referral in 12% (18/147) of UGIEs and 11% of colonoscopy (22/196). All these procedures were able to be categorised as appropriate or inappropriate using the locally developed alarm-based criteria. However, ASGE was unable to classify 3 UGIEs (17%) and 10 (45%) colonoscopies, and EPAGE was unable to classify 2 UGIEs (11%) and 4 (18%) colonoscopies (Table 4). In this subset of procedures, 14/18 UGIEs and almost half of the colonoscopies (10/22) were judged inappropriate using the locally developed alarm-based criteria (Table 4).

Table 4.  Comparison of the performance of alarm-based, ASGE, EPAGE for UGIE and colonoscopy in patients with clinically suspected FGID symptoms

UGIE

Custom Alarm-Based Criteria(n)

AGSE

(n)

EPAGE

(n)

A

I

X

A

I

X

A/N

I/U

X

UGIE Indications

4

14

0

13

2

3

14

2

2

Clinically Relevance

     Relevant

1

0

0

1

0

0

1

0

0

     Non‑contributory/Normal

3

14

0

12

2

3

13

2

2

Sensitivity [95% CI]

100% [5-100]

100% [5-100]

100% [5-100]

Specificity [95% CI]

82% [56-95]

14% [3-44]

13% [2-42]

Colonoscopy

Custom Alarm-Based Criteria(n)

AGSE

(n)

EPAGE

(n)

A

I

X

A

I

X

A/N

I/U

X

Colonoscopy Indications

     For FGID Symptoms

12

10

0

11

1

10

15

3

4

Clinically Relevance

Relevant

3

0

0

3

0

0

3

0

0

Non-contributory/Normal

9

10

0

8

1

10

12

3

4

Sensitivity [95% CI]

100% [31-100]

100% [31-100]

100% [31-100]

Specificity [95% CI]

53% [29-75]

11% [1-49]

20% [5-49]

I: inappropriate, A: appropriate, A/N: appropriate or necessary, I/U: inappropriate or uncertain. UGIE relevant finding (hiatus hernia with antral gastritis). Colonoscopy relevant findings (tubular adenoma with low grade dysplasia, benign hyperplastic polyp, active chronic colitis consistent with IBD).

Clinically relevant findings in patients suspected of FGIDs were seen in only 1 UGIE and 3 colonoscopies, occurring in the “appropriate” category of all 3 sets of criteria including the local custom-alarm based ones (Table 4). The alarm-based local criteria applied to UGIEs in patients suspected of FGIDs exhibited greater specificity than ASGE or EPAGE (Z = 3.53, p < 0.001 for each), and were as sensitive as both ASGE and EPAGE (p < 0.001 each). When applied to colonoscopies in patients with clinically suspected FGIDs, alarm-based criteria had greater specificity than ASGE (53% vs 11%, Z = 2.37, p = 0.018), and comparable specificity to EPAGE (55% vs 20%, p = 0.052). Commonly encountered symptoms that are characteristic of FGIDs and yet deemed appropriate for endoscopic tests by ASGE or EPAGE (but not by local alarm-based criteria) were chronic diarrhoea (sampling of tissue or fluid, or suspected malabsorption) and persistent upper abdominal symptoms (following treatment trial, or uncomplicated dyspepsia).

When the custom alarm-based criteria were applied to all diagnostic UGIEs (n = 147; not only those performed in people suspected to have a FGID), they were less sensitive than ASGE (89% vs 100, Z = 2.298, p ≤ 0.021) but as sensitive as EPAGE (89% vs 96% Z = 1.12, P = 0.263) (Table 5). Custom alarm-based criteria more specific than ASGE (26% vs 4%, Z = 3.57, p < 0.001) and EPAGE (26% vs 6%, Z = 3.16, p = 0.002). Only ASGE captured all relevant findings however. When applied to all diagnostic colonoscopies, local alarm based criteria were as sensitive as both ASGE (94% vs 98%, Z = 1.20, p > 0.05) and EPAGE (94% vs 98%, Z = 0.942, p > 0.05), more specific than ASGE (14% vs 1%, Z = 3.06, p = 0.002) and as specific as EPAGE (14% vs 16%, Z = 0.432, p = 0.667).

Table 5.  Comparison of the performance of alarm-based, ASGE, EPAGE criteria in patients undergoing diagnostic UGIE and colonoscopy

Diagnostic UGIE (n = 119)

Custom Alarm-Based Criteria(n)

AGSE

(n)

EPAGE

(n)

A

I

X

A

I

X

A/N

I/U

X

Diagnostic UGIE Indications

95

24

0

112

3

4

104

6

9

Clinically Relevance

Relevant

    42

5

0

47

0

4

43

2

2

Non‑contributory/Normal

53

19

0

65

3

0

61

4

7

Sensitivity [95% CI]

89% [76-96]

100% [91-100]

96% [84-99]

Specificity [95% CI]

26% [17-38]

4% [1-13]

6% [2-16]

Diagnostic Colonoscopy (n = 149)

Custom Alarm-Based Criteria(n)

AGSE

(n)

EPAGE

(n)

A

I

X

A

I

X

A/N

I/U

X

Colonoscopy Indications

132

16

0

133

2

13

111

13

25

Clinically Relevance

Relevant

51

3

0

53

1

0

49

1

4

Non-contributory/Normal

81

13

0

80

1

13

62

12

20

Sensitivity [95% CI]

94% [84-99]

98% [89-100]

98% [88-100]

Specificity [95% CI]

14% [8-23]

1% [0-8]

16% [9-27]

I: inappropriate, A: appropriate, A/N: appropriate or necessary, I/U: inappropriate or uncertain. 

Discussion

Local performance

Here we demonstrated a low rate of inappropriate endoscopic procedures according to both ASGE and EPAGE criteria. Our results are on the low end of the spectrum of the published 10-40% rate of inappropriate procedures [19,21–24,32,33], and better than published rates for gastroenterologist referred colonoscopies (2% vs 10%) and UGIEs (4% vs 14%) using ASGE [25,26]. This study is the first to assess and report the appropriateness of endoscopic procedures in Australia. The low rates of inappropriate procedures may reflect the service pressure to choose wisely [34], and the lack of financial incentives to over-investigate within a publicly funded system. This study was performed in one metropolitan hospital, and further evaluation in the larger Australian context is warranted to establish generalisability.

Comparison of ASGE/EPAGE

Although ASGE and EPAGE criteria were comparable in the yield of clinically relevant findings in those endoscopic investigations judged appropriate, they differed in utility. ASGE was broader in its inclusions, covering most clinical scenarios without consideration of time-frames, whilst EPAGE was more stringent and did not address therapeutic procedures (e.g. stricture dilatation, or intervention for Barrett’s oesophagus) [35]. According to ASGE, all UGIEs are appropriate in patients over 45 years of age with upper abdominal symptoms irrespective of the presence or absence of clinical alarms [36]. There were however several indications which were unable to be classified by each set of criteria which were clearly appropriate according to current clinical practice, suggesting that these criteria could benefit from updating. The rigid format of EPAGE resulted in more indications being unable to be categorised. Specifically, EPAGE required flexible sigmoidoscopy results to determine appropriateness of colonoscopy for iron deficiency anaemia, however sigmoidoscopy is now rarely performed and thus, this resulted in an inability to categorise this indication. Similarly, UGIE endoscopy for caustic/foreign body ingestion was uncodeable in EPAGE whereas they are clearly appropriate based on current data and clinical experience [37–40].

UGIE is regarded as an important diagnostic procedure for patients with upper abdominal and reflux symptoms, however, the logic is mainly due to a fear of missing significant pathology. However, symptomology/clinical alarms do not correlate well with the yield of endoscopic procedures. One study (n = 7159) has shown that less than 1% of patients with gastroesophageal reflux symptoms had Barrett’s or adenocarcinoma. Similarly, a random population study in Sweden (n = 3000) found that although gastroesophageal reflux symptoms were reported in 40% of the general population, only 16% were found to have erosive oesophagitis upon UGIE whilst 6 of 20 (30%) patients with gastric ulcer and 2 of 21 (10%) with duodenal ulcer did not have any symptoms. In patients with epigastric or upper abdominal symptoms, it is generally accepted that UGIE is not needed in those with clinical diagnosis of functional dyspepsia.

A potential limitation of this study is the small sample size. The final number of UGIEs examined was not powered to detect the estimation of 14% inappropriate indications at 5% precision. However, this had negligible effect on the results or subsequent interpretation, as a precision of 6% was achieved. In addition, the number of clinically relevant findings was small, and it is therefore possible that a Type II error has occurred when examining for associations between appropriateness and clinical yield. A larger, prospective comparison of ASGE/EPAGE would be valuable.

Utility of local alarm-based criteria

When applied to patients referred with clinically suspected functional symptoms, the custom alarm-based criteria performed as well as ASGE and EPAGE in terms of sensitivity. In addition, they were more specific that ASGE or EPAGE. Furthermore, the alarm-based criteria enabled categorisation of all indications unlike ASGE or EPAGE. There were several indication categories under which potentially functional symptoms (such as chronic diarrhoea and persistent symptoms) could be coded in both ASGE/EPAGE. These categories could be viewed as “escape clauses” for over-investigating functional symptoms, resulting in more endoscopic procedures than truly necessary according to current guidelines [2].

The use of our alarm-based approach to determining the appropriateness of endoscopic investigation in patients with symptoms suggestive of functional disease may be useful to reduce the number of unnecessary investigations, freeing up valuable endoscopic resources and reducing unnecessary risk to patients. However, this subset of endoscopic procedures performed in potential FGID patients was small and further large-scale evaluation of our custom alarms-based criteria in patients with likely functional symptoms seems justified on these preliminary data.

Conclusion

The targeting of appropriate endoscopic investigations in this unit is very good, with results at the low end of published rates for inappropriate procedures world-wide. Although the ASGE and EPAGE appropriateness criteria performed similarly, both were limited in patients with possible functional symptoms, and less specific than alarm-based criteria. The use of our alarm-based criteria in patients with suspected functional gastrointestinal disorders may further reduce the rate of unnecessary investigations, and this warrants larger scale evaluation.

Funding

2021 Copyright OAT. All rights reserv

This research was funded by The University of Adelaide’s PhD Scholarship.

Acknowledgement

We would like to acknowledge the input of Stuart Howell, The University of Adelaide, for statistical input.

References

  1. Muinuddin A, Aslahi R, Hopman WM, Paterson WG (2013) Relationship between the number of positive fecal occult blood tests and the diagnostic yield of colonoscopy. Can J Gastroenterol 27: 90-94. [Crossref]
  2. Lee TJ, Clifford GM, Rajasekhar P, Rutter MD, Kometa S, et al. (2011) High Yield of Colorectal Neoplasia Detected by Colonoscopy following a Positive Faecal Occult Blood Test in the Nhs Bowel Cancer Screening Programme. J Med Screen 18: 82-86. [Crossref]
  3. Williamson KD, Steveling K, Holtmann G, Schoeman M, Andrews JM (2015) Clinical triage for colonoscopy is useful in young women. Intern Med J 45: 492-496. [Crossref]
  4. Dalrymple J, Bullock I (2008) Diagnosis and management of irritable bowel syndrome in adults in primary care: summary of NICE guidance. BMJ 336: 556-558. [Crossref]
  5. Chang JY, Locke III GR, McNally MA, Halder SL, Schleck CD, et al. (2010) Impact of Functional Gastrointestinal Disorders on Survival in the Community. Am J Gastroenterol 105: 822-832.
  6. Talley NJ (2008) Functional gastrointestinal disorders as a public health problem. Neurogastroenterol Motil 20: S121-S129. [Crossref]
  7. Linedale EC, Chur-Hansen A, Mikocka-Walus A, Gibson PR, Andrews JM (2016) Uncertain Diagnostic Language Affects Further Studies, Endoscopies, and Repeat Consultations for Patients withFunctional Gastrointestinal Disorders. Clin Gastroenterol Hepatol 14: 1735-1741. [Crossref]
  8. Longstreth GF, Thompson WG, Chey WD, Houghton LA, Mearin F, et al. (2006) Functional bowel disorders. Gastroenterology 130: 1480-1491. [Crossref]
  9. Cash BD, Schoenfeld P, Chey WD (2002) The utility of diagnostic tests in irritable bowel syndrome patients: a systematic review. Am J Gastroenterol 97: p2812-p2819. [Crossref]
  10. Hulisz D (2004) The Burden of Illness of Irritable Bowel Syndrome: Current challenges and Hope for the Future. J Manag Care Pharm 10: 299-309. [Crossref]
  11. Linedale E, Shahzad MA, Kellie AR, Mikocka-Walus A, Gibson PR, et al. (2016) Referrals to a Tertiary Hospital: A Window into the Effectiveness of Management of Patients with Functional Gastrointestinal Disorders in Primary Care. J Gastro Hepat 1: 84-91.
  12. Hulisz D (2004) The burden of illness of irritable bowel syndrome: current challenges and hope for the future. J Manag Care Pharm 10: 299-309. [Crossref]
  13. ASGE and EPAGE guidelines are an important help to select and prioritise patients referred to colonoscopy. 2008. Available at: https://www.duo.uio.no/handle/10852/29275
  14. Vader JP, Froehlich F, Dubois RW, Beglinger C, Wietlisbach V, et al. (1999) European Panel on the Appropriateness of Gastrointestinal Endoscopy (EPAGE): conclusion and WWW site. Endoscopy 31: 687-694. [Crossref]
  15. Rossi A, Bersani G, Ricci G, Defabritiis G, Pollino V, et al. (2002) ASGE guidelines for the appropriate use of upper endoscopy: association with endoscopic findings. Gastrointest Endosc 56: 714-719. [Crossref]
  16. Gonvers JJ, Harris JK, Wietlisbach V, Burnand B, Vader JP, et al. (2007) A European view of diagnostic yield and appropriateness of colonoscopy. Hepatogastroenterology 54: 729-735. [Crossref]
  17. Argüello L, Pertejo V, Ponce M, Peiró S, Garrigues V, et al. (2012) The appropriateness of colonoscopies at a teaching hospital: magnitude, associated factors, and comparison of EPAGE and EPAGE-II criteria. Gastrointest Endosc 75: 138-145. [Crossref]
  18. Andriulli A, Annese V, Terruzzi V, Grossi E, Minoli G (2006) "Appropriateness" or "prioritization" for GI endoscopic procedures? Gastrointest Endosc 63: 1034-1036. [Crossref]
  19. Froehlich F, Pache I, Burnand B, Vader JP, Fried M, et al. (1998) Performance of panel-based criteria to evaluate the appropriateness of colonoscopy: a prospective study. Gastrointest Endosc 48: 128-136. [Crossref]
  20. Seematter-Bagnoud L, Vader JP, Wietlisbach V, Froehlich F, Gonvers JJ, et al. (1999) Overuse and underuse of diagnostic upper gastrointestinal endoscopy in various clinical settings. Int J Qual Health Care 11: 301-308. [Crossref]
  21. Buri L, Hassan C, Bersani G, Anti M, Bianco MA, et al. (2010) Appropriateness guidelines and predictive rules to select patients for upper endoscopy: a nationwide multicenter study. Am J Gastroenterol 105: 1327-1337. [Crossref]
  22. Suriani R, Rizzetto M, Mazzucco D, Grosso S, Gastaldi P, et al. (2009) Appropriateness of colonoscopy in a digestive endoscopy unit: a prospective study using ASGE guidelines. J Eval Clin Pract 19: 41-45. [Crossref]
  23. Altayar O, Sharma S, Prokop LJ, Sood A, Murad MH, et al. (2015) Psychological therapies in patients with irritable bowel syndrome: a systematic review and meta-analysis of randomized controlled trials. Gastroenterol Res Pract: 549308.
  24. Harris JK, Froehlich F, Gonvers JJ, Wietlisbach V, Burnand B, et al. (2007) The appropriateness of colonoscopy: a multi-center, international, observational study. Int J Qual Health Care 19: 150-157. [Crossref]
  25. Suriani R, Rizzetto M, Mazzucco D, Grosso S, Gastaldi P, et al. (2009) Appropriateness of colonoscopy in a digestive endoscopy unit: a prospective study using ASGE guidelines. J Eval Clin Pract 15: 41-45. [Crossref]
  26. Rossi A, Bersani G, Ricci G, Defabritiis G, Pollino V, et al. (2002) ASGE guidelines for the appropriate use of upper endoscopy: association with endoscopic findings. Gastrointestinal endoscopy 56: 714. [Crossref]
  27. Bersani G, Rossi A, Suzzi A, Ricci G, De Fabritiis G, et al. (2004) Comparison between the two systems to evaluate the appropriateness of endoscopy of the upper digestive tract. Am J Gastroenterol 99: 2128-2135. [Crossref]
  28. Adler A, Roll S, Marowski B, Drossel R, Rehs HU, et al. (2005) Appropriateness of Diagnostic Colonoscopy in the Era of Screening Colonoscopy: Do We Need Better Selection Criteria? Gastrointest Endosc 61: AB246-AB246.
  29. Bersani G, Rossi A, Gorini B, Suzzi A, Ricci G, et al. (2005) ASGE Criteria and EPAGE Method for the Appropriate Use of Colonoscopy: Which Is the Most Accurate? Gastrointest Endosc 61: AB148-AB148.
  30. Burnand B, Vader JP, Froehlich F, Dupriez K, Larequi-Lauber T, et al. (1998) Reliability of panel-based guidelines for colonoscopy: an international comparison. Gastrointest Endosc 47: 162-166. [Crossref]
  31. Brown LD, Cai TT, Dasgupta A (2001) Interval Estimation for a Binomial Proportion: Rejoinder. Statistical Science 16: 128-133.
  32. Kaliszan B, Soule JC, Vallot T, Mignon M (2006) Applicability and efficacy of qualifying criteria for an appropriate use of diagnostic upper gastrointestinal endoscopy. Gastroenterol Clin Biol 30: 673-680. [Crossref]
  33. Balaguer F, Llach J, Castells A, Bordas JM, Ppellise M, et al. (2005) The European panel on the appropriateness of gastrointestinal endoscopy guidelines colonoscopy in an open-access endoscopy unit: a prospective study. Aliment Pharmacol Ther 21: 609-613. [Crossref]
  34. http://www.choosingwisely.org.au/
  35. Vader JP, Froehlich F, Burnand B, Gonvers JJ (2005) ASGE versus EPAGE versus diagnostic yield: a level playing field, please! Am J Gastroenterol 100: 1892. [Crossref]
  36. ASGE Standards of Practice Committee, Early DS, Ben-Menachem T, Decker GA, Evans JA, et al. (2012) Appropriate use of GI endoscopy. Gastrointest Endosc 75: 1127-1131. [Crossref]
  37. Eisen GM, Baron TH, Dominitz JA, Faigel DO, Goldstein JL, et al. (2002) Guideline for the management of ingested foreign bodies. Gastrointest Endosc 55: 802-806. [Crossref]
  38. Birk M, Bauerfeind P, Deprez PH, Häfner M, Hartmann D, et al. (2016) Removal of foreign bodies in the upper gastrointestinal tract in adults: (ESGE) Clinical Guideline. Endoscopy 48: 1-8.
  39. Poley JW, Steyerberg EW, Kuipers EJ, Dees J, Hartmans R, et al. (2004) Ingestion of acid and alkaline agents: outcome and prognostic value of early upper endoscopy. Gastrointest Endosc 60: 372-377. [Crossref]
  40. Cabral C, Chirica M, de Chaisemartin C, Gornet JM, Munoz-Bongrand N, et al. (2012) Caustic injuries of the upper digestive tract: a population observational study. Surg Endosc 26: 214-221. [Crossref]

Editorial Information

Editor-in-Chief

Marcel CC Machado
University of Brazil

Article Type

Research Article

Publication history

Received date: May 12, 2018
Accepted date: May 30, 2018
Published date: June 04, 2018

Copyright

©2018 Linedale EC. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Citation

Linedale EC, Rizvi Q, Mikocka-Walus A, Gibson PR, Andrews JM (2018) Direct comparison of ASGE, EPAGE and alarm-based appropriateness criteria for endoscopic procedures: A retrospective audit. Gastroenterol Hepatol Endosc 3: doi: 10.15761/GHE.1000161

Corresponding author

Ecushla C. Linedale

The University of Adelaide, North Terrace, SA 5005, Australia.

Table 1. Locally Developed Algorithm-based Alarm Criteria for the Appropriateness of Endoscopies.

Upper GI Endoscopy

 Colonoscopy

Abnormal physical exam

Abnormal Imaging

New onset symptoms if > 50 years of age (within 6 months)

Unexplained weight loss (> 3 kg or 5% body weight)

Iron deficiency ± anaemia

Haematemesis

Melena, faecal occult blood, overt rectal bleeding

Dysphagia/odynophagia

Abdominal pain awaking patient from sleep

Family History of Coeliac Disease in symptomatic patient (1 FDR)

Nocturnal diarrhoea/faecal incontinence

Unexplained fever

Family history of colon cancer (1 FDR* < 60, or > 1 FDR any age)

Family History of IBD in symptomatic patient (1 FDR)

*FDR: first-degree relative

Table 2. Demographics of patients undergoing UGIE and colonoscopy

Demographics

UGIE

Colonoscopy

Number of procedures

n (%)

n (%)

147

196

Gender

Female

69 (47)

97 (50)

Male

78 (53)

99 (50)

Admission Status

Outpatient

98 (67)

172 (88)

In-patient

43 (29)

18 (9)

In-patient/for the procedure

6 (4)

6 (3)

Referral Source

Gastroenterologist

99 (67)

101(52)

Primary healthcare provider

4 (3)

3 (1)

Surgeons

19 (13)

80 (41)

Other

25 (17)

12 (7)

Prior procedures

Multiple prior

25 (17)

11 (6)

At least one prior

22 (15)

53 (27)

No prior

12 (8)

15 (8)

Not stated

88 (60)

117 (60)

Table 3. Comparison of the performance of ASGE, EPAGE for UGIE and Colonoscopy.

AGSE n(%)

EPAGE n(%)

A

I

X

A/N

I/U

X

UGIE Indications

131 (89%)

6 (4%)

10 (7%)

117 (80%)

11 (7%)

19 (13%)

Clinical Alarms (88)

86

0

2

83

0

5

Persistent Symptoms/No Alarms (21)

17

2

2

14

4

3

Surveillance (20)

14

2

4

8

3

9

Post-operative assessment/complications (3)

3

0

0

2

0

1

Pre-operative Assessment (2)

0

1

1

1

1

0

Metastatic cancer-seeking primary (3)

2

1

0

2

1

0

Persistent symptoms despite treatment (3)

3

0

0

3

0

0

Achalasia (2)

2

0

0

2

0

0

Operative endoscopy (2)

1

0

1

1

1

0

Diarrhoea/Immunocompromised (2)

2

0

0

0

1

1

Food bolus (1)

1

0

0

1

0

0

Clinical Relevance of Findings

Clinically Relevant

64 (49%)

2 (33%)

3 (30%)

53 (45%)

6 (55%)

10 (53%)

Non-contributory abnormality

28 (21%)

2 (33%)

2 (20%)

27 (23%)

3 (27%)

2 (11%)

Normal

39 (30%)

2 (33%)

5 (50%)

37 (32%)

2 (18%)

7 (37%)

AGSE n (%)

EPAGE n (%)

A

I

X

A/N

I/U

X

Colonoscopy Indications

173 (88%)

4 (2%)

19 (10%)

141 (72%)

20 (10%)

35 (18%)

Clinical Alarms (124)

121

0

3

95

10

19

Persistent Symptoms/No Alarms (13)

4

1

8

10

1

2

Surveillance (27)

21

2

4

13

4

10

IBD Follow Up (12)

12

0

0

9

2

1

Pre-operative Assessment (5)

4

0

1

5

0

0

Metastatic cancer-seeking primary (4)

3

0

1

3

1

0

Persistent symptoms despite treatment (2)

2

0

0

1

0

1

Completion colonoscopy (3)

2

0

1

2

0

1

Operative colonoscopy (2)

2

0

0

1

1

0

Diarrhoea/Immunocompromised (2)

2

0

0

1

0

1

Unindicated (2)

1

0

1

1

0

1

Clinical Relevance of Findings

Clinically Relevant

70 (40)

2 (50%)

2 (11%)

62 (44%)

4 (21%)

8 (22%)

Non-contributory abnormality

46 (24%)

1 (25%)

4 (22%)

35 (25%)

4 (21%)

12 (33%)

Normal

58 (33)

1 (25%)

12 (67%)

44 (31%)

11 (58%)

16 (44%)

A: appropriate, I: inappropriate, X: un-codeable, A/N: appropriate or necessary, I/U: inappropriate or uncertain. UGIE Surveillance (Barrett’s oesophagus n = 12, varices n = 6, stricture n = 1, gastric ulcer n = 1), post-operative assessment for complications (fundoplication n = 2, gastric bypass n = 1), Preoperative assessment (gastric bypass surgery n = 2). 3/10 ASGE-uncodeable and 3/11 EPAGE-uncodeable UGIEs, were unable to be coded due to insufficient information in the medical records. Colonoscopy IBD Follow Up (active disease n = 4, cancer n = 6, post-operative n = 3), Surveillance (benign disease n = 2, colorectal cancer n = 3, polyps n = 14, post colorectal cancer n = 8), Preoperative assessment (benign disease n = 2, colorectal cancer n = 2, fistula n = 1). 4/18 ASGE-uncodeable and 11/36 EPAGE-uncodeable colonoscopies, were unable to be coded due to insufficient information in the medical records.

Table 4.  Comparison of the performance of alarm-based, ASGE, EPAGE for UGIE and colonoscopy in patients with clinically suspected FGID symptoms

UGIE

Custom Alarm-Based Criteria(n)

AGSE

(n)

EPAGE

(n)

A

I

X

A

I

X

A/N

I/U

X

UGIE Indications

4

14

0

13

2

3

14

2

2

Clinically Relevance

     Relevant

1

0

0

1

0

0

1

0

0

     Non‑contributory/Normal

3

14

0

12

2

3

13

2

2

Sensitivity [95% CI]

100% [5-100]

100% [5-100]

100% [5-100]

Specificity [95% CI]

82% [56-95]

14% [3-44]

13% [2-42]

Colonoscopy

Custom Alarm-Based Criteria(n)

AGSE

(n)

EPAGE

(n)

A

I

X

A

I

X

A/N

I/U

X

Colonoscopy Indications

     For FGID Symptoms

12

10

0

11

1

10

15

3

4

Clinically Relevance

Relevant

3

0

0

3

0

0

3

0

0

Non-contributory/Normal

9

10

0

8

1

10

12

3

4

Sensitivity [95% CI]

100% [31-100]

100% [31-100]

100% [31-100]

Specificity [95% CI]

53% [29-75]

11% [1-49]

20% [5-49]

I: inappropriate, A: appropriate, A/N: appropriate or necessary, I/U: inappropriate or uncertain. UGIE relevant finding (hiatus hernia with antral gastritis). Colonoscopy relevant findings (tubular adenoma with low grade dysplasia, benign hyperplastic polyp, active chronic colitis consistent with IBD).

Table 5.  Comparison of the performance of alarm-based, ASGE, EPAGE criteria in patients undergoing diagnostic UGIE and colonoscopy

Diagnostic UGIE (n = 119)

Custom Alarm-Based Criteria(n)

AGSE

(n)

EPAGE

(n)

A

I

X

A

I

X

A/N

I/U

X

Diagnostic UGIE Indications

95

24

0

112

3

4

104

6

9

Clinically Relevance

Relevant

    42

5

0

47

0

4

43

2

2

Non‑contributory/Normal

53

19

0

65

3

0

61

4

7

Sensitivity [95% CI]

89% [76-96]

100% [91-100]

96% [84-99]

Specificity [95% CI]

26% [17-38]

4% [1-13]

6% [2-16]

Diagnostic Colonoscopy (n = 149)

Custom Alarm-Based Criteria(n)

AGSE

(n)

EPAGE

(n)

A

I

X

A

I

X

A/N

I/U

X

Colonoscopy Indications

132

16

0

133

2

13

111

13

25

Clinically Relevance

Relevant

51

3

0

53

1

0

49

1

4

Non-contributory/Normal

81

13

0

80

1

13

62

12

20

Sensitivity [95% CI]

94% [84-99]

98% [89-100]

98% [88-100]

Specificity [95% CI]

14% [8-23]

1% [0-8]

16% [9-27]

I: inappropriate, A: appropriate, A/N: appropriate or necessary, I/U: inappropriate or uncertain.