There is controversy with regard to therapies proposed to be effective for Myalgic Encephalomyelitis (ME) and chronic fatigue syndrome (CFS), especially behavorial therapies: cognitive behavioral therapy (CBT) and graded exercise therapy (GET). As will be exemplified by the PACE trial and other studies, the positive effects of CBT and GET are almost exclusively based on strongly varying subjective criteria (measures and cut-off thresholds for fatigue, physical functioning, et cetera). Depending on the subjective criteria used ‘recovery’ rates vary from 7% to 69%. Looking at the objective measures, e.g. work rehabilitation, physical fitness, and activity levels, CBT and GET seem to have a negligible effect or no effect at all. Trials into proposed therapies for ME and CFS, including CBT, GET, rituximab and rintatolimod, should use objective measures to impartially assess the effectiveness.
myalgic encephalomyelitis, chronic fatigue syndrome, therapy, evidence-based medicine, measures
ME, acknowledged as a new clinical entity in the ‘50s , is a multisystemic disease, characterised by distinctive muscular symptoms, especially muscle weakness and myalgia after minor exertion lasting for days, neurological symptoms implicating cerebral dysfunction, e.g. cognitive impairment and sleep reversal, dysregulation of the circulatory system and other systems, and a chronic relapsing course [2-4]. CFS, introduced in 1988  and redefined in 1994 , is primarily defined by chronic fatigue. To meet the diagnosis CFS , chronic fatigue must be accompanied by at least four out of eight additional symptoms: loss of memory or concentration, sore throat, tender lymph nodes, muscle pain, joint pain, headaches, unrefreshing sleep and prolonged extreme exhaustion after minor exertion (post-exertional ‘malaise’). Although ME and CFS are often used interchangeably, the diagnostic criteria for ME [2-4] and CFS  define distinct clinical entities with partial overlap. A patient can meet the diagnosis ME [2-4] while not fulfilling the CFS  criteria and vice versa.
Both ME and CFS are defined by a complex of symptoms: ambiguous and abstract notions, e.g. muscle weakness, fatigue, cognitive deficits and unrefreshing sleep. However these symptoms, if not operationalized, are also experienced in other conditions, e.g. mitochondrial disorders and depression, and assessment of the presence and severity of a specific symptom fully relies on the patient’s judgement. Diagnosis, improvement and recovery are almost always based on subjective notions, e.g. fatigue scores, derived from questionnaires, visual analogue scales et cetera.
This article will illustrate that the various subjective definitions of caseness and recovery used, based on cut-off scores for subjective measures, used fully determine the outcomes of trails into the effects of treatments, e.g. CBT and GET, yielding recovery rates from 7% (without any significant differences compared to non-intervention) to 69%.
Commonly used subjective measures for ME and CFS relate to ‘fatigue’ and physical functioning. An often used variant of the Chalder Fatigue Scale (CFQ) [7,8] contains 11 questions relate to ‘fatigue’ , e.g. “Do you lack energy?”. The answers can be scored ‘binary’ (“better than usual” and “no worse than usual” scoring 0, “worse than usual” and “much worse” scoring 1), yielding a range of 0 to 11 for the CFB fatigue score. Alternatively the CFQ is combined with Likert scores (“better than usual”: 0, “no worse than usual”: 1, “worse than usual”: 2, and “much worse”: 3), giving a range of 0 to 33 for the CFL fatigue score. Higher CFB and CFL fatigue scores implicate higher levels of fatigue. The CIS F  score is based on the patients’ rating of 8 statements related to ‘fatigue’, e.g. “I get tired very quickly”, on a seven point Likert scale (from 1 for “no, that is not true” to 7 for “yes, that is true”, or reversed scoring) yielding a total score for CIS F ranging from 8 to 56. Higher CIS F scores indicate higher levels of fatigue. The SF-36 PF score [11-13] is derived from 10 questions with regard to physical limitations, with possible scores being “limited a lot” (score: 0), “limited a little” (50), or “not limited at all” (100). The total SF-36 PF score (range: 0-1,000) is divided by 10, yielding a range of 0 to 100. Higher SF-36 PF scores implicate better health. Other studies use the SIP 8 score [10,14] to assess the degree of disability (limitations), subdivided into 8 categories. The SIP-8 score (total weighted score of all items in the 8 SIP subscales) ranges from 0 to 5,799, lower scores indicating less disability.
The outcomes of trials into the effect of therapies are fully determined by strongly varying subjective criteria
Most trials into therapies for ME and CFS relate to CBT, GET or variants thereof. Some trials have investigated the effects of pharmaceuticals, including rituximab and rintatolimod. The strong influence of the subjective criteria employed on the (positive) outcomes of CBT and GET will be illustrated by two examples: the PACE-trial and hallmark studies of the Dutch Expert Centre for Chronic Fatigue (NKCV). The third example relates to the subjective and objective effects of pharmaceuticals.
Example 1: The PACE trial (CBT, GET and standard medical care)
The PACE trial , a large-scale trial into the effects of CBT, GET, adaptive pacing therapy (APT) and standard care (SMC) in the UK, have been the subject to of lot of controversy [16-23]. According to the original PACE protocol  people were eligible if they met the Oxford criteria for chronic fatigue (CF) , implicating a CFB score ≥6 (CFL >12), and the SF-36 PF score was ≤65. A ‘positive outcome’ for CFL B was defined as “a 50% reduction in fatigue score, or a score of 3 or less” (“normal fatigue”), while a score of ≥75, or a 50% increase from the baseline score was considered to be a ‘positive outcome’ for SF-36 PF. Recovery was defined by four criteria: CFB ≤3, SF-36 PF ≥85, self-rated Clinical Global Impression (CGI): "very much better" and no longer meeting the criteria for CF , CFS  or ‘ME’.
Deviating from the protocol , the eligibility criterion for SF-36 PF was defined as ≤60 at the start of the trial . During the trial this criterion was changed from ≤60 to ≤65 to increase recruitment. The eligibility criterion for the CFB score remained ≥6. In the post-hoc analysis the ‘normal range’ for the CFL score was defined as ≤18, corresponding to a CFB score of ≤9, the ‘normal range’ for SF-36 PF as ≥60 . This implies the patient in the PACE trial could meet the ‘normal ranges’ for CFL and SF-36 PF afterwards without any improvement or even with a small deterioration. Moreover the ‘normal values’ defined by the PACE trial  (CFL ≤18, SF-36 PF ≥60) don’t come close to the recovery criteria from the protocol (CFB ≤3/CFL ≤9, SF-36 PF ≥85).
In 2013 the PACE trial investigators published ‘recovery rates’  for “trial recovery from CFS” and “clinical recovery from the illness”. “Trail recovery” was defined by the two criteria based on ‘normal values’ for CFB (≤18) and SF-36 PF (≥60), combined two other criteria, CGI being “much better” or “very much better” and no longer meeting the Oxford case definition of CF . Based on this new ‘recovery’ criteria, which are much less strict than the recovery criteria as defined in the PACE trial protocol , the authors reported that the percentages of ‘recovered’ CF patients were 22% after CBT, 22% after GET, 8% after APT and 7% after SMC . Note, these rates potentially include patients who already met ‘recovery’ criteria at baseline. A re-analysis concluded that “When recovery was defined according to the original protocol, recovery rates in the GET and CBT groups were low and not significantly higher than in the control group [SMC arm] (4%, 7% and 3%, respectively) .
So, when the subjective recovery criteria defined by the PACE trial investigators are employed the difference between the effects of CBT and GET and of SMC are nihil. This finding is reflected by the effects of CBT, GET and SMC on objective measures. CBT and GET had a very small effect on the number of meters walked in 6 minutes , largely insufficient to achieve normal levels [28,29], ‘return to employment’, health care usage and social welfare benefits didn’t improve , while fitness and perceived exertion during a step test also didn’t substantially improve .
Example 2: Dutch studies into CBT/GET
The use of various subjective measures and strongly fluctuating cut-off scores to define caseness, improvement and recovery is also observed in three Dutch studies into the effects of CBT/GET.
According to Knoop et al.  69% of the patients ‘recovered from CFS’ by CBT/GET. ‘Recovery from CFS’ was defined as a CIS F score <35 and a SIP 8 score <700. Since the inclusion criteria (CIS F ≥35 and SIP 8 ≥700) border on the recovery criteria, a minimal improvement was sufficient to be qualified as ‘recovered from CFS’. But the cut-off thresholds for recovery don’t come close to the criteria for “normal fatigue” (CIS F ≤27) and “no disabilities in all domains” (SIP8 ≤203) as defined by the authors. According to Knoop et al.  23% of the patients recovered using the ’“most comprehensive definition”. However this definition of recovery doesn’t include a criterion for SIP 8, one of the two measures to define ‘CFS’. Moreover, all cut-off thresholds (mean + 1 SD) assume normal distributions for CIS F, SF-36 PF, SF-36 Social Functioning and SF-36 Social Functioning. But, as the authors confirm, the scores are not normally distributed. For that reason (85%) percentiles should be used. If percentiles were used and the SIP 8 score was included recovery rates would drop substantially below 20%. A control group was lacking, but another study by the same group  observed a self-rated clinical improvement in 30% of the patients in the non-intervention group.
Prins et al.  conducted a study of the effects of CBT/GET, guided support, and non-intervention in CF patients and concluded that “[CBT/GET] was significantly more effective than both control conditions for fatigue severity [..] and for functional impairment [..]”. Both CBT/GET and non-intervention had a positive effect on the mean CIS F  and SIP 8  score. But the effects of CBT/GET and non-intervention were by far insufficient to achieve ‘normal levels’ for CIS F [32,36] and SIP 8 [32,33,36] as defined in other studies by the research group. There was no significant difference between the effect of CBT/GET and non-intervention on all secondary subjective measures, except for the Karnofsky status [37,38], rated by a clinical psychologist. Prins and colleagues  observed a clinically significant improvement of fatigue (CIS F) for 35%, Karnofsky score for 49%, and self-rated improvement for 50% of the CF patients after CBT/GET. However 32% of the patients in the non-intervention group also reported a clinical significant improvement without any intervention and 23% experienced a significant improvement of the Karnofsky performance status. The subjective improvement experienced in the CBT/GET and non-intervention group was not reflected by an improvement of objective measures. CBT/GET had no substantial effect on the (low) number of hours worked  or activity levels .
Both CBT/GET and non-intervention had a positive effect on CIS F and SF-36 PF in adolescents with CFS in a study by Stulemeijer and others , although the effects of CBT/GET on these two primary measures were significantly enhanced. The effects of CBT/GET on the eight other CFS symptoms  were very modest or non-existent. No less than 44% of the patients in the non-intervention group and 71% in the CBT/GET arm rated themselves as “completely recovered” or “much better”. Although the effect of CBT/GET was significantly larger, both CBT/GET and non-intervention had a positive effect on school attendance, the only objective measure reported by this study. Despite the positive effects school absence remained rather high in both groups. A reduction of school absence is at odds with the negligible effects of CBT/GET on activity levels established in another study by the same research group . A follow-up study  observed that CBT/GET didn’t result into improved cognitive test scores. This is extremely relevant since Nijhoff and others  observed that CFS has a dramatic impact on cognitive functioning and this decline in the IQ of CFS patients is not correlated to school absence.
Example 3: Research into pharmaceuticals
Some studies have studied the effects of Rintatolimod (Ampligen), an antiviral and immunomodulatory drug, poly(I).poly(C12U), in CFS . Although studies showed positive effects on subjective measures for the severity of the symptoms and degree of disability [44-46], the evidence of positive effects on objective measures is limited to exercise tolerance and concomitant medication usage until now [44,46].
Three studies reported positive effects of B-cell depletion by the anti-CD20 antibody rituximab in a subgroup of CFS patients [47-49]. Evidence of a positive effect on objective measures, e.g. (maximum) oxygen uptake or activity levels, is still lacking, but the protocol of a randomized phase III study , which will be finished in the near future, states the trial will report on the effects of rituximab on activity levels.
Trials into therapies for ME and CFS should be using objective measures
Subjective measures are associated with risk of bias (‘researcher allegiance’’) , the placebo effect  and buy-in effects , and other effects related to the nature of these measures. The shortcomings of subjective measures are extremely relevant since, as observed by Knoop and colleagues , the effect of behavorial treatments, like CBT and GET, is (mainly) due to expectations and a placebo effect.
Knoop et al.  also confirm that: “[R]ecovery is a construction. The percentage of recovered patients differed depending on the definition of recovery used.”. Recovery rates vary from 69% to non-existent, just by employing different cut-offs for subjective measures. Since the effect of CBT/GET is ascribed to a placebo response by Knoop et al.  (14% for psychological interventions in ME/CFS), one could argue that the real effect of CBT/GET is non-existent. This position is confirmed by the observation that CBT/GET has no substantial effect of the low activity levels .
Looking at the current controversy with regard to therapies for ME and CFS, trials into proposed effective therapies for ME and CFS, including CBT, GET, rituximab and rintatolimod, should use objective measures to impartially assess the effectiveness.
- No authors listed (1956) A new clinical entity? Lancet 270: 789-790.
- Ramsay AM (1988) Myalgic Encephalomyelitis and postviral fatigue states: the saga of Royal Free disease. (2nd ed). London, UK: Gower Publishing Corporation.
- Dowsett EG, Ramsay AM, McCartney RA, Bell EJ (1990) Myalgic encephalomyelitis--a persistent enteroviral infection? Postgrad Med J 66: 526-530. [Crossref]
- Ramsay AM, Dowsett EG (1992) Myalgic Encephalomyelitis: Then and now. In: Hyde BM, Goldstein J, Levine P, edtrs. The Clinical and Scientific Basis of Myalgic Encephalomyelitis / Chronic Fatigue Syndrome. Ottawa: The Nightingale Research Foundation: 81-84.
- Holmes GP, Kaplan JE, Gantz NM, Komaroff AL, Schonberger LB, et al. (1988) Chronic fatigue syndrome: a working case definition. Ann Intern Med 108: 387-389. [Crossref]
- Fukuda K, Straus SE, Hickie I, Sharpe MC, Dobbins JG, et al. (1994) The chronic fatigue syndrome: a comprehensive approach to its definition and study. International Chronic Fatigue Syndrome Study Group. Ann Intern Med 121: 953-959. [Crossref]
- Cella M, Chalder T (2010) Measuring fatigue in clinical and community settings. J Psychosom Res 69: 17-22. [Crossref]
- Chalder T, Berelowitz G, Pawlikowska T, Watts L, Wessely S, et al. (1993) Development of a fatigue scale. J Psychosom Res 37: 147-153. [Crossref]
- Jason LA, Jessen T, Porter N, Boulton A, Gloria-Njoku M, et al. (2009) Examining types of fatigue among individuals with ME/CFS. Disability Studies Quarterly 29.
- Vercoulen JH, Swanink CM, Fennis JF, Galama JM, van der Meer JW, et al. (1994) Dimensional assessment of chronic fatigue syndrome. J Psychosom Res 38: 383-392. [Crossref]
- Ware JE Jr, Sherbourne CD (1992) The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care 30: 473-483. [Crossref]
- McHorney CA, Ware JE Jr, Raczek AE (1993) The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Med Care 31: 247-263. [Crossref]
- McHorney CA, Ware JE Jr, Lu JF, Sherbourne CD (1994) The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Med Care 32: 40-66. [Crossref]
- Bergner M, Bobbitt RA, Carter WB, Gilson BS (1981) The Sickness Impact Profile: development and final revision of a health status measure. Med Care 19: 787-805. [Crossref]
- White PD, Goldsmith KA, Johnson AL, Potts L, Walwyn R, et al. (2011) Comparison of adaptive pacing therapy, cognitive behaviour therapy, graded exercise therapy, and specialist medical care for chronic fatigue syndrome (PACE): a randomised trial. Lancet 377: 823-836. [Crossref]
- Kindlon T (2011) The PACE trial in chronic fatigue syndrome. Lancet 377: 1834-1835. [Crossref]
- Vlaeyen JW, Karsdorp P, Gatzounis R, Ranson S, Schrooten M (2011) The PACE trial in chronic fatigue syndrome. Lancet 377: 1834. [Crossref]
- Shinohara M (2011) The PACE trial in chronic fatigue syndrome. Lancet 377: 1833-1834. [Crossref]
- Geraghty KJ (2017) 'PACE-Gate': When clinical trial evidence meets open data access. J Health Psychol 22: 1106-1112. [Crossref]
- Edwards J (2017) PACE team response shows a disregard for the principles of science. J Health Psychol 22: 1155-1158. [Crossref]
- Vink M (2017) PACE trial authors continue to ignore their own null effect. J Health Psychol 22: 1134-1140. [Crossref]
- Kindlon T (2017) Do graded activity therapies cause harm in chronic fatigue syndrome? J Health Psychol 22: 1146-1154. [Crossref]
- Twisk F (2016) PACE: CBT and GET are not rehabilitative therapies. Lancet Psychiatry 3: e6. [Crossref]
- White PD, Sharpe MC, Chalder T, DeCesare JC, Walwyn R, et al. (2007) Protocol for the PACE trial: a randomised controlled trial of adaptive pacing, cognitive behaviour therapy, and graded exercise, as supplements to standardised specialist medical care versus standardised specialist medical care alone for patients with the chronic fatigue syndrome/myalgic encephalomyelitis or ence-phalopathy. BMC Neurol 7: 6. [Crossref]
- Sharpe MC, Archard LC, Banatvala JE, Borysiewicz LK, Clare AW, et al. (1991) A report--chronic fatigue syndrome: guidelines for research. J R Soc Med 84: 118-121. [Crossref]
- White PD, Goldsmith KA, Johnson AL, Chalder T, Sharpe M, et al. (2013) Recovery from chronic fatigue syndrome after treatments given in the PACE trial. Psychol Med 43: 2227-2235. [Crossref]
- Wilshire C, Kindlon T, Matthees A, McGrath S (2017) Can patients with chronic fatigue syndrome really recover after graded exercise or cognitive behavioural therapy? A critical commentary and preliminary re-analysis of the PACE trial. Fatigue: Biomedicine, Health & Behavior 5: 43-56.
- Kewley AJ (2011) The PACE trial in chronic fatigue syndrome. Lancet 377: 1834-1835. [Crossref]
- Troosters T, Gosselink R, Decramer M (1999) Six minute walking distance in healthy elderly subjects. Eur Respir J 14: 270-274. [Crossref]
- McCrone P, Sharpe M, Chalder T, Knapp M, Johnson AL, et al. (2012) Adaptive pacing, cognitive behaviour therapy, graded exercise, and specialist medical care for chronic fatigue syndrome: a cost-effectiveness analysis. PLoS One 7: e40808. [Crossref]
- Chalder T, Goldsmith KA, White PD, Sharpe M, Pickles AR (2015) Rehabilitative therapies for chronic fatigue syndrome: a secondary mediation analysis of the PACE trial. Lancet Psychiatry 2: 141-152. [Crossref]
- Knoop H, Bleijenberg G, Gielissen MF, van der Meer JWM, White PD (2007) Is a full recovery possible after cognitive behavioural therapy for chronic fatigue syndrome? Psychother Psychosom 76: 171-176. [Crossref]
- Prins JB, Bleijenberg G, Bazelmans E, Elving LD, de Boo TM, et al. (2001) Cognitive behaviour therapy for chronic fatigue syndrome: a multicentre randomised controlled trial. Lancet 357: 841-847. [Crossref]
- Vercoulen JHMM, Alberts M, Bleijenberg G (1999) [De Checklist Individual Strength (CIS)] [Article in Dutch]. Gedragstherapie 32: 131-136.
- Jacobs HM, Luttik A, Touw-Otten FW, de Melker RA (1990) [De ‘Sickness Impact Profile’: resultaten van een valideringsonderzoek van de Nederlandse versie] [Article in Dutch]. Ned Tijdschr Geneeskd 134: 1950-1954.
- Bazelmans E, Prins JB, Lulofs R, van der Meer JW, Bleijenberg G (2005) Cognitive behaviour group therapy for chronic fatigue syndrome: a non-randomised waiting list controlled study. Psychother Psychosom 74: 218-224. [Crossref]
- Karnofsky DA, Abelmann WH, Craver LF, Burchenal J (1948) Use of the nitrogen mustards in the palliative treatment of carcinoma - with particular reference to bronchogenic carcinoma. Cancer 1: 634-656.
- Schaafsma J, Osoba D (1994) The Karnofsky Performance Status Scale re-examined: a cross-validation with the EORTC-C30. Qual Life Res 3: 413-424. [Crossref]
- Wiborg JF, Knoop H, Stulemeijer M, Prins JB, Bleijenberg G (2010) How does cognitive behaviour therapy reduce fatigue in patients with chronic fatigue syndrome? The role of physical activity. Psychol Med 40: 1281-1287. [Crossref]
- Stulemeijer M, de Jong LWAM, Fiselier TJW, Hoogveld SWB, Bleijenberg G (2005) Cognitive behaviour therapy for adolescents with chronic fatigue syndrome: randomised controlled trial. BMJ 330: 14. [Crossref]
- Knoop H, Prins JB, Stulemeijer M, van der Meer JWM, Bleijenberg G (2007) The effect of cognitive behaviour therapy for chronic fatigue syndrome on self-reported cognitive impairments and neuropsychological test performance. J Neu-rol Neurosurg Psychiatry 78: 434-436. [Crossref]
- Nijhof LN, Nijhof SL, Bleijenberg G, Stellato RK, Kimpen JL, et al. (2016) The impact of chronic fatigue syndrome on cognitive functioning in adolescents. Eur J Pediatr 175: 245-252. [Crossref]
- Mitchell WM (2016) Efficacy of rintatolimod in the treatment of chronic fatigue syndrome/myalgic encephalomyelitis (CFS/ME). Expert Rev Clin Pharmacol 9: 755-770. [Crossref]
- Strayer DR, Carter WA, Brodsky I, Cheney P, Peterson D, et al. (1994) A controlled clinical trial with a specifically configured RNA drug, poly(I).poly(C12U), in chronic fatigue syndrome. Clin Infect Dis 18: S88-S95. [Crossref]
- Suhadolnik RJ, Reichenbach NL, Hitzges P, Adelson ME, Peterson DL, et al. (1994) Changes in the 2-5A synthetase/RNase L antiviral pathway in a controlled clinical trial with poly(I)-poly(C12U) in chronic fatigue syndrome. In Vivo 8: 599-604. [Crossref]
- Strayer DR, Carter WA, Stouch BC, Stevens SR, Bateman L, et al. (2012) A double-blind, placebo-controlled, randomized, clinical trial of the TLR-3 agonist rintatolimod in severe cases of chronic fatigue syndrome. PLoS One 7: e31334. [Crossref]
- Fluge Ø, Mella O (2009) Clinical impact of B-cell depletion with the anti-CD20 antibody rituximab in chronic fatigue syndrome: a preliminary case series. BMC Neurol 9: 28. [Crossref]
- Fluge Ø, Bruland O, Risa K, Storstein A, Kristoffersen EK, et al. (2011) Benefit from B-lymphocyte depletion using the anti-CD20 antibody rituximab in chronic fatigue syndrome. A double-blind and placebo-controlled study. PLoS One 6: e26358. [Crossref]
- Fluge Ø, Risa K, Lunde S, Alme K, Rekeland IG, et al. (2015) B-lymphocyte deple-tion in Myalgic Encephalopathy/chronic fatigue syndrome. an open-label phase II study with rituximab maintenance treatment. PLoS One 10: e0129898. [Crossref]
- Mella O (2014) B-lymphocyte depletion using rituximab in chronic fatigue syndrome/ Myalgic Encephalopathy (CFS/ME). A randomized phase-III study. (RituxME). ClinicalTrials.gov Identifier: NCT02229942. [Available at: https://clinicaltrials.gov/ct2/show/NCT02229942]
- Munder T, Brütsch O, Leonhart R, Gerger H, Barth J (2013) Researcher allegiance in psychotherapy outcome research: an overview of reviews. Clin Psychol Rev 33: 501-511. [Crossref]
- Vos-Vromans DC, Huijnen IP, Rijnders LJ, Winkens B, Knottnerus JA (2016) Treatment expectations influence the outcome of multidisciplinary rehabilitation treatment in patients with CFS. J Psychosom Res 83: 40-45. [Crossref]