Copyright ©ERS Journals Ltd 2004 Inhaled steroids and mortality in COPD: bias from unaccounted immortal timeDivision of Clinical Epidemiology, Royal Victoria Hospital, McGill University Health Centre, and the Depts of Epidemiology and Biostatistics and of Medicine, McGill University, Montreal, Canada CORRESPONDENCE: S. Suissa, Division of Clinical Epidemiology, Royal Victoria Hospital, 687 Pine Avenue West, Ross 4.29, Montreal, Canada, H3A 1A1. Fax: 1 5148431493. E-mail: samy.suissa@clinepi.mcgill.ca Keywords: biases, cohort studies, drug effectiveness, epidemiology, immortal time, pharmacoepidemiology
Received: June 3, 2003
This research was funded by grants from the Canadian Institutes of Health Research (CIHR) and Fonds de la recherche en Santé du Québec (FRSQ). The acquisition of the database was funded by grants from AstraZeneca, Boehringer Ingelheim and GlaxoSmithKline. The author is the recipient of a Distinguished Investigator award from the CIHR. This study is based on de-identified data provided by the Saskatchewan Dept of Health. The interpretation and conclusions contained herein do not necessarily represent those of the government of Saskatchewan or the Saskatchewan Dept of Health.
A recent observational study, which suggested that inhaled corticosteroids (ICS) with or without long-acting bronchodilators are effective at reducing all-cause mortality in chronic obstructive pulmonary disease (COPD) patients, may be subject to immortal time bias. This bias was assessed using a population-based cohort of 3,524 newly treated COPD patients from Saskatchewan, Canada, observed from 19901999. Regular users of bronchodilators or ICS were followed for 3 yrs, during which time 860 deaths occurred. Cox's proportional hazards model was used to compare the hierarchical intention-to-treat approach employed in the recent study, a technique subject to bias from two sources of immortal time, with the conventional intention-to-treat approach and the according-to-treatment approach. The adjusted rate ratio of death using the hierarchical intention-to-treat approach was 0.66 (95% confidence interval (CI) 0.570.76) for ICS use relative to bronchodilator use, compared with 0.75 (95% CI 0.620.90) with the conventional intention-to-treat approach. Conversely, the rate ratio was 0.94 (95% CI 0.811.09) with the according-to-treatment approach, which accounts for both sources of immortal time. In this study, regular inhaled corticosteroid use in chronic obstructive pulmonary disease was not found to reduce all-cause mortality. Suggestion of this benefit from a previous observational study is the result of bias from unaccounted immortal time in its cohort design and analysis. The use of inhaled corticosteroids (ICS) in the treatment of chronic obstructive pulmonary disease (COPD) is highly debated, with important divergence in the data from randomised trials and observational studies 1. Recent randomised trials have found that ICS treatment confers little or no benefit on lung function 27. Although not part of the primary objective, two of these studies found a reduction in exacerbations or healthcare resource use among patients with moderate 7 or severe COPD 6. Conversely, four recent observational studies have suggested that these drugs are extremely effective at preventing COPD morbidity and mortality. Three of the observational studies, using an identical design, evaluated ICS dispensed after hospital discharge for COPD and found them to be very effective at preventing COPD morbidity and mortality 810. The cohort design employed by these studies defined time zero (date of hospital discharge) independently of ICS exposure and used an intention-to-treat analysis. However, the current author has shown that this approach can lead to an important bias resulting from the introduction of immortal time and its misclassification with respect to exposure 11. The study was replicated, using a different cohort of COPD patients, and a rate ratio (RR) of 0.69 was found for ICS, subject to bias. The RR became 1.00 when these sources of bias were properly attended to 11. The fourth observational study used a different cohort design that appears to have accounted for immortal time 12. This cohort study found that regular ICS use, given to newly diagnosed COPD patients, not necessarily after COPD hospitalisation, reduced the rate of all-cause mortality by 3852% 12. Unlike the other observational studies, however, time zero for cohort entry was defined by ICS exposure and the exposure was defined hierarchically. As a result of these definitions, it can be hypothesised that this study, using the intention-to-treat approach, also generated immortal time that was unaccounted for and that may have biased the findings. In the present paper, it is shown that the intention-to-treat method used by this recently published study, by its approach to cohort formation and hierarchical exposure definition, introduces a bias involving immortal time that leads to significant distortion of the results. The nature of the bias is described and illustrated, and its impact is assessed using data from another population-based cohort of patients with COPD.
Source of data The source population of COPD patients was identified using the computerised databases of Saskatchewan Health (Saskatchewan, Canada). These databases were developed as a result of the universal health insurance programme provided to all residents of this Canadian province since 1975 13. The base cohort, which has been previously described in more detail, was formed from all subjects newly treated for COPD in this population 11, 14, 15. They were identified by having been dispensed three or more prescriptions on at least two different dates for a bronchodilator (short-acting ß2-agonist (SABA), inhaled anticholinergic or theophylline) within a 1-yr period between January 1, 1990 and December 31, 1997. Cohort entry was the date of the third prescription, at which point subjects were 55 yrs of age. Subjects with any prescriptions for bronchodilators or other asthma drugs, including ICS, nasal corticosteroids, cromones (cromoglycate and nedocromil) and ketotifen, during the 5-yr period prior to cohort entry, were excluded. The cohort members were followed until December 31, 1999.
Study cohort As defined in the previous published study, regular treatment was taken to be the first dispensing of three or more prescriptions of ICS (in this study beclomethasone, fluticasone or budesonide) or three or more prescriptions of a bronchodilator from any one of the following classes: inhaled SABA, inhaled anticholinergics, xanthines or combined bronchodilators within a 6-month period. Long-acting ß-agonist use was ignored as it was too infrequent among cohort members. All subjects were then assumed to remain regular users of either bronchodilators or ICS until the end of follow-up, namely until the date of death, the date of emigration from the province, the date of end of coverage of the health insurance plan or December 31, 1999, whichever occurred first.
Outcome
Exposure
To assess this bias, two alternative approaches of classifying exposure were considered. First, a conventional intention-to-treat approach was employed, based on the very first regular exposure identified after diagnosis. Using this method, regular users of bronchodilators were classified into the reference group even if they subsequently started regular ICS use. As a convention, subjects who became regular users of both ICS and bronchodilators on the same day were classified into the ICS group. Using this intent-to-treat approach, subjects remain classified in their exposure group until the end of follow-up. Secondly, an according-to-treatment approach was used, based on the actual exposure. Here, regular users of bronchodilators are classified into the reference group prior to starting regular ICS exposure, but only until they start ICS exposure. At that point, their person-time is classified into the ICS group until the end of follow-up. Another source of immortal time arises from the definition of time zero. The recently published study used the date of the first of the three exposure-defining prescriptions within a 6-month period. The time span between the first and the third prescription is also immortal, as the subject must survive from the first to the third prescription to satisfy the definition of regular use. To avoid this bias, time zero should be defined as the date of the third of the three prescriptions. This alternative definition was used in the following analyses.
Data analysis With respect to the definition of time zero, the time span between the first and third prescriptions defining time zero was first compared separately for bronchodilators and ICS, to verify if it differed for the two exposures. This alternative definition of time zero, namely the date of the third prescription instead of the first, was then used to estimate the crude and adjusted RRs for the three different approaches.
The cohort included 5,645 subjects newly treated for COPD between 19901999, of which 3,682 subjects became regular users of bronchodilators or ICS at some point during follow-up. There were 1,738 subjects who were regular users of a bronchodilator and 951 regular users of ICS throughout the follow-up. There were also 993 subjects who were first regular users of a bronchodilator and in time became regular users of ICS. Table 1
Table 2
Table 3 83.5 person-yrs between the ICS and bronchodilator groups.
Table 4
In this study, a subtle but important bias was identified in the recently published observational study that suggested that regular ICS use with or without a long-acting bronchodilator is effective at reducing all-cause mortality in COPD patients. The study design, which bases its analysis on a hierarchical intention-to-treat approach to define the exposure groups, is biased from unaccounted immortal time. Using a comparable cohort of COPD patients identified from another database, from which the biased analysis was accurately reproduced, the current authors showed that the bias is sufficiently important that it rendered the significant effect nonsignificant. With the biased approach, it was found that the adjusted estimate of the RR of death for regular ICS use relative to regular bronchodilator use was 0.66 (95% CI 0.570.76). After accounting for the two sources of immortal time bias introduced by this approach, the RR became 0.94 (95% CI 0.811.09).
The bias results from overlooking two sources of immortal time. The bias is first introduced in the hierarchical definition of exposure. From a cohort of all newly diagnosed COPD patients, the hierarchy of exposure first assessed subjects from the date of diagnosis to the end of follow-up to identify the exposed, namely those who received three or more prescriptions of fluticasone proportionate or salmeterol during a 6-month period. The unexposed reference group is then defined by the subjects who did not receive any fluticasone proportionate or salmeterol during follow-up, but received three or more prescriptions of a short-acting bronchodilator during a 6-month period. Consequently, a large number of exposed subjects could have used short-acting bronchodilators prior to their start of fluticasone proportionate or salmeterol, as confirmed in table 1 The previously published study focussed on fluticasone and salmeterol, suggesting that the combination is more effective than either drug, which are, in turn, more effective than short-acting bronchodilators alone. In this context, the hierarchical approach will accentuate the bias, as subjects receiving the combination could have first been exposed to short-acting bronchodilators, the reference, then to the long-acting bronchodilator or the ICS, before eventually being dispensed the latter two together during the same 6-month period. All immortal time spent in the reference exposure, as well as in the individual long-acting bronchodilator and ICS exposures, are not accounted for in the analysis. The present analysis suggests that the bias from unaccounted immortal time bias resulting from the hierarchical approach will lead to a hierarchy of effects. The second source of immortal time arises from selecting time zero as the time of the first of the three prescriptions that define exposure. The time from the first to the third prescription is also immortal, as the subjects must have three prescriptions to satisfy the definition of regular use and are not included in the study if they die after the first or second. To avoid this bias, time zero should be defined as the date of the third of the three prescriptions, as has been done in previous similar studies of asthma and COPD 14, 17. The analysis of the present COPD cohort indicates that accounting for this second source of immortal time changes the biased RR from 0.66 to 0.71 and the RR corrected for the first source of immortal time from 0.85 to 0.94. In essence, the two sources of immortal time turn out to have an important impact on the RR of death for ICS use, changing it from a highly significant 0.66 (95% CI 0.570.76) to a nonsignificant 0.94 (95% CI 0.811.09). The observational study presented here is also subject to the usual biases. ICS are expected to be prescribed to patients with more severe disease, who are at higher risk of death. Thus, the finding of a RR of 0.94 for ICS, even after adjustment for several confounding factors, may in fact suggest a modest benefit that must be investigated in large randomised trials. The diagnosis of COPD, from administrative databases, was only based on age and bronchodilator use. In the absence of information on smoking, symptoms and spirometry measures, subjects in the cohorts may have been misclassified as COPD. The unintended, yet possible, inclusion of asthma patients as COPD by these administrative criteria could lead to an apparent but fallacious beneficial effect of ICS in COPD. In addition, exposure was crudely defined to be consistent with the previously published cohort study 12. Once a subject was allocated to an exposure group, they remained there and were considered exposed to that drug category until the end of follow-up, irrespective of whether they stopped or continued for the entire 3-yr follow-up. This assumption will produce exposure misclassification that tends to attenuate the RR towards unity. As chronic obstructive pulmonary disease is one of the major causes of death, and as both mortality and morbidity due to chronic obstructive pulmonary disease have increased over the last two decades, the clinical implications of this observational study are important 18, 19. While observational studies are a valuable addition to randomised controlled trials to demonstrate treatment effectiveness, they must be properly conducted to minimise bias 20. Care must be taken in evaluating cohort studies with a hierarchical approach to exposure definition, as they can be subject to biases from unaccounted immortal time. This bias can give the false appearance of an important drug benefit, as can be seen with the apparent effectiveness of combination therapy with fluticasone and salmeterol to reduce mortality in chronic obstructive pulmonary disease. Randomised controlled trials are essential to verify whether these drugs, alone or in combination, are beneficial in chronic obstructive pulmonary disease. The important bias identified in this study, implies that the effectiveness of inhaled corticosteroids in chronic obstructive pulmonary disease remains debatable 21, 22.
The author would like to thank P. Ernst for helpful discussions and comments.
This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||