1 Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, the Netherlands.
2 Department of Pulmonary Disease, University Medical Center Utrecht, Utrecht, the Netherlands.
3 Department of Virology, University Medical Center Utrecht, Utrecht, the Netherlands.
Received for publication June 18, 2002; accepted for publication October 25, 2002.
![]() |
ABSTRACT |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
case-control studies; immunization; influenza; lung diseases; middle age; vaccines
Abbreviations: Abbreviations: CI, confidence interval; COPD, chronic obstructive pulmonary disease.
![]() |
INTRODUCTION |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
We determined the occurrence of respiratory and cardiac morbidity during influenza periods and the clinical effectiveness of vaccination in reducing these complications in patients aged 1864 years who had asthma or COPD by using a prospective, nested case-control design. Our observations covered the 19981999 influenza outbreak (principally type B) and the 19992000 epidemic (mainly type A (H3N2)) (15, 16). Since it is well known that influenza causes only part of the complications and that our outcome might therefore be nonspecific, as was the case in many previous reports (36), we also obtained nose and throat swabs from a sample of cases and controls to assess the relative contribution of influenza to complications.
![]() |
MATERIALS AND METHODS |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Patients eligible for inclusion in our study were selected as of October 1999 and October 2000 by means of a dedicated software module. Details on the modules stepwise selection procedures have been described elsewhere (20). Briefly, patients were identified by age and the presence of COPD, as indicated by International Classification of Primary Care diagnostic codes (R91, R95, R96), Anatomical Therapeutic Classification medical drug codes (class R03), and a tag in their computerized records indicating COPD. Next, the general practitioners were asked to verify whether the diagnosis of asthma or COPD in the preselected patients had been made in accordance with the Dutch College of General Practitioners guidelines (21). In October 1999 and October 2000, 4,241 and 5,966 eligible patients of a total of 6,011 and 8,495 study patients, respectively, preselected by using the search algorithm in the general practitioner information systems, were enrolled.
Since all data were supplied anonymously to the Julius Center for Health Sciences and Primary Care (Utrecht, the Netherlands), individual patient consent was not obtained. The Medical Ethical Board of the University Medical Center Utrecht approved the conduct of the study.
Identification of cases during the epidemics
Subjects qualified as cases if they had a primary diagnosis of an episode of fatal or nonfatal severe exacerbation of underlying lung disease, pneumonia, congestive heart failure, or myocardial infarction during either epidemic (refer to the Appendix). Case criteria were verified by using a computerized questionnaire, which was integrated in the medical records of study patients and could be activated by their general practitioners during consultation.
Annual influenza surveillance was carried out by the National Influenza Center in collaboration with the Sentinel Practice Network (15, 16). The epidemic periods were defined as the weeks in which the incidence of influenza-like illness reported by the sentinel practices was more than four per 10,000 inhabitants per week (between week 50 of 1998 and week 12 of 1999 (season one) and between week 50 of 1999 and week 10 of 2000 (season two)). During the first and largest wave of the 19981999 biphasic influenza outbreak, the influenza B-Harbin-type virus predominated, followed by a smaller wave of A(H3N2)Sydney. Clinical influenza activity during the 19992000 season was predominantly associated with influenza type A(H3N2)Sydney.
In seasons one and two, six of 60 and five of 207 cases, respectively, were deemed ineligible for the study because it was unclear whether they had asthma or COPD; therefore, these patients and their controls were excluded from further consideration. In addition, 47 and 174 patients with severe exacerbation of asthma or COPD, five and 26 patients with pneumonia, zero and one patient with congestive heart failure, and two and one patient who died, respectively, were considered eligible cases. No myocardial infarctions were recorded. In seasons one and two, eight and 16 cases, respectively, were hospitalized.
Identification of controls
Each time that a case was identified, we randomly selected four controls from the remainder of that seasons cohort, matched by age (in the same 5-year age category) and sex. Of the 1,024 controls selected from the database, 50 were excluded because either no data were available for them or the baseline diagnosis was unclear or they had died or had been lost to follow-up before the relevant epidemics occurred.
Assessment and confirmation of exposure to influenza vaccine
In the Netherlands, almost all persons receive the influenza vaccine through a primary care vaccination program (17). In both seasons, the composition of the trivalent subunit influenza vaccine complied with World Health Organization recommendations and matched well with circulating influenza A and B strains, as quantified by high hemagglutinin inhibition titer in ferret sera (15, 16). A person was assumed to have been vaccinated if his or her general practitioner retrospectively confirmed receipt of influenza vaccination by reviewing the medical records. Confirmed exposure/nonexposure to influenza vaccination within the 2 months before either epidemic was in high agreement with the absence/presence of the International Classification of Primary Care R44.1 code for vaccination (kappa = 0.93).
Measurements of covariates
Baseline demographic information, including age, sex, and health insurance coverage (private or National Health Service), was collected by using the software module (20). These data are required by health insurance companies and are therefore valid and reliable. Further detailed information was obtained on potential risk factors by review of medical records by the participating general practitioners, who were unaware of the role of these covariate assessments in relation to the primary aim of the study. We extracted information on the presence of concomitant high-risk disease and previous hospital admissions in the 12 months preceding the epidemic. In addition, influenza infection and influenza vaccination status in the previous season and chronic use of medications were registered, and the numbers of consultations in the preceding year were counted as an indicator of disease severity and use of medical services. Some of the cases and controls in the second, 19992000 season (608 of 1,012) participated in an additional questionnaire study (unpublished data). Kappa values, as a measure of agreement between patient and general practitioner information, were satisfactory for some important variables: 0.64 for the presence or absence of chronic comorbid disease, 0.54 for the presence or absence of respiratory medication use, and 0.54 for the presence or absence of previous influenza vaccination.
Virology
Six primary care centers that included 23 trained general practitioners from the Utrecht academic network (6) were asked to take nose and throat swabs from their cases and from a sample of controls for virologic assessment. Specimens were put into 4 ml of transport medium. Swabs were vortexed for 10 seconds and were centrifuged at 2,000 x g for 15 minutes. One ml of the supernatant was used directly for rapid virus culturing and antigen testing by immunofluorescence with monoclonal antibodies against influenza virus. The other material was stored at 70°C. Nested, reverse transcriptase polymerase chain reaction was carried out blindly to test for the presence of influenza A or B virus; respiratory syncytial virus; picornaviruses (rhinovirus and enterovirus); parainfluenza viruses 1, 2, and 3; and coronavirus (22).
Sample size and data analysis
Before starting the study, we estimated that a seasonal study population of 186 cases and 744 controls would give us a statistical power of more than 80 percent to detect an odds ratio of 0.6 (i.e., reduction of 40 percent allowing for nonspecificity, as observed in other studies) (35). We assumed a vaccination rate of 75 percent, a case-control ratio of 1:4, and a two-tailed level of 0.05.
We approached data analysis in two ways. First, we applied multivariate conditional logistic regression analysis for matched case-control studies to assess vaccine effectiveness independent of confounding factors. In the modeling procedure, factors that appeared to be strongly associated with both exposure to vaccination and case status were first added to the naive model that included vaccination status only. Additionally, those risk factors that substantially altered the odds ratio of vaccine effectiveness further (>5 percent) were entered in the model (23). Although it has been shown that vaccine uptake is determined by patient rather than practice or physician factors (24), we extended the analysis by matching by practice, which did not materially change the results. Since circulating viruses and vaccination components differed in the two seasons and only a minority of subjects were admitted to the study during both seasons, we pooled the observations and performed similar analyses on case and control person-periods (25). Moreover, we decided in advance to use statistical interaction terms to determine potential modification of vaccine effectiveness by age (1839, 4064 years), sex, disease (asthma or COPD), and care by a pulmonologist. Adjusted odds ratios, as approximations of relative risks, and their 95 percent confidence intervals were calculated.
Second, we applied the propensity score method, a recently introduced, powerful method of further removing "confounding by indication" (26, 27). This technique enables assessment of the association of an intervention, that is, vaccination, with outcomes in patients who have an equal probability of receiving the vaccine. Potential predictors were included in a logistic regression analysis, with vaccination as the dependent variable. The analysis was used to estimate the probability of vaccination (propensity score) for each individual patient in the full data set (256 cases, 976 controls). The fit of the model that included age and sex, health insurance, underlying disease, use of prednisolone and inhaled corticosteroids, specialist care, and cardiac and other comorbidity was appropriate (Hosmer-Lemeshow goodness-of-fit test: p = 0.41), and the models discriminative ability was moderate to good, with a value of 0.71 (95 percent confidence interval (CI): 0.68, 0.75) for the area under the receiver operating curve. In a patient-matching procedure, we searched for a vaccinated person who had a propensity score closest (within a range of 0.000.01) to that for each unvaccinated patient. Thus, in this quasi-experiment, two comparison groups that had an equal probability of vaccination were formed, and, in an analogy to the analysis of trials, cumulative incidences of complications were compared.
![]() |
RESULTS |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
|
|
|
|
|
![]() |
DISCUSSION |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Several potential limitations of our study need to be considered. A major issue in nonexperimental evaluation of vaccines is often that vaccinated and unvaccinated patients are not prognostically comparable. As expected, and as shown in the present and previous studies, vaccinees have more risk factors than nonvaccinees (46, 25, 28). This fact may have obscured a positive effect of vaccination. However, we minimized this so-called confounding by indication in both the design and data-analysis phases of the study (23). First, we admitted into the study cohorts only those patients who had current asthma or COPD. Recent studies have shown that only in a few patients registered as having asthma or COPD were the diagnoses not confirmed by spirometry (29, 30). Second, since age and sex are major confounders, we matched cases and controls for these factors. In addition, matched analysis by general practice did not change our results. Third, we had information on many potential confounders, and we adjusted for them by using conditional logistic regression. Once we had controlled for the matching factors and just three additional risk factors (previous vaccination, specialist care, and prednisolone use in the previous year), further adjustment for eight additional risk factors did not alter the estimates of vaccine effectiveness. Finally, we applied the propensity score method as an effective technique to control for confounding by indication (26, 27). Although the statistical power of the latter approach was more limited, risk factors were apparently distributed similarly in the selected vaccinated and unvaccinated subjects, and no difference was found in the incidence of outcomes. Obviously, only a large, randomized controlled trial will guarantee absence of confounding, but it is very unlikely that the observed lack of vaccine effectiveness in our nonexperimental study could be explained by residual confounding in our data.
Most studies of the effectiveness of vaccination in the elderly have been restricted to even more severe endpoints such as death or hospitalization for influenza or pneumonia, assuming that, during influenza outbreaks, the influenza is frequently a causal component of these outcomes (31, 32). However, from a societal point of view, the influenza-related needs for health care of patients of working-age are mainly limited to relatively less severe complications treated in primary care settings or at outpatient clinics (refer to the Appendix). For example, Rothbarth et al. (14) estimated that, in the Netherlands, 11 excess deaths occur in this group of half a million persons during influenza epidemics. In other words, if the vaccine could prevent 50 percent of the deaths (5), more than 100,000 patients would need to be vaccinated to prevent one death. A major strength of our study is that virologic analyses of a sample of our cases and controls showed that influenza infection was frequently associated with these complications, and we found much higher prevalences than those reported in earlier influenza studies in this age group (10, 11). Furthermore, in season one, which was predominated by influenza B types, most of the positive cases had influenza A infection. This finding accords with ours and findings from others that the incidence of cases was much lower in this season compared with the influenza A season. We were not able to verify retrospectively whether case ascertainment was complete. However, occurrence rates of pneumonia, acute cardiac disease, and death in the 19992000 influenza A season were comparable with data from a previous study in a smaller group of similar patients followed up during the 19951996 influenza A epidemic (6).
Although a positive relation between respiratory virus infections and exacerbations of asthma has been well established, the etiologic role of influenza viruses has long been underestimated. The underestimated role of influenza might mainly be due to the laboratory techniques used to detect these viruses; in recent years, polymerase chain reaction has become available for rapid diagnosis of influenza infection, considerably increasing diagnostic accuracy compared with conventional virologic analysis (22, 33).
This study is one of the largest so far reported, and it covered two types of influenza outbreaks. Although we had limited power to detect a clinically important reduction of at least 40 percent in the first season, in the second season, and in pooled data from the two seasons combined, including 256 case person-periods and 976 control person-periods provided enough power to estimate an even smaller reduction of 35 percent. Since more than 500,000 working-age patients with asthma or COPD are currently indicated for influenza vaccination at a cost of 7 million euros (approximately $13 million) annually, we are convinced that, from a cost-effectiveness point of view, lower than 35 percent reductions in severe outcomes as a result of vaccination do not justify such a costly, large-scale campaign. Other less severe endpoints such as productivity loss or minor exacerbations might be reduced by vaccination, although it is unlikely in light of our results. However, from a public health perspective, such possible benefits might also not justify this preventive program.
Our finding of a lack of benefit from influenza vaccination in respiratory patients of working-age corroborates some earlier observations. For example, Paul et al. (34) observed no reduction in acute respiratory illness in a small subset of vaccinated high-risk patients less than 65 years of age during the 19851986 influenza epidemic. Stenius-Aarniala et al. (35) also found no protective effect of the vaccine in reducing asthma exacerbations in a randomized controlled trial among asthmatics, although influenza activity during the follow-up period was low. Wiselka et al. (36) conducted a general practitioner-based study among more than 500 adult asthmatics and found that influenza vaccination was not associated with any substantial reduction in either asthma exacerbations or severity of symptoms.
These observations seem counterintuitive in the face of the beneficial effects of conventional influenza vaccination in high-risk children and the elderly, and they do not support international recommendations to immunize working-age patients with asthma or COPD against influenza (18). Although the occurrence of endpoints was twice as high in COPD patients compared with asthmatics in our study, the vaccine did not reduce the incidence of endpoints in either group. It is still unclear why the vaccine is clinically not effective in both patient groups less than age 65 years. One possible explanation could be that virus-induced allergy and hyperreactivity as precipitating factors may be a much more significant pathologic mechanism in adults than in young children and the elderly (11, 37, 38). If this explanation is true, preventive measures other than vaccination against influenza, such as self-management programs aimed at reducing the number and severity of exacerbations of asthma or COPD, may have a larger impact on the influenza-related health burden in this particular group of high-risk patients than does annual influenza vaccination.
![]() |
ACKNOWLEDGMENTS |
---|
The participation of the general practitioners in data collection is gratefully acknowledged. The authors are indebted to F. Leffers for technical assistance. They also thank Dr. M. Nijhuis and L. van Elden for the virologic analyses.
![]() |
APPENDIX |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
|
![]() |
NOTES |
---|
![]() |
REFERENCES |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|