a Department of Epidemiology and Public Health, The Medical School, University of Newcastle upon Tyne, Newcastle NE2 4HH, UK.
b Department of Public Health Sciences, University of Edinburgh, Edinburgh EH8 9AG, UK.
c Department of Diabetes, The Medical School, University of Newcastle upon Tyne, Newcastle NE2 4HH, UK.
Dr Colin M Fischbacher, Department of Epidemiology and Public Health, The Medical School, University of Newcastle, Newcastle upon Tyne NE2 4HH, UK. E-mail: c.m.fischbacher{at}ncl.ac.uk
Abstract
Background The Rose angina questionnaire has been extensively used in different cultural settings, but may not perform consistently in different ethnic groups. We set out to assess the performance of the Rose angina questionnaire in UK South Asians compared with Europeans.
Methods Data on major ECG abnormalities, possible or definite Rose questionnaire angina and diagnosed angina were collected from an age- and sex-stratified random sample of 1509 adults from European, Indian, Pakistani and Bangladeshi ethnic groups.
Results The ECG abnormalities were commoner in South Asians than Europeans (6% versus 2% in men). The prevalence in both South Asian and European men of possible Rose angina and diagnosed angina was 18% and 8%, respectively, but definite Rose angina was less common in South Asians (3% versus 6%). Definite Rose angina showed lower sensitivity for other measures in South Asians than in Europeans: sensitivity for a doctor's diagnosis was 21% in South Asian and 37% in European men. For possible Rose angina, the corresponding figures were 81% and 84%. Similar patterns were seen in women.
Conclusions The performance of the Rose angina questionnaire was sufficiently inconsistent to warrant further work to achieve greater cross-cultural validity. Possible Rose angina performed more consistently across ethnic groups than definite Rose angina and pending further validation studies may be the most appropriate form to use.
Keywords Angina pectoris, ethnic minorities, test performance, questionnaire, ischaemic heart disease, chest pain
Accepted 15 June 2001
The Rose questionnaire (RQ) was introduced in 1962 as a standardized method of measuring angina and myocardial infarction in population surveys (Appendix). It defines angina as chest pain that limits exertion, is situated over the sternum or in the left chest and left arm, and is relieved within 10 minutes by rest.1 The diagnosis of angina on RQ predicts morbidity and mortality in European populations independently of other clinical findings,2345 and measures the burden of disease. The RQ has been widely used in its original and modified forms,6 and in translation78910 to study the prevalence and natural history of ischaemic heart disease,7891011121314 response to interventions,15 and to make population comparisons.1617
There is no agreed gold standard which can be used to validate RQ measures of angina but studies have used expert clinical diagnosis,1218192021 ECG findings,222324 exercise thallium scans2526 and coronary angiography.9 Clearly without such a standard the terms sensitivity and specificity need to be used with caution. Validation studies have generally reported high specificity (8095%) but variable sensitivity (1983%). There is evidence that the RQ is less valid in women.2728 Most validation studies have used the traditional RQ definition of angina. However, there is evidence from population-based studies52329 that exertional chest pain alone (RQP, P for possible) has a similar prognosis to definite RQ angina (RQD).
Almost all validation studies of the RQ have been performed in European or North American white ethnic groups, the exceptions being a study including Americans of Japanese descent20 and two that included both black and white US residents.2430 Only one study31 has assessed the Rose questionnaire in a population of UK South Asians (of mainly Punjabi ethnic origin). This study, by Patel et al., suggested that the questionnaire was inaccurate in South Asians because of its weak agreement with the respondents' history of cardiac disease and the assessment of a clinician. A comparison group was not included, so the question of whether the performance of the questionnaire was worse than in European populations could not be assessed. The cross-cultural performance of the RQ is important because coronary heart disease (CHD) is a major cause of morbidity32 and the leading cause of mortality33 in UK residents of South Asian ethnic origin, and several UK studies have used the RQ to report the prevalence of angina in South Asians343536 (though there are no studies linking it to outcomes).
We used data from the Newcastle Heart Project to study the comparative performance of the RQ in three South-Asian groups and a European ethnic group. In order to establish whether the RQ performed equally well in Europeans and South Asians, we tested the hypothesis that compared with diagnosed angina and ECG changes the RQ provided similar sensitivity and specificity, similar levels of agreement with these measures, and similar ethnic rankings of prevalence.
Methods
Interviews and ECG data
The Newcastle Heart Project is a cross-sectional study of a population sample of 1509 Newcastle residents of European (n = 825), Indian (n = 259), Pakistani (n = 305) and Bangladeshi (n = 120) ethnic origin. Full details of the methods have been published.36 Europeans were screened between April 1993 and October 1994 and South Asians between May 1995 and March 1997. The response rate was 67% for South Asians and 64% for Europeans. Local ethical committee approval was obtained and all participants gave informed consent. Clinical data included ECG, biochemical, anthropometric and cardiovascular measures. A questionnaire (covering lifestyle and cardiovascular risk factors) was first translated into Hindi, Punjabi, Urdu and Bengali and then back-translated into English. Researchers conferred with translators and back-translators until agreement on translation was reached. South Asians were interviewed in the subject's home and in their preferred language by interviewers of their own ethnic group and gender. European respondents self-completed the questionnaire while attending for screening.
Respondents completed the standard WHO Rose questionnaire (RQ)37 and were asked whether a doctor had ever told them that they had angina. Those who fulfilled all the Rose criteria were classified as having definite RQ angina (RQD). Exertional chest pain (with or without other Rose criteria) was defined as possible RQ angina (RQP).
Resting 12-lead ECG were Minnesota coded38 by two trained and independent coders, and discrepant reports were resolved with a third independent coder. Probable CHD was defined as Minnesota coding 1.11.2 (large Q and QS waves) and possible CHD as Minnesota coding 1.3 (small Q and QS), 4.14.4 (ST-T depression), 5.15.3 (flattened or inverted T waves) or 7.1.1 (complete left bundle branch block).
Statistical methods
Prevalences were directly age standardized to the 1991 England and Wales population using Stata 7 (Stata Corporation, College Station, TX). Agreement between measures was estimated using Cohen's kappa statistic, which takes the value one when there is perfect agreement and zero when there is no agreement beyond that observed by chance. We used a chi squared test for heterogeneity (2 HE) described by Donner39 to test for differences by ethnic group and gender in the extent of agreement of Rose questionnaire findings with other measures. We used a test for the difference in two proportions to compare sensitivity and specificity.
In recognition of the heterogeneity within the South-Asian groups we present data on Indians, Pakistanis and Bangladeshis separately while focusing on the comparison of Europeans and South Asians.
Results
Prevalence of measures of ischaemic heart disease
The prevalence of diagnosed angina was the same in European and South-Asian men, although lower in Indian than in Pakistani and Bangladeshi men (Table 1). Abnormal ECG findings were commoner in South-Asian than in European men, particularly those showing major Q waves suggestive of probable CHD. The prevalence of RQP angina in South-Asian men was the same as in European men, but lower in Indians and Pakistanis compared to Bangladeshis. The prevalence of RQD angina, in contrast, was lower in South-Asian than in European men. The prevalence was similar in Indians, Pakistanis and Bangladeshis.
|
While RQP angina was about three times as common as RQD in Europeans (men and women) it was six times as common in South Asians.
Agreement between measures
Table 2 shows respondents who reported RQD (versus all those who did not fulfil RQD criteria) and those reporting RQP (versus those who did not fulfil RQP criteria) by recall of a doctor's diagnosis of angina. It shows that agreement (measured by kappa) between RQD and RQP and a doctor's diagnosis of angina was similar in South-Asian and European men.
|
Among women, sensitivity using RQD was also lower in South Asians than Europeans, but for RQP, sensitivity was similar. Specificity was lower in South Asians than Europeans. The ethnic differences in sensitivity and specificity were generally smaller with RQP than with the RQD, the most significant being the ethnic difference in specificity in women (P = 0.05). In relation to doctor's diagnosis, differences in kappa between Europeans and South Asians in both sexes combined were of marginal significance (P = 0.065 for RQD and P = 0.096 for RQP) but combining both ethnic groups kappa was lower in women (P = 0.007 for RQD, P = 0.0005 for RQP).
Table 3 shows that agreement between RQD and ECG abnormalities was similar in South Asian and European men. Specificity was slightly higher, but sensitivity was lower. For RQP, agreement, sensitivity and specificity were higher in South-Asian men.
|
Components of the Rose questionnaire
Table 4 shows that among male respondents with exertional chest pain (RQP) the RQ questions least likely to receive a positive RQ response were those relating to site (among Europeans, Indians and Pakistanis) and related to relief of pain within 10 minutes of rest (particularly among Bangladeshis).
|
Figure 1 shows that in European, Indian and Pakistani men the site of chest pain made the largest contribution to the difference between definite and possible Rose angina. In Bangladeshi men relief of pain by rest and relief within 10 minutes of rest also contributed to the difference. Site was the most important contributor to the difference between RQD and RQP in women but relief of pain by rest and relief within 10 minutes also contributed substantially among Pakistani and Bangladeshi women. P-values less than 0.05 for comparisons with the European reference group are shown in the Figure.
|
|
Study strengths and limitations
This is a study of a representative population sample. The response rate was similar across ethnic groups and acceptably high. The survey was developed in close consultation with the community by researchers familiar with the relevant cultures and languages; it used standardized methods, interviewers from the same ethnic group and gender as the respondents, and (for South Asians) face-to-face interviews conducted in the preferred language of interviewees. Europeans completed the questionnaire themselves because we did not have the resources to interview them in the absence of a clear need. Self-completion has been associated with more frequent positive responses, but without differences in the associations with abnormal ECG findings or subsequent coronary mortality.37 This weakness in our study design, moreover, cannot explain differences between Indians, Pakistanis and Bangladeshis.
Comparative performance of the Rose questionnaire
Comparing RQ with ECG findings has evident limitations, e.g. angina, may show no abnormalities on a resting ECG, while diagnosed angina, though based on questions similar to the RQ, is influenced by access to health care and diagnostic practices. Complete agreement between these measures and RQ would be neither expected nor desirable. Our results show that the RQ's known low sensitivity for, and agreement with, ECG and diagnosed angina in Europeans, also applies in South-Asian populations. The RQ performs less well in European women, and the same seems to be true for South-Asian women. In this respect the criticisms of the RQ of Patel et al. are substantiated by our data.
The differences between ethnic groups in the performance of the RQ should be interpreted with caution, for reasons discussed above and since the low power of the study means that the performance measures in different ethnic groups had wide and overlapping confidence intervals. Overall RQD performed less consistently than RQP, the latter being considerably more sensitive than RQD, though less specific. The inter-ethnic differences for RQP were much smaller than those seen with the RQD. While RQP, diagnosed angina and ECG abnormalities all suggested that South-Asian men had a similar or higher prevalence of angina than European men, RQD suggested that angina was less prevalent. Similarly, in women all the measures except RQD suggested a higher prevalence of angina in South Asians than Europeans. Although the small numbers in individual ethnic groups do not allow firm conclusions to be drawn, RQD also gave lower estimates relative to other measures in Pakistanis and Bangladeshis than in Indians. While Patel et al.'s criticisms are correct, our analysis shows that the RQP performs as well (compared to ECG changes and diagnosed angina) in South Asians as in Europeans.
Site of pain in respondents reporting exertional chest pain
The anatomical location of pain was more variable in South Asians than in Europeans, and classical elements of the history such as left arm pain were less frequent than in Europeans, while atypical features such as right-sided chest pain were more common in Pakistanis and Bangladeshis. Bangladeshis with chest pain mostly failed to report the other features required for RQD. Few South Asians reported that particular combination of left chest and left arm pain required to fulfil the RQD definition. Our data raise the possibility of systematic differences between ethnic groups in the site of reported chest pain. However, given the small number of cases and the fact that ethnic differences in site of reporting were not statistically significant, firm conclusions must await confirmation from further studies.
Explanations for inter-ethnic differences
The lack of power of the study to estimate differences precisely means that chance is a possible explanation, though the general consistency of findings in both sexes and using different measures argues against this. Despite the fact that the questionnaire was back-translated and checked, and respondents interviewed in their own language, the translations are not likely to be culturally equivalent. Chest pain may be experienced, understood, interpreted and described differently in different cultures.40 The variations may reflect problems with the way those questions were translated, with differing interpretations of symptoms, or with differing pathophysiological processes. Educational and socioeconomic factors may influence the way chest pain is reported; more South Asians than Europeans had had only primary education (36% versus 17%) but more had had further education (33% versus 23%). Studies to develop a cross-culturally compatible version of the RQ for South Asian and Chinese populations are underway in Edinburgh University.
Conclusion
In comparison with ECG and diagnosed angina the RQD performs differently in South Asians than in Europeans, but the RQP performs similarly. In Europeans RQP has been shown to be as discriminating as RQD in prognostic terms;52329 and though this remains to be demonstrated in South Asians, RQP is presently the preferred measure of angina in comparative studies involving this population, since it is simpler to translate and administer and gives more consistent results.
Appendix
Criteria for Rose angina questionnaire
1. Have you ever had any pain or discomfort in your chest?
2. Do you get it when you walk uphill or hurry?
3. Do you get it when you walk at an ordinary pace on the level?
4. What do you do if you get it while you are walking?
5. If you are standing still, what happens to it?
6. How soon?
7. Will you show me where it is?
Angina is defined as being present in subjects who answer as follows: Q1: yes; Q2 or Q3: yes; Q4: stop or slow down; Q5: relieved; Q6: 10 minutes or less; Q7: either (a) sternum (upper or middle or lower) or (b) left anterior chest and left arm.
Please note, because of the correction of minor coding errors, some of the figures in this paper differ slightly from those previously given in reference 36.
KEY MESSAGES
|
Acknowledgments
Funding: Barclay Trust, British Diabetic Association, Newcastle Health Authority, research and development directorate of the Northern Regional Health Authority, Department of Health, and British Heart Foundation. We thank Margaret Miller, Mavis Brown, Amanda McEwan, Heather Armstrong, Afroz Qureshi, Ayesha Motala, Kaushik Ramaiya and Dilip Singh for help at the screening sessions; Peter Stevenson for both screening and analysis of electrocardiograms; Nan Keen for coding electrocardiograms; Louise Walker for help with data preparation and analysis; Julie Yallop for managing the recruitment and screening for the South Asian study; Jane Harland for contributing to the design of the European study and Lisa Hanna and Salma Ayis for helpful comments.
References
1 Rose G. The diagnosis of ischaemic heart pain and intermittent claudication in field surveys. Bull World Health Organ 1962;27:64558.[ISI][Medline]
2 Cederlof R, Jonsson E, Lundman T, Stockholm M. On the validity of mailed questionnaires in diagnosing angina pectoris and bronchitis. Arch Environ Health 1966;13:73842.[ISI][Medline]
3 Krueger D, Rogot E, Blackwelder W, Reid D. The predictive value of a postal questionnaire on cardio-respiratory symptoms. J Chron Dis 1970;23:41121.[ISI][Medline]
4 Rose G, Hamilton P, Keen H, Reid D, McCartney P, Jarrett R. Myocardial ischaemia, risk factors and death from coronary heart disease. Lancet1977;i:10509.
5
Lampe F, Whincup P, Wannamethee S, Ebrahim S, Walker M, Shaper A. Chest pain on questionnaire and prediction of major ischaemic heart disease events in men. Eur Heart J 1998;19:6373.
6 Zeiner-Henricksen T. Cardiovascular disease symptoms in Norwaya study of prevalence and a mortality follow-up. J Chron Dis 1971;24: 55367.[ISI][Medline]
7 Raman Kutty V, Balakrishnan K, Jayasree A, Thomas J. Prevalence of coronary heart disease in the rural population of Thiruvananthapuram district, Kerala, India. Int J Cardiol 1993;39:5970.[ISI][Medline]
8 Singh R, Sharma J, Rastogi V et al. Prevalence of coronary artery disease and coronary risk factors in rural and urban populations of north India. Eur Heart J 1997;18:172835.[Abstract]
9 Erikssen J, Forfang K, Storstein O. Angina pectoris in presumably healthy middle aged men. Eur J Cardiol 1977;6:28598.[ISI][Medline]
10 Krogh V, Trevisan M, Panico S, Farinaro E, Mancini M, Menotti A. Prevalence and correlates of angina pectoris in the Italian nine communities study. Epidemiology 1991;2:2632.[Medline]
11 Bainton D, Baker I, Sweetnam P, Yarnell J, Elwood P. Prevalence of ischaemic heart disease: the Caerphilly and Speedwell surveys. Br Heart J 1988;59:20106.[Abstract]
12 Reeder B, Liu L, Horlick L. Sociodemographic variation in the prevalence of cardiovascular disease in Saskatchewan: results from the Saskatchewan Heart Health Survey. Can J Cardiol 1996;12:27177.[ISI][Medline]
13 Netterstrom B, Laursen P. Incidence and prevalence of ischaemic heart disease among urban bus drivers in Copenhagen. Scand J Soc Med 1981;9:7579.[ISI][Medline]
14 Rossouw J, Weich H, Steyn K, Kotze J, Kotze T. The prevalence of ischaemic heart disease in three rural South African communities. J Chronic Dis 1984;37:97106.[ISI][Medline]
15 Reid D, Brett G, Hamilton P, Jarrett R, Keen H, Rose G. Cardiorespiratory disease and diabetes among middle aged civil servants. A study of screening and intervention. Lancet1974;i:46973.
16 Marmot MG, Syme SL, Kagan A, Kato H, Cohen JB, Belsky J. Epidemiologic studies of coronary heart disease and stroke in Japanese men living in Japan, Hawaii and California: prevalence of coronary and hypertensive heart disease and associated risk factors. Am J Epidemiol 1975;102:51425.[Abstract]
17 Rose GA, Ahmeteli M, Checcacci L et al. Ischaemic heart disease in middle-aged men. Prevalence comparisons in Europe. Bull World Health Organ 1968;38:88595.[ISI][Medline]
18 Heyden S, Bartel A, Tabesh E et al. Angina pectoris and the Rose questionnaire. Arch Intern Med 1971;128:96164.[ISI][Medline]
19 Friedman L, Byington R, the Beta Blocker Heart Attack Trial Research Group. Assessment of angina pectoris after myocardial infarction: comparison of Rose questionnaire with physician judgment in the beta-blocker heart attack trial. Am J Epidemiol 1985;121:55562.[Abstract]
20 Blackwelder W, Kagan A, Gordon T, Rhoads G. Comparison of methods for diagnosing angina pectoris: the Honolulu heart study. Int J Epidemiol 1981;10:21115.[Abstract]
21 Lundman T, Liljefors I, Cederlof R, Friberg L. The validity of the questionnaire diagnosis. Angina pectoris. Arch Environ Health 1971;22:59799.[ISI][Medline]
22 Wilcosky T, Harris R, Weissfeld L. The prevalence and correlates of Rose questionnaire angina among women and men in the lipid research clinics program prevalence study population. Am J Epidemiol 1987; 125:40009.[Abstract]
23 Cook D, Shaper A, MacFarlane P. Using the WHO (Rose) angina questionnaire in cardiovascular epidemiology. Int J Epidemiol 1989;18: 60713.[Abstract]
24 Smith K, McGraw S, Crawford S, McKinlay J. Do blacks and whites differ in reporting Rose questionnaire angina? Results of the Boston Health Care Project. Ethnicity and Disease 1993;3:27889.[Medline]
25 Bass E, Follansbee W, Orchard T. Comparison of a supplemented Rose questionnaire to exercise thallium testing in men and women. J Clin Epidemiol 1989;42:38594.[ISI][Medline]
26 Garber C, Carleton R, Heller G. Comparison of Rose questionnaire angina to exercise thallium scintigraphy: different findings in males and females. J Clin Epidemiol 1992;45:71520.[ISI][Medline]
27 Harris R, Weissfeld L. Gender differences in the reliability of reporting symptoms of angina pectoris. J Clin Epidemiol 1991;44:107178.[ISI][Medline]
28 Nicholson A, White I, Macfarlane P, Brunner E, Marmot M. Rose questionnaire angina in younger men and women: gender differences in the relationship to cardiovascular risk factors and other reported symptoms. J Clin Epidemiol 1999;52:33746.[ISI][Medline]
29 LaCroix A, Guralnik J, Curb D, Wallace R, Ostfeld A, Hennekens C. Chest pain and coronary heart disease mortality among older men and women in three communities. Circulation 1990;81:43746.[Abstract]
30 Sorlie P, Cooper L, Schreiner P, Rosamond W, Szklo M. Repeatability and validity of the Rose questionnaire for angina pectoris in the atherosclerosis risk in communities study. J Clin Epidemiol 1996;49: 71925.[ISI][Medline]
31 Patel D, Winterbotham M, Sutherland S, Britt R, Keil J, Sutton G. Comparison of methods to assess coronary heart disease prevalence in South Asians. Natl Med J India 1997;10(5):21013.[ISI][Medline]
32 Nazroo J. The Health of Britain's Ethnic Minorities. London: Policy Studies Institute, 1997.
33
Wild S, McKeigue P. Cross sectional analysis of mortality by country of birth in England and Wales, 197092. Br Med J 1997;314:70510.
34 McKeigue PM, Ferrie JE, Pierpoint T, Marmot MG. Association of early-onset conronary heart disease in South Asian men with glucose intolerance and hyperinsulinemia. Circulation 1993;87:15261.[Abstract]
35 Williams R, Bhopal R, Hunt K. The health of a Punjabi ethnic minority in Glasgow: a comparison with the general population. J Epidemiol Community Health 1993;47:96102.[Abstract]
36
Bhopal R, Unwin N, White M et al. Heterogeneity of coronary heart disease risk factors in Indian, Pakistani, Bangladeshi and European origin populations: cross sectional study. Br Med J 1999;319:21520.
37 Rose G, McCartney P, Reid D. Self administration of a questionnaire on chest pain and intermittent claudication. Br J Prev Soc Med 1977; 31:4248.[ISI][Medline]
38 Prineas R, Crow R, Blackburn H. The Minnesota Code Manual of Electrocardiographic Findings. London: John Wright, 1982.
39 Donner A, Klar N. The statistical analysis of kappa statistics in multiple samples. J Clin Epidemiol 1996;49:105358.[ISI][Medline]
40 Chaturvedi N, Rai H, Ben-Shlomo Y. Lay diagnosis and health-care-seeking behaviour for chest pain in south Asians and Europeans. Lancet 1997;350:157883.[ISI][Medline]