Application of the Method of Triads to Evaluate the Performance of Food Frequency Questionnaires and Biomarkers as Indicators of Long-term Dietary Intake

Edmond K. Kabagambe1, Ana Baylin1, Damon A. Allan1, Xinia Siles2, Donna Spiegelman3,4 and Hannia Campos1,2

1 Department of Nutrition, Harvard School of Public Health, Harvard University, Boston, MA.
2 Salud Coronaria, Instituto de Investigaciones en Salud, Universidad de Costa Rica, San Pedro, Costa Rica.
3 Department of Epidemiology, Harvard School of Public Health, Harvard University, Boston, MA.
4 Department of Biostatistics, Harvard School of Public Health, Harvard University, Boston, MA.

ABSTRACT

Little is documented about the performance of the food frequency questionnaire (FFQ) in US minority groups and in populations in developing countries. The authors applied a novel technique, the method of triads, to assess the validity and reproducibility of the FFQ among Hispanics. The subjects were men (n = 78) and women (n = 42) living in Costa Rica. Seven 24-hour dietary recalls and two FFQ interviews (12 months apart) were conducted between 1995 and 1998 to estimate dietary intake during the past year. Plasma and adipose tissue samples were collected from all subjects. Validity coefficients, which measure the correlation between observed and "true" dietary intake, were also estimated. The median validity coefficients for tocopherols and carotenoids estimated by dietary recall, the average of the two FFQs, and plasma were 0.71, 0.60, and 0.52, respectively. Compared with adipose tissue, plasma was a superior biomarker for carotenoids and tocopherols. Adipose tissue was a poor biomarker for saturated and monounsaturated fatty acids but performed well for polyunsaturated fatty acids (validity coefficients, 0.45–1.01) and lycopene (validity coefficient, 0.51). This study also showed that biomarkers did not perform better than the FFQ and that they should be used to complement the FFQ rather than substitute for it.

biological markers; diet; epidemiologic methods; Hispanic Americans; methods; questionnaires; recall; reproducibility of results

Abbreviations: FFQ, food frequency questionnaire; USDA, US Department of Agriculture; VC, validity coefficient

High intake of certain nutrients and total energy is a recognized risk factor for conditions such as diabetes, stroke, and cardiovascular disease (1Go, 2Go), whereas intake of others (e.g., tocopherols, carotenoids, folic acid, vitamin C, and dietary fiber) is thought to be protective (3GoGo–5Go). Assessment of long-term dietary intake, the essential exposure factor for disease, is complicated by a lack of accurate methods (6Go, 7Go). Traditionally, intake of micro- and macronutrients has been estimated by the use of semiquantitative food frequency questionnaires (FFQs), dietary records, and dietary recalls (7Go, 8Go). Use of biomarkers of dietary intake is a recent addition to these techniques (3Go, 9Go, 10Go). Assessment of true long-term dietary intake is fraught with a number of problems (11GoGo–13Go), and biomarkers may not be better than traditional methods because they can be affected by factors other than diet and are not available for all nutrients (10Go, 14Go). Regardless of the technique used, actual food intake and its reporting are affected by factors such as culture, education, type of food consumed, age, gender, and body weight (11Go, 12Go, 15GoGo–17Go). Furthermore, menus and recipes tend to vary across sociocultural groups.

Although a questionnaire is an excellent tool for assessing long-term dietary intake, an FFQ valid for one population may be invalid when applied to another. For this reason, a validation study is necessary whenever an FFQ is used. The performance of FFQs in describing food consumption patterns (18Go) and intake of individual nutrients has been evaluated extensively in European and US Caucasian populations (8Go, 14Go, 19Go). Little is known about the performance of the FFQ in other ethnic groups, particularly in developing countries and in US minority populations. In addition, FFQs have been validated mainly against one dietary assessment method such as dietary recalls or dietary records. The problem attending this approach is that the same factors that affect the reference method may also affect the FFQ. This problem would make it impossible to assume independent random errors in the two methods, which could lead to overestimation of the correlation between the reference method and the FFQ (20Go).

Even if this error did not exist, a bias leading to underestimation of this correlation could occur as a result of correlated random errors in repeated measurements when the reference method is used (14Go, 20Go). Furthermore, in most FFQ evaluation studies, additional information on biomarkers of intake is usually not available to augment data from the reference method. When such information is available, Kaaks (6Go) has recommended that the correlation of the estimate by using the dietary assessment method and a person's "true" long-term intake (referred to as the validity coefficient (VC)) be estimated from three pairwise correlations between the FFQ, the reference method, and the biomarker (figure 1). The technique for this estimation, named the "method of triads," is an application of a factor analysis model and does correct for bias due to correlated errors in the repeated measurements from the reference method (6Go, 20Go). Briefly, if Q, R, and M are the measurements from the FFQ, the reference method, and the biomarker, respectively, VCs can be estimated as follows (6Go, 14Go, 20Go):


where r is the correlation corrected for within-subject variation and T is the true, but unknown long-term dietary intake. This technique assumes that random errors in the dietary assessment methods are uncorrelated and that positive linear correlations exist between estimates obtained by the dietary assessment methods and true intake (6Go, 14Go, 20Go). Existence of negative correlations and high random variation in the sample correlation could cause VCs to be inestimable or >1, a condition referred to as Heywood case (6Go). The authors of the method of triads have applied it in a few validation studies (14Go, 20Go), but we are not aware of other studies in which this novel approach has been used.



View larger version (14K):
[in this window]
[in a new window]
 
FIGURE 1. Diagrammatic representation of the method of triads used to estimate the correlation (?) between true long-term nutrient intake and intake estimated using dietary assessment methods. Modified from Ocké and Kaaks (20Go).

 
Here, we apply the method of triads to validate the FFQ and the biomarkers used in our ongoing study of myocardial infarction and gene-diet interaction in Costa Rica. We also report the reproducibility of the FFQ in assessing dietary intake of selected nutrients in Costa Rica.

MATERIALS AND METHODS

Study population and design
The subjects in this 1995–1998 validation study were recruited from the control group of an ongoing case-control study of myocardial infarction in Costa Rica. The 78 men and 42 women in this study are of Mestizo background and culturally are Hispanic Americans. All subjects had no history of myocardial infarction or physical or mental disabilities prior to enrolling in the study. The study was approved by the Use of Human Subjects in Research committees at the Harvard School of Public Health (Boston, Massachusetts) and the University of Costa Rica (San Pedro, Costa Rica). Subjects randomly selected from the control group were asked to participate in the FFQ validation study. All subjects were visited at their homes by a dietitian and were interviewed about their dietary intake during the past year (FFQ1). In addition, seven 24-hour dietary recall assessments were conducted at each participant's home and served as a reference dietary assessment method. To account for seasonal variations in nutrient intake, the dietary recall assessments for each subject were distributed across 7 months of the year. For each subject, the months and days on which dietary recall assessments were conducted were chosen at random. All 7 days of the week were represented, except for a few subjects (n = 9) who could not be contacted on certain days. All dietary recall assessments were completed within 1 year of the FFQ1 interview.

To assess the reproducibility of FFQ1, we conducted a second interview (FFQ2) among all validation study subjects about a year later. The same 135-item FFQ (modified from that of Willett et al. (19Go)) was used for both interviews. Each subject provided a plasma sample (for assessment of tocopherol and carotenoid intake) and an adipose tissue biopsy (for assessment of tocopherol, carotenoid, and fatty acid intake).

Intake of energy and nutrients was computed by multiplying the consumption frequency of each food by the nutrient content of the specific portion; food composition values from the US Department of Agriculture (USDA) database (19Go, 21Go) and data from manufacturers and published reports were used. Carotenoid intake (including {alpha}-carotene, ß-carotene, ß-cryptoxanthin, lycopene, and zeaxanthin + lutein) was calculated by using the new carotenoid database that includes more than 2,400 fruits, vegetables, and selected multicomponent foods (22Go, 23Go). The carotenoid content of tomato-based products was updated with values from the USDA, which were derived recently by reverse-phase high-performance liquid chromatography (24Go).

"Food Processor" nutrient analysis software (ESHA Research, Salem, Oregon), which is based on USDA food composition data, was used to compute nutrient intakes from dietary recalls. This database was enhanced with nutrient composition data for foods and recipes specific to Costa Rica.

Sample collection and biochemical analyses
All biologic specimens were collected at the subjects' homes on the morning after an overnight fast. A subcutaneous adipose tissue biopsy was collected from the upper buttock with a 16-gauge needle and disposable syringe, as described previously (25Go). Blood samples were collected into tubes containing 0.1 percent ethylenediaminetetraacetic acid (EDTA). Both samples were stored in a cooler with ice packs at 4°C and were transported to the fieldwork station within 4 hours. Blood was then centrifuged at 2,500 rpm for 20 minutes at 4°C to obtain plasma. Plasma and adipose tissue samples were stored at -80°C and, within 6 months of collection, were transported over dry ice to the Harvard School of Public Health for analysis.

Concentrations of {alpha}- and {gamma}-tocopherol were measured with a dual wavelength Hitachi high-performance liquid chromatography system and data station (26Go). The L-4200 detector was set at a wavelength of 300 nm, and injections were performed by a programmable AS-4000 Auto-Sampler. One large sample of adipose tissue was maintained as a stock for quality assurance in subsequent runs. A portion of the same weight (20–60 mg) as the study sample was taken from the core of the quality assurance sample and was included in each run to adjust for between-run variation. Every run also included a pooled plasma sample. The coefficients of variation for plasma {alpha}- and {gamma}-tocopherol were 9.4 and 10.1 percent, respectively. The respective coefficients of variation were 20.4 and 17.8 percent for adipose tissue {alpha}- and {gamma}-tocopherol. The minimum detection limits in a 30-mg adipose tissue sample were 1.189 and 0.718 µg/g for {alpha}- and {gamma}-tocopherol, respectively, while they ranged from 0.023 to 0.035 µg/g for the carotenoids. Samples (n <= 4) below the detection limits were set to missing. The same procedure was used to measure concentrations of {alpha}-carotene, ß-carotene, ß-cryptoxanthin, lycopene, and zeaxanthin + lutein in adipose tissue and plasma samples, except that the L-4200 detector was set at a wavelength of 445 nm. Lutein and zeaxanthin were grouped because they coelute on the chromatogram. The between-run coefficients of variation for {alpha}-carotene, ß-carotene, ß-cryptoxanthin, lycopene, and zeaxanthin + lutein were 7.2, 7.5, 12.6, 8.1, and 8.6 percent, respectively, in plasma samples and 18.6, 21.8, 26.4, 16.7, and 19.6 percent in adipose tissue samples.

The proportion of total fat in adipose tissue contributed by each fatty acid was determined by gas-liquid chromatography (27Go). In brief, about 2 mg of adipose tissue was added to a hexane:isopropanol (3:2) mixture. To 200 µl of this mixture was added methanol and acetyl chloride, which formed methyl esters. After esterification, the adipose tissue was evaporated and the fatty acid methyl esters were redissolved in iso-octane. The fatty acid concentrations were determined according to the following specifications: fused-silica capillary cis/trans column, SP2560, 100 m x 250 µm internal diameter x 0.20 µm film (Supelco, Belefonte, Pennsylvania); splitless injection port at 240°C; hydrogen carrier gas at 1.3 ml/minute, constant flow; Hewlett-Packard (now Agilent, Palo Alto, California) Model GC 6890 flame ionization detector (FID) gas chromatograph with 7673 autosampler injector; 1 µl of sample injected; and a temperature program of 90–170°C at 10°/minute, 170°C for 5 minutes, 170–175°C at 5°/minute, 175–185°C at 2°/minute, 185–190°C at 1°/minute, 190–210°C at 5°/minute, 210°C for 5 minutes, 210–250°C at 5°/minute, and 250°C for 10 minutes. We used known standards (NuCheck Prep, Elysium, Minnesota) and Agilent Technologies ChemStation A.08.03 software to identify peak retention times and the relative quantity of each fatty acid. For the 16 blind duplicates included with the test samples, the coefficients of variation were 24.9 percent for myristic, 5.4 percent for palmitic, 14.0 percent for palmitoleic, 16.0 percent for stearic, 3.0 percent for oleic, 5.5 percent for linoleic, and 8.5 percent for linolenic acids.

Plasma triacylglycerol, cholesterol, and high density lipoprotein cholesterol concentrations were measured with enzymatic reagents (Boehringer-Mannheim, Indianapolis, Indiana) and a Cobas Mira Plus autoanalyzer (Roche Diagnostics, Somerville, New Jersey). Cholesterol measurements were standardized to guidelines from the Centers for Disease Control (Atlanta, Georgia) and the National Heart, Lung, and Blood Institute (Bethesda, Maryland) (28Go, 29Go).

Statistical analysis
SAS software (SAS Institute, Inc., Cary, North Carolina) was used for all statistical analyses. The mean of seven dietary recalls was computed and was compared with intakes estimated from FFQs, plasma, and adipose tissue. We also determined the mean of the two FFQ (average FFQ) assessments in an attempt to obtain a better estimate of long-term dietary intake (30Go), and we compared it with the mean of dietary recalls. The significance of the differences between the mean of dietary recalls and the average from the two FFQs was assessed by using Wilcoxon's signed rank test (31Go). Descriptive statistics for the validation study population and for the overall control population were computed.

Because there were high correlations between total energy intake and individual nutrient intakes estimated by dietary recalls and the FFQs, variables were adjusted for total energy intake by regressing the nutrient against total energy intake, as described previously (7Go, 30Go). Briefly, a nutrient was loge or square-root transformed to improve normality. The transformed nutrient was then regressed on total energy intake obtained from the same dietary assessment method. The regression coefficient, the intercept, and residuals were obtained. Although by definition the residuals are independent of the explanatory variable, some are negative and difficult to interpret. Therefore, we multiplied the regression coefficient by the mean of energy intake for the whole study population; to this product we added the intercept and the residual (7Go). The result was back-transformed to obtain energy-adjusted nutrient intake for each subject. Plasma tocopherol and carotenoid concentrations correlated highly with plasma triacylglycerol and cholesterol, respectively. Accordingly, plasma tocopherol and carotenoid measurements were adjusted for triacylglycerol and cholesterol concentrations by the methods used for energy adjustment. The same approach was used to adjust adipose tissue tocopherols and carotenoids for the quantity of the adipose biopsy. Because some individual fatty acids are somewhat related to the total area of the chromatogram, we adjusted adipose tissue fatty acids for the total area of the lipid chromatogram by using the method described for energy adjustment.

All correlations among dietary assessment methods were computed from intakes adjusted for total energy intake, plasma triacylglycerol, cholesterol, quantity of adipose tissue, or area of the chromatogram. Since these data are from a matched case-control study, we computed Pearson's partial correlation coefficients on normalized nutrient intake estimates by coding the matching variables (i.e., age, gender, and county of residence in Costa Rica) as numeric regressors and used them as partial variables in the CORR procedure of SAS (32Go). Because of the established negative relation between smoking and amounts of carotenoids and tocopherols in the plasma and diets of smokers (30Go, 33Go), and the observed associations between these nutrients, smoking status, and body mass index in this study, we used regression methods to compute Pearson's partial correlation coefficients for these nutrients (32Go).

Random within-subject error in estimating the intake of a nutrient tends to attenuate correlations toward zero (7Go). Therefore, we performed analysis of variance on the data from dietary recalls to estimate within- and between-subject variation and used the ratio of the two variances to correct correlations for day-to-day variation (7Go). Briefly, the following formula was used: , where Cr is the corrected correlation, r is the observed correlation, {lambda}x is the ratio of within to between subject variation, and nx is the number of dietary recall replicates for each subject. Only subjects whose data were not missing were included in the computation of {lambda}x, leaving at least 110 subjects for whom data on each of the nutrients were complete.

We used the method of triads (6Go, 14Go, 20Go) to estimate the VCs between "true" nutrient intakes and those estimated from using dietary assessment methods. Because data on biomarkers were available for carotenoids, tocopherols, and fatty acids only, VCs were computed for these nutrients only. The correlation between the FFQ and the biomarker, and the deattenuated correlations of the dietary recalls with the biomarker and the FFQ, were computed and were used to estimate the VCs (14Go, 20Go). Three measurements, a biomarker (e.g., plasma or adipose tissue), the mean of dietary recalls, and the estimate from the FFQ (e.g., Q1 or Q2 or their average, Q3) were used to estimate the VCs (figure 1). The VCs obtained through the various dietary assessment methods were then compared by assuming that they should be about equal if the assessment method was reproducible (e.g., FFQ1 vs. FFQ2) or if all methods were relatively valid. We used bootstrap sampling to construct confidence intervals around the VCs (14Go, 20Go). A total of 1,000 bootstrap samples of equal size (n = 120) were obtained from 120 study subjects by random sampling with replacement. For each bootstrap sample, VCs for the FFQ, dietary recalls, and the biomarker were obtained and were merged into a single data set. The UNIVARIATE procedure of SAS software, which uses the empirical distribution function (32Go), was applied to compute the 5th and 95th percentiles that we used as the nonparametric confidence interval for the VC.

RESULTS

Descriptive statistics
The subjects in this validation study were similar to the overall control group with respect to most variables, including biologic parameters (table 1). However, this study included a larger proportion of women (35 percent) than did the total control population (27 percent). The mean absolute intakes estimated by dietary recalls and the FFQs are shown in table 2. For most nutrients, intake estimates obtained by FFQ tended to be higher than those obtained by dietary recall. The average FFQ values also tended to be higher than the mean of the dietary recalls, and the differences were significant (p < 0.05) for all nutrients but vitamin K, iron, and caffeine. On average, the FFQ overestimated daily energy intake by 477 kcal.


View this table:
[in this window]
[in a new window]
 
TABLE 1. Characteristics of the 120 controls interviewed to validate the semiquantitative food frequency questionnaire used in a study of myocardial infarction, Costa Rica, 1995–1998

 

View this table:
[in this window]
[in a new window]
 
TABLE 2. Comparison of mean daily energy and absolute nutrient intakes estimated by using a semiquantitative food frequency questionnaire and seven 24-hour dietary recalls for 120 controls in a study of myocardial infarction, Costa Rica, 1995–1998

 
Correlations
Pearson's partial correlation coefficients between the mean of the dietary recalls and FFQs and between the two FFQs are shown in table 3. It is notable that the correlations between the mean of the dietary recalls with FFQ1 and those with FFQ2 were similar for most nutrients. Given the error inherent in the reporting of food intake, these correlations (r = 0.40) (6Go) show that the FFQ has good validity. Furthermore, correlations between FFQ1 and FFQ2 were high, indicating that the questionnaire has high reproducibility.


View this table:
[in this window]
[in a new window]
 
TABLE 3. Pearson's partial correlation coefficients* for nutrients estimated from two food frequency questionnaires and seven 24-hour dietary recalls for 120 subjects from Costa Rica, 1995–1998

 
Correlations between nutrient concentrations measured in biomarkers and those estimated by dietary recall and the FFQ are presented in table 4. Except for {alpha}-tocopherol, plasma measurements correlated fairly well with estimates from dietary recalls. Overall, the correlations between adipose tissue concentrations and traditional dietary assessment methods were lower than those with plasma. Good correlations with dietary recalls were observed for adipose tissue ß-carotene (r = 0.43) and lycopene (r = 0.42). It is noteworthy that the correlations between measurements of saturated fatty acids and monounsaturated fatty acids in adipose tissue and the estimates obtained by dietary recall and FFQ were low. However, the correlations between measurements of adipose tissue polyunsaturated fatty acids and those obtained by dietary recall and FFQ were high.


View this table:
[in this window]
[in a new window]
 
TABLE 4. Pearson's partial correlation coefficients* for carotenoids, tocopherols, and fatty acids estimated from plasma, adipose tissue, seven 24-hour dietary recalls, and two semiquantitative food frequency questionnaires for 120 subjects from Costa Rica, 1995–1998

 
Validity coefficients
The VCs for each dietary assessment method are presented in tables 5 and 6. Although a few Heywood cases were evident, especially when adipose tissue was used as a biomarker, most VCs were within the range of 0–1. For {gamma}-tocopherol and carotenoids in plasma and for adipose tissue polyunsaturated fatty acids, at least two of the three VCs were similar, suggesting that at least two of the methods yielded similar measurements of the nutrient. When the average FFQ was used together with the mean of dietary recalls, plasma (VC, 0.16–0.72; median, 0.52) was found to be a better biomarker for carotenoids and {gamma}-tocopherol than adipose tissue (VC, 0.05–0.51; median, 0.30). VCs for the average FFQ were similar to or higher than those for plasma and adipose tissue biomarkers and were in some cases (e.g., ß-cryptoxanthin) higher than those for dietary recall.


View this table:
[in this window]
[in a new window]
 
TABLE 5. Validity coefficients (95% bootstrap confidence intervals) for carotenoids and tocopherols estimated from plasma, adipose tissue, seven 24-hour dietary recalls, and two semiquantitative food frequency questionnaires for 120 subjects from Costa Rica, 1995–1998

 

View this table:
[in this window]
[in a new window]
 
TABLE 6. Validity coefficients (95% bootstrap confidence intervals) for selected fatty acids estimated from adipose tissue, seven 24-hour dietary recalls, and two semiquantitative food frequency questionnaires for 120 subjects from Costa Rica, 1995–1998

 
VCs for adipose tissue palmitic acid could not be estimated because of a negative correlation (tables 4 and 6). However, adipose tissue was a good biomarker for polyunsaturated fatty acids; VCs ranged from 0.45 to 1.01. For polyunsaturated fatty acids, the VCs from the FFQ were always higher than those from adipose tissue and, for linoleic acid, were similar to those from dietary recalls, again suggesting that the three methods are comparable.

DISCUSSION

Unlike most validation studies, in which data from only one FFQ interview and one reference method are available, our study estimated nutrient intake by using three methods (FFQ, dietary recalls, and biomarkers). The sample size of 120 subjects, coupled with seven dietary recall replicates per subject, allowed for reasonable precision in estimating the correlations (7Go). In addition, potential seasonal variation in food intake, especially of fruits and vegetables, was considered in the study design. The analysis also produced a better estimation of long-term intake because the two FFQs were averaged.

In this study, the correlations between estimates obtained by the FFQ and the dietary recall are similar to those observed between FFQs and dietary records in other studies (8Go, 19Go). The median of the correlations between the dietary recalls and average FFQ measurements was 0.55, again indicating good validity of the FFQ. Relative to the dietary recalls, the FFQ also performed well in estimating intake of fatty acids, irrespective of whether they were saturated or unsaturated. The highest correlations were found for linoleic (r = 0.73) and myristic (r = 0.70) acids. The FFQ was highly reproducible, as shown by Pearson's partial correlation coefficients ranging from 0.33 to 0.77. Intraclass correlations were also high (data not shown).

In comparison with dietary recall estimates, lycopene seemed to be equally well estimated from both plasma (r = 0.45) and adipose tissue (r = 0.42). Plasma was also a good biomarker for ß-cryptoxanthin (r = 0.43) and zeaxanthin + lutein (r = 0.43), and adipose tissue was a good biomarker for ß-carotene (r = 0.43). The correlation between plasma and adipose tissue {alpha}-tocopherol measurements (r = 0.41) was similar to the one (r = 0.39) reported in the European Community Multicenter Study on Antioxidants, Myocardial Infarction and Cancer (EURAMIC) of the Breast (34Go). However, our correlations between plasma and adipose tissue ß-carotene (r = 0.50) and lycopene (r = 0.43) were higher than those reported in the EURAMIC study (ß-carotene, r = 0.39; lycopene, r = 0.24).

Measurements of saturated fatty acids and monounsaturated fatty acids from adipose tissue correlated poorly with those estimated by the FFQ. This poor correlation may reflect the fact that other than dietary sources, saturated fatty acids can be synthesized endogenously; furthermore, other physiologic processes may influence adipose tissue concentrations. Compared with plasma, higher coefficients of variation were observed for nutrients measured from adipose tissue. We determined that this high variation is due to nonuniform distribution of the nutrient in adipose tissue and could in part explain the poor correlations between adipose tissue measurements and those obtained by the FFQ and dietary recalls. Estimates of saturated fatty acids from dietary recalls correlated better with those from the FFQ than the measurements from adipose tissue, suggesting that although biomarkers are informative, there are nutrients for which the FFQ remains a better dietary assessment method.

The VCs estimated for the FFQ were high, suggesting that the FFQ is a valid dietary assessment method. We also estimated VCs for the dietary recall and the biomarker. Doing so enabled us to correct correlations for potential attenuating effects of correlated errors in repeated dietary recalls (6Go) and therefore to simultaneously compare the relative performance of the three methods. For some of the nutrients from the average FFQ (e.g., ß-cryptoxanthin and lycopene), the VCs for the questionnaire were higher or similar to those for the biomarker, suggesting that the FFQ and the biomarker are comparable. Published data on VCs are scarce, especially those from studies in which dietary recalls are used as a reference method. In one study (n = 61) in which serum was used as a biomarker for ß-carotene and dietary recall as a reference dietary assessment method, the VCs for the FFQ, dietary recall, and biomarker were 0.44, 0.58, and 0.32, respectively; in our study, the VCs were 0.76, 0.71, and 0.50, respectively (20Go). In another study (n = 87) in which dietary records were used as a reference method (14Go), the VCs for the FFQ, dietary records, and plasma ß-carotene were 0.39, 0.52, and 0.85, respectively. The disparity between estimates obtained from these studies could be due to the different reference methods used, random error resulting from differences in sample sizes, differences in the populations studied, or the structure and size of the questionnaires used in these studies.

The VCs for FFQ1 and FFQ2 were very similar, further suggesting that the FFQ is a reproducible dietary assessment method. Random error could explain the Heywood cases found in our analysis. Thus, sample sizes of >120 may be necessary to stabilize the variances in validation studies. Efforts to correct for random error and to constrain VC estimates between 0 and 1 are needed to perfect this method. We cannot rule out the potential for correlated errors between the FFQ and dietary recalls; thus, the VCs reported in this study could have been overestimated and should be regarded as upper limits of the true VC.

This study has shown that the FFQ is a valid and reproducible instrument for assessing dietary intake among Hispanics in Costa Rica. Furthermore, the VCs suggest that plasma could be used as a biomarker for {alpha}-tocopherol, ß-carotene, ß-cryptoxanthin, lycopene, and zeaxanthin + lutein, while adipose tissue could be used as a biomarker for lycopene and polyunsaturated fatty acids. This study also shows that biomarkers did not perform better than the FFQ and that they should be used to complement the FFQ rather than substitute for it.

ACKNOWLEDGMENTS

This study was supported by National Institutes of Health grant HL49086.

The authors thank the field workers of Proyecto Salud Coronaria, San José, Costa Rica, for their help with data collection.

NOTES

Correspondence to Dr. Hannia Campos, Department of Nutrition, Room 353A, Harvard School of Public Health, Harvard University, Boston, MA 02115 (e-mail: hcampos{at}hsph.harvard.edu).

REFERENCES

  1. Hannah JS, Howard BV. Dietary fats, insulin resistance, and diabetes. J Cardiovasc Risk 1994;1:31–7.[Medline]
  2. He J, Ogden LG, Vupputuri S, et al. Dietary sodium intake and subsequent risk of cardiovascular disease in overweight adults. JAMA 1999;282:2027–34. (Comments published in JAMA 2000;283:1957–8).[Abstract/Free Full Text]
  3. Kardinaal AF, Kok FJ, Ringstad J, et al. Antioxidants in adipose tissue and risk of myocardial infarction: the EURAMIC Study. Lancet 1993;342:1379–84. (Comments published in Lancet 1994;343:595–6).[ISI][Medline]
  4. Werler MM, Shapiro S, Mitchell AA. Periconceptional folic acid exposure and risk of occurrent neural tube defects. JAMA 1993;269:1257–61. (Comments published in JAMA 1993;269:1292–3.)[Abstract]
  5. Salmeron J, Ascherio A, Rimm EB, et al. Dietary fiber, glycemic load, and risk of NIDDM in men. Diabetes Care 1997;20:545–50.[Abstract]
  6. Kaaks RJ. Biochemical markers as additional measurements in studies of the accuracy of dietary questionnaire measurements: conceptual issues. Am J Clin Nutr 1997;65:1232S–9S.[Abstract]
  7. Willett WC. Nutritional epidemiology. New York, NY: Oxford University Press, 1998.
  8. Andersen LF, Solvoll K, Johansson LR, et al. Evaluation of a food frequency questionnaire with weighed records, fatty acids, and alpha-tocopherol in adipose tissue and serum. Am J Epidemiol 1999;150:75–87.[Abstract]
  9. Bingham SA, Day NE. Using biochemical markers to assess the validity of prospective dietary assessment methods and the effect of energy adjustment. Am J Clin Nutr 1997;65:1130S–7S.[Abstract]
  10. Hunter D. Biochemical indicators of dietary intake. In: Willett WC, ed. Nutritional epidemiology. New York, NY: Oxford University Press, 1998:174–243.
  11. Frank GC. Methodological issues regarding eating behavior of high-risk adolescents. Ann N Y Acad Sci 1997;817:66–82.[Abstract]
  12. Singhal S, Goyle A, Gupta R. Quantitative food frequency questionnaire and assessment of dietary intake. Natl Med J India 1998;11:268–75. (Comments published in Natl Med J India 1999;12:138–9).[ISI][Medline]
  13. Bathalon GP, Tucker KL, Hays NP, et al. Psychological measures of eating behavior and the accuracy of 3 common dietary assessment methods in healthy postmenopausal women. Am J Clin Nutr 2000;71:739–45.[Abstract/Free Full Text]
  14. Daures JP, Gerber M, Scali J, et al. Validation of a food-frequency questionnaire using multiple-day records and biochemical markers: application of the triads method. J Epidemiol Biostat 2000;5:109–15.[Medline]
  15. Forsythe HE, Gage B. Use of a multicultural food-frequency questionnaire with pregnant and lactating women. Am J Clin Nutr 1994;59:203S–6S.[Abstract]
  16. Bingham SA, Cassidy A, Cole TJ, et al. Validation of weighed records and other methods of dietary assessment using the 24 h urine nitrogen technique and other biological markers. Br J Nutr 1995;73:531–50.[ISI][Medline]
  17. Heerstrass DW, Ocke MC, Bueno-de-Mesquita HB, et al. Underreporting of energy, protein and potassium intake in relation to body mass index. Int J Epidemiol 1998;27:186–93.[Abstract]
  18. Hu FB, Rimm E, Smith-Warner SA, et al. Reproducibility and validity of dietary patterns assessed with a food-frequency questionnaire. Am J Clin Nutr 1999;69:243–9. (Comments published in Am J Clin Nutr 1999;70:422).[Abstract/Free Full Text]
  19. Willett WC, Sampson L, Stampfer MJ, et al. Reproducibility and validity of a semiquantitative food frequency questionnaire. Am J Epidemiol 1985;122:51–65.[Abstract]
  20. Ocké MC, Kaaks RJ. Biochemical markers as additional measurements in dietary validity studies: application of the method of triads with examples from the European Prospective Investigation into Cancer and Nutrition. Am J Clin Nutr 1997;65:1240S–5S.[Abstract]
  21. US Department of Agriculture. Composition of foods: raw, processed and prepared. USDA nutrient database for standard reference, release 13. Beltsville, MD: USDA, Agricultural Research Service, Beltsville Human Nutrition Research Center, Nutrient Data Laboratory, 1999:1–37.
  22. Chug-Ahuja JK, Holden JM, Forman MR, et al. The development and application of a carotenoid database for fruits, vegetables, and selected multicomponent foods. J Am Diet Assoc 1993;93:318–23.[ISI][Medline]
  23. Mangels AR, Holden JM, Beecher GR, et al. Carotenoid content of fruits and vegetables: an evaluation of analytic data. J Am Diet Assoc 1993;93:284–96. (Erratum published in J Am Diet Assoc 1993;93:527).[ISI][Medline]
  24. Tonucci LH, Holden JM, Beecher GR, et al. Carotenoid content of thermally processed tomato-based food products. J Agric Food Chem 1995;43:579–86.[ISI]
  25. Beynen AC, Katan MB. Rapid sampling and long-term storage of subcutaneous adipose-tissue biopsies for determination of fatty acid composition. Am J Clin Nutr 1985;42:317–22.[Abstract]
  26. Hess D, Keller HE, Oberlin B, et al. Simultaneous determination of retinol, tocopherols, carotenes and lycopene in plasma by means of high-performance liquid chromatography on reversed phase. Int J Vitam Nutr Res 1991;61:232–8.[ISI][Medline]
  27. Lillington JM, Trafford DJ, Makin HL. A rapid and simple method for the esterification of fatty acids and steroid carboxylic acids prior to gas-liquid chromatography. Clin Chim Acta 1981;111:91–8.[ISI][Medline]
  28. Myers GL, Cooper GR, Winn CL, et al. The Centers for Disease Control–National Heart, Lung and Blood Institute Lipid Standardization Program. An approach to accurate and precise lipid measurements. Clin Lab Med 1989;9:105–35.[ISI][Medline]
  29. Myers GL, Kimberly MM, Waymack PP, et al. A reference method laboratory network for cholesterol: a model for standardization and improvement of clinical laboratory measurements. Clin Chem 2000;46:1762–72.[Abstract/Free Full Text]
  30. Michaud DS, Giovannucci EL, Ascherio A, et al. Associations of plasma carotenoid concentrations and dietary intake of specific carotenoids in samples of two prospective cohort studies using a new carotenoid database. Cancer Epidemiol Biomarkers Prev 1998;7:283–90.[Abstract]
  31. Pagano M, Gauvreau K. Principles of biostatistics. 2nd ed. Pacific Grove, CA: Duxbury Press, 2000.
  32. SAS Institute, Inc. Selected SAS documentation for BIO 226ab: applied longitudinal analysis (fall 1998). Cary, NC: SAS Institute, Inc, 1998.
  33. Wei W, Kim Y, Boudreau N. Association of smoking with serum and dietary levels of antioxidants in adults: NHANES III, 1988–1994. Am J Public Health 2001;91:258–64.[Abstract]
  34. Su LC, Bui M, Kardinaal A, et al. Differences between plasma and adipose tissue biomarkers of carotenoids and tocopherols. Cancer Epidemiol Biomarkers Prev 1998;7:1043–8.[Abstract]
Received for publication February 13, 2001. Accepted for publication September 13, 2001.