* Department of Biostatistics, Virginia Commonwealth University, Richmond, Virginia 23298; National Health and Environmental Effects Research Laboratory, ORD, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina 27711
1 To whom correspondence should be addressed at B1-039-A, 1101 East Marshall Street, Department of Biostatistics, Virginia Commonwealth University, Richmond, VA 232980032. Fax: 8048288900. E-mail: gennings{at}hsc.vcu.edu.
Received May 17, 2005; accepted September 7, 2005
![]() |
ABSTRACT |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Key Words: additivity; nonadditivity; nonlinear threshold models; optimal designs.
![]() |
INTRODUCTION |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Efficient, less than full-factorial experimental designs make evaluation of large numbers of chemicals in a mixture economically and technically feasible. As an example, Groten et al. (1997) used a fractional 29 factorial design in a study of nine chemicals that required the assumption that higher order interactions were negligible and that a linear approximation is appropriate (supported with only two dose groups) to what may be a nonlinear relationship. The ray experimental design examines a constant mixing ratio of chemicals in various doses that results in varying levels of biological effect (Gennings, 1996
; Gennings and Schwartz, 1998
; Meadows et al., 2002
). This approach may be useful for examining low biological effect levels, because a response threshold can be incorporated into the statistical model (Gennings, 1996
; Gennings and Schwartz, 1998
). For the purposes of this article, the term threshold refers to a dose level estimated from the statistical model that separates doses with background responses from doses with nonbackground responses. The Single Chemical Required (SCR) methodology (Casey et al., 2004
; Gennings et al., 2002
) allows the estimation of additivity or interaction for a mixture with any number of chemicals. This method requires that single chemical doseresponse curves are available for each component of the mixture. By use of a fixed-ratio mixture ray with chemicals in proportions that are relevant to the scientific question of interest, this approach results in a test for a departure from additivity that requires relatively few dose groups compared to full-factorial experimental designs.
Using the SCR methodology, the investigators can choose optimal experimental conditions that result in increased power to detect departures from additivity. The power of a test can be defined as the probability of observing a departure from additivity, provided that one exists (e.g., Neter et al., 1996, pp. 10521060), and it depends on the amount of departure specified in the alternative hypothesis. In the present work, a methodology is described for the development of experimental designs that require much fewer dose groups than traditional full-factorial designs, yet these designs have high power to detect departures from additivity. They are based on a D-optimality criterion that minimizes the generalized variance of parameters from the mixture model based on specified values of the model parameters. For a fixed sample size, this kind of design selects the experimental doses of the mixture, and number of observations per dose level, that result in minimum variance of the model parameters, thereby increasing the power to detect departures from additivity. The scenario is that single chemical doseresponse data are available and an additivity model is estimated. The objective is to determine total doses and sample size allocation to be used for a fixed mixing ratio of the chemicals that satisfies a specified design optimality criterion. The example in this article uses a mixture of two chemicals. However, the methods presented permit extension to any number of chemicals, provided that suitable single chemical doseresponse data are available for each chemical.
The optimal experimental designs presented can vary as a function of the expected relationship between the dose of the mixture and the biological response of interest. The example presented examines changes in cholinesterase (ChE) activity in erythrocytes produced by a 2:1 mixture of chlorpyrifos:carbaryl. Using an additivity model defined by the SCR methodology, we provide examples of optimal designs for a greater than additive, less than additive, and mixed (less than additive in one dose region and greater than additive in another dose region) interactions. As with any experimental paradigm, judgment on the part of the investigators as to the effect size they wish to detect is required in designing the experiments. For these examples, a 33% change in the ED20 (i.e., a 20% decrease from the vehicle control) for erythrocyte ChE activity was chosen.
![]() |
MATERIALS AND METHODS |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Statistical methods.
The SCR method has been described previously (Casey et al., 2004; Gennings et al., 2002
). This methodology permits the analysis of mixtures while maintaining feasible experimental designs, does not require the constraint of parallel doseresponse curves for the chemicals in the mixture, and adequately accounts for biological variability when testing the null hypothesis of additivity. Briefly, doseresponse curves for individual chemicals are determined. Based on the single chemical doseresponse curves, an additivity model is developed. Experimental mixture data are generated using mixtures at fixed mixing ratios, and then modeled to produce the mixture curve. The results of this mixture model are then compared to the additivity model in terms of total dose of the mixture. The statistical comparison of the two models based on prediction along the specified fixed-ratio ray(s) is a test of additivity for the fixed ratio of the mixture of chemicals. Differences between the mixture and additivity models are considered to be a demonstration of departure from additivity. Details of the SCR method are provided in the Appendix.
The definition of additivity (i.e., zero interaction) we use is given by Berenbaum (1985) and is based on the classical isobologram for the combination of two chemicals (e.g., Loewe, 1953
; Loewe and Muischnek, 1926
). That is, in a combination of c chemicals, let Ei represent the dose/concentration of the ith component alone that yields a fixed response, y0, and let xi represent the dose/concentration of the ith component in combination with the c agents that yields the same response. According to this definition of additivity, if the substances combine with zero interaction, then
![]() | (1) |
If the left-hand side of Equation 1, termed the interaction index, is less than 1, then a greater than additive effect can be claimed. If the left-hand side of Equation 1 is greater than 1, then a less than additive interaction can be claimed. The additivity models used in the SCR approach are algebraically equivalent to Berenbaum's definition of additivity (Equation 1) (Carter et al., 1988; Gennings et al., 2002
). This definition of additivity is a general form for what is commonly known as dose-addition.
The SCR methodology requires single chemical doseresponse data. With these data, optimal experimental conditions for the mixture experiment can be chosen to increase the power of detecting departure from additivity. Although there are many statistical criteria for an optimal experimental design, it is common to minimize the variability associated with the model parameters. Designs based on this criterion are known as D-optimal designs (e.g., Myers and Montgomery, 2002). The procedure minimizes the generalized variance, defined as the determinant of the variance-covariance matrix, of the model parameters. The smaller standard errors from this procedure result in increased power compared to standard, nonoptimal designs, because, for a fixed effect size, smaller standard errors result in more evidence against the null hypothesis. With the SCR methodology, for example, using the models described in the appendix (i.e., the nonlinear exponential threshold model), the hypothesis of additivity is parameterized in terms of the slope and threshold parameters of the statistical model, and is written in Equation 2:
![]() | (2) |
The null hypothesis is evaluated using a Wald test. The D-optimal criterion produces an optimal design by minimizing the generalized variance of these parameters. The variance-covariance matrix of these parameters depends on the location of the dose groups for the mixture, as well as the allocation of the total sample size to each dose group. Details of the D-optimality criterion and the dependence of the variance-covariance matrix on the location of the dose groups and allocation of the sample size are provided in the Appendix.
Using the SCR methodology, the predicted model under additivity is estimated from the single chemical data, and thus the slope (add) and threshold (
add) parameters under additivity are estimated based on observed data. However, because the parameters associated with the mixture model (
mix and
mix) are unknown, they must be specified. Therefore, the D-optimality criterion minimizes the variance according to the assumed values of these parameters. Thus, different specifications of the slope and threshold parameters of the mixture model will result in different optimal designs. To find the D-optimal design, a numerical algorithm is needed. We implemented the Nelder-Mead simplex routine (Nelder and Mead, 1965
) to minimize the generalized variance of the model parameters. The computation of this direct-search algorithm was performed using SAS version 8.2 (SAS, 1999
), and this article presents an example to illustrate the application of this methodology. The doseresponse relationship for chlorpyrifos and carbaryl (as prototypical organophosphate and carbamate pesticides) in a 2:1 mixing ratio was determined. The biological response of interest was the ChE activity in erythrocytes, expressed as a proportion of the vehicle control group's activity. Expressing the data in this manner facilitated convergence in the statistical model.
![]() |
RESULTS |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
|
|
The goal of this work was to design mixture experiments that would minimize the generalized variance of the slope and threshold parameters of the statistical model in Equation 5. After finding the optimal design, the power for detecting departure from additivity is reported.
Because the optimal designs depend on the predicted outcome of the experimental results from the mixture experiment, three scenarios of interest were chosen. First, where carbaryl and chlorpyrifos have a greater than additive interaction; second, in a mixed relationship interaction that is less than additive in the low-dose region and greater than additive at higher doses. Finally, we seek a less than additive interaction. In each scenario, the shape of the curve for the mixture data was chosen to represent one possibility of a biologically meaningful effect. In the reported examples, an effect size of a 33% shift in the ED20 (i.e., a 20% decrease in ChE activity from the vehicle control) was modeled by selecting appropriate parameter values for the slope and threshold. The threshold and slope parameters were allowed to change by a varying percentage for each scenario, but their values had to satisfy the particular example (i.e., for the greater than additive scenario, the mixture curve was greater than additive for the entire active range; for the less than additive scenario the mixture curve was less than additive for the entire active range, and in the mixed-interaction scenario, the mixture curve was first less than additive and subsequently greater than additive). For all designs, a total of 50 animals was assumed. This number was chosen to correspond to a mixture experiment that allocated 10 subjects to five different dose groups.
Greater than Additive Interaction Scenario
For all scenarios, the ED20 for the additive model is 1.54 mg/kg and the threshold is 0.95 mg/kg (see Table 1 for details). For the greater than additive interaction scenario, a steeper slope was chosen for the mixture curve compared to the additivity curve. The threshold was slightly reduced so that the greater than additive interaction resulted in a 33% shift in the ED20. It was assumed that the mixture and additivity curves reached the same maximal effect, and thus both curves were equivalent in the high-dose region.
The shift in the greater than additive response curve shown in Figure 2 results in an ED20 of 1.03 mg/kg (a 33% decrease from additivity), and under this scenario, the additivity ED20 of 1.54 mg/kg became the ED43. For this example, the threshold for the mixture is 0.74 mg/kg, which is a 22% decrease from the threshold under additivity.
|
|
As stated previously, the ED20 under additivity is 1.54 mg/kg, and the threshold is 0.95 mg/kg. The shift in the mixed interaction curve shown in Figure 3 results in an ED20 of 2.05 mg/kg (33% increase), and the additivity threshold of 1.54 mg/kg is associated with the control response. For this scenario, the threshold for the mixed interaction curve became 1.75 mg/kg, which is an 82% increase from that under additivity.
|
|
|
Under the less than additive interaction scenario (Table 4), a five-point design with 10 observations per group equally spaced in 5-unit intervals has only 5% power to detect a departure from additivity. A similarly spaced design with 4- and 3-unit intervals has about the same power. These equally spaced designs miss the threshold as well as the majority of the active range of the mixture curve. The optimal five-point design (Design 4) has 26% power to detect a departure from additivity, whereas the optimal four-point design (Design 5) has 27% power. The optimal designs again increase the power of detecting a departure from additivity by locating dose groups at the predicted threshold (1.57 mg/kg) and at doses that will be effective at estimating the slope. It is again important to note that 86% of the observations are allocated to the low-dose region for the two optimal designs. The power of the optimal designs under this scenario is much lower than that under the greater than additive or mixed interaction scenarios. This result is a consequence of the specific choice of a less than additive interaction and the observed single chemical data that produced the additivity model. For this particular case, the curves were mostly coincident for doses greater than the shifted ED20 (2.05 mg/kg). The similarity between the curves resulted in small differences between the model parameters. Smaller changes are more difficult to detect, and this led to the decreased power. However, in general, the D-optimal design criterion does not systematically result in designs that have lower power for detecting less than additive effects than greater than additive interactions. As an example of the difficulty of detecting a difference in this specific scenario, using 1000 animals with Design 1 has only 5% power. Although a 33% shift in the ED20 was achieved, this example demonstrates that, for a nonlinear model, the optimal design depends not only on the type of interaction and effect size but also on the shape of the predicted mixture curve.
|
![]() |
DISCUSSION |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
The procedures demonstrated in this article involve several steps. First, single chemical doseresponse curves are generated. Second, the responses from these experiments are modeled, and the coefficients are used to construct the additivity model. The third step is to design the mixture experiment, collect the data, and see if the results indicate a deviation from dose-additivity.
The D-optimal designs for nonlinear models that are presented depend on the assumed values of the model parameters. This requires specification of the predicted type of interaction (greater than additive, less than additive, mixed interactions), the shape of the mixture doseresponse curve, and the magnitude of the change (effect size) to detect while designing the mixtures experiment. As with any power calculation, the investigator can choose to maintain a constant sample size and calculate the resultant power or calculate the required sample size to produce the desired statistical power (Casey et al., 2005a, 2005b
; Cohen, 1992
; Meadows-Shropshire et al., 2005
; Muller and Benignus, 1992
; Muller et al., 1992
). For the purposes of this demonstration, a 33% change in the ED20 for inhibition of erythrocyte ChE activity was chosen. The ED20 was chosen as this represents a low-level effect, yet is within the detection range for most ChE assays. Pilot experiments are a useful means to gain insight into directions of nonadditivity. Such pilot studies can be designed as a part of on-going experiments in a "leapfrog design" (Muller et al., 1983
). After determining a direction of nonadditivity using a small sample size, the investigator can construct the D-optimal experimental design. Two-stage designs can be implemented, which use the data from the pilot study and the data from the larger optimally designed experiment, to determine departures from additivity.
In the threshold models we examined, the D-optimal designs contained observations at the expected threshold. To achieve the desired statistical power, the groups near the threshold may require larger numbers of observations than the groups near the ends of the response range. Designs with equally spaced dose groups over the mixture doseresponse function may have low statistical power owing to inadequate definition of the threshold or slope parameters of the model. A relatively minor adjustment to the location of a dose group can result in a large change in power, especially when the slope of the mixture curve is steep. Thus, the investigator should assure that the spacing of dose groups effectively estimates both the threshold and the slope of the mixture response curve.
As a general observation, the four-point designs had greater power than the five-point designs. This occurred because the dose groups of the four-point designs more efficiently estimate the two parameters (mix and
mix), by putting a greater percentage of observations at critical design points. For example, in the greater than additive scenario (see Table 2), the optimal four-point design allocates 37 observations to the active range, whereas only 28 are allocated in the optimal five-point design. A similar conclusion exists for the mixed interaction scenario shown in Table 3. However, the five-point optimal designs are more robust to misspecification of the threshold and slope parameters than the four-point optimal designs. This suggests that when the investigator does not have prior information regarding these parameter estimates (from pilot studies), the five-point design may be a desirable alternative to the four-point optimal design.
Several other observations about these D-optimal designs can be clarified. Low statistical power can be a result of similarity between the mixture and additivity curves. This is because the hypothesis of additivity is evaluated with a test of coincidence of the two curves. In general, curves that are farther apart are more likely to have greater power to detect departure from additivity. This was observed in the optimal designs for the less than additive scenario, which had less power than the optimal designs for the mixed or greater than additive scenarios. This finding was related to the similarity of the mixture and additivity curves for doses greater than the ED20. When a 60% increase in the ED20 was allowed, the difference between the curves was increased and the optimal designs resulted in 5254% power. This is in agreement with other sorts of power analysis, where larger effect sizes result in greater statistical power.
In summary, use of statistical methods for experimental design can increase the power to detect effects without requiring a large increase in sample size. The method described in this article uses a D-optimality criterion to minimize the variance of model parameters associated with a chemical mixtures ray design. The reduction in the model variance is accomplished by placing treatment groups for the mixture experiment at points that efficiently estimate the model parameters. Often these locations are regions where the mixture model is anticipated to be altered (e.g., change in ED20, change in response slope) from the additivity model by exposure to the chemical mixture. Unequal allocation of observations may also be necessary to optimize the parameter estimation. Pilot studies with the mixture of interest can greatly assist in developing the D-optimal experimental design. Although the present work created designs for continuous responses, the D-optimal criterion can be used for any type of regression model, including those for binary responses. These models are also applicable when the dose metric is internal dosage (e.g., blood levels of compound), which may change the single chemical doseresponse curves, as the theory of construction of the additivity model and the D-optimal designs is not altered. In times of declining resources, assurance of proper experimental design and adequate power to detect deviations from dose-additivity is of paramount importance. A properly designed experiment can increase efficiency, decrease cost, and increase confidence that the results are scientifically defendable.
![]() |
APPENDIX |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
![]() |
Testing for Interaction Using a Fixed-Ratio Ray Design: SCR Approach
It is of interest to determine whether the components in a specified mixing ratio of chemicals interact. Interaction is detected in the SCR approach by comparison of the results of mixture experiments to the corresponding additivity model. It has been previously demonstrated (Carter et al., 1988; Gennings, 2002
) that generalized linear models, and nonlinear models which can be linearized
have planar contours and therefore agree with the definition of additivity in Equation 1 (see Gennings et al., 2005
for discussion). Further, these models can be adjusted to be in the form of a threshold additivity model (Schwartz et al., 1995
). Specifically, for increasing doseresponse relationships,
![]() |
To illustrate the approach, we consider a nonlinear exponential threshold model where = [
,
] and
![]() |
![]() | (3) |
![]() |
![]() |
We are interested in detecting and characterizing an interaction among the c chemicals in the mixture for the fixed mixing ratio of the chemicals. Following Gennings et al. (2002), define t as the total dose of the mixture
![]() |
![]() |
![]() |
![]() | (4) |
![]() |
![]() | (5) |
If smooth models are used, the hypothesis of additivity is versus
An F-test is used to test this hypothesis of additivity (e.g., Casey et al., 2004
).
D-Optimal Design Criterion
Following Casey et al. (2005), let = [
ßß
add
mix
mix]T represent the p x 1 vector of model parameters from Equations 3 and 5,
![]() |
![]() |
![]() |
![]() |
![]() |
![]() |
NOTES |
---|
Portions of this manuscript were presented as a poster at the 43rd Annual Meeting of the Society of Toxicology (2004, Toxicol. Sci. 78(S-1), 363).
![]() |
ACKNOWLEDGMENTS |
---|
![]() |
REFERENCES |
---|
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() |
---|
Berenbaum, M. C. (1988). Isobolographic, algebraic, and search methods in the analysis of multiagent synergy. J. Am. Coll. Toxicol. 7, 927938.[ISI]
Carter, W. H., Jr., Gennings, C., Staniswalis, J. G., Campbell, E. D., and White, K. L., Jr. (1988). A statistical approach to the construction and analysis of isobolograms. J. Am. Coll. Toxicol. 7, 963973.[ISI]
Casey, M., Gennings, C., Carter, W. H., Jr., Moser, V. C., and Simmons, J. E. (2004). Detecting interaction(s) and assessing the impact of component subsets in a chemical mixture using fixed-ratio mixture ray designs. J. Agr. Biol. Environ. Stat. 9, 339361.[CrossRef][ISI]
Casey, M., Gennings, C., Carter, W. H., Jr., Moser, V. C., and Simmons, J. E. (2005a). Power and sample size calculations for linear hypotheses associated with mixtures of many components using fixed-ratio ray designs. J. Environ. Ecol. Stat. (In press).
Casey, M., Gennings, C., Carter, W. H., Jr., Moser, V., and Simmons, J. E. (2005b). Ds-optimal designs for studying combinations of chemicals using multiple fixed-ratio ray experiments, Environmetrics 16, 129147.[CrossRef][ISI]
Cassee, F. R., Groten, J. P., van Bladeren, P. J., and Feron, V. J. (1998). Toxicological evaluation and risk assessment of chemical mixtures. Crit. Rev. Toxicol. 28, 73101.[CrossRef][ISI][Medline]
Cohen, J. (1992). A power primer. Psycholog. Bull. 112, 155159.[CrossRef][ISI]
Food Quality Protection Act (FQPA). Public Law 104170, 1996.
Gennings, C. (1996). Economical designs for detecting and characterizing departure from additivity in mixtures of many chemicals. Food Chem. Toxicol. 34, 10531058.[CrossRef][ISI][Medline]
Gennings, C. (2002). On testing for drug/chemical interactions: Definitions and inference. J. Biopharm. Stat. 10, 457467.
Gennings, C., and Schwartz, P. (1998). Combination threshold models with design optimization along fixed-ratio rays. J. Agr. Biol. Environ. Stat. 3, 116.
Gennings, C., Carter, W. H., Campain, J. A., Bae, D.-S, and Yang, R. S. H. (2002) Statistical analysis of interactive cytotoxicity in human epidermal keratinocytes following exposure to a mixture of four metals. J. Agr. Biol. Environ. Stat. 7, 5873.[CrossRef][ISI]
Gennings, C., Carter, W. H., Jr., Campbell, E. D., Staniswalis, J. G., Martin, T. J., Martin, B. R., and White, K. L., Jr. (1990). Isobolographic characterization of drug interactions incorporating biological variability. J. Pharmacol. Exp. Ther. 252, 208217.[Abstract]
Gennings, C., Carter, W. H., Jr., Carchman, R. A., Teuschler, L. K., Simmons, J. E., and Carney, E. W. (2005). A unifying concept for assessing toxicological interactions: changes in slope. ToxSci. 10.1093/toxsci/kfi275.
Gessner, P. K. (1988). A straightforward method for the study of drug interactions: An isobolographic primer. J. Am. Coll. Toxicol. 7, 9871012.[ISI]
Gordon, C. J., Herr, D. W., Gennings, C., Graff, J., McMurray, M., Stork, L., Coffey, T., Hamm, A., and Mack, C. (2005). Thermoregulatory response to an organophosphate and carbamate insecticide mixture: Testing the assumption of dose-additivity. Toxicology, in press.
Grecco, W. R., Bravo, G., and Parsons, J. C. (1995). The search for synergy: A critical review from a response surface perspective. Pharmacol. Rev. 47, 331385.
Groten, J. P., Schoen, E. D., van Balderen, P. J., Kuper, C. F., van Zorge, J. A., and Feron, V. J. (1997). Subacute toxicity of a mixture of nine chemicals in rats: Detecting interactive effects with a fractionated two-level factorial design. Fundam. Appl. Toxicol. 36, 1529.[CrossRef][ISI][Medline]
Groten, J. P., Feron, V. J., and Sühnel, J. (2001). Toxicology of simple and complex mixtures. Trends Pharmacol. Sci. 26, 316322.[CrossRef]
Hunter, D. L., and Padilla, S. (1999). Influence of storage conditions on the stability of cholinesterase activity in plasma and brain tissue taken from carbamate or organophosphorus pesticide-treated rats. Toxicol. Meth. 9, 189199.[CrossRef][ISI]
Johnson, C. D., and Russell, R. L. (1975). A rapid, simple radiometric assay for cholinesterase, suitable for multiple determinations. Anal. Biochem. 64, 229238.[CrossRef][ISI][Medline]
Kavlock, R. J., Schmid, J. E., and Setzer, R. W., Jr. (1996). A simulation study on the influence of study design on the estimation of benchmark doses for developmental toxicity. Risk Analysis 16, 399410.[ISI][Medline]
Loewe, S. (1953). The problem of synergism and antagonism of combined drugs. Arzneimittle Forsch. 3, 285290.
Loewe, S., and Muischnek, H. (1926). Uber kombinationswirkunger. I. Mitteilung: Hiltsmittel der fragstellung. Naunyn-Schmiedebergs Arch. Pharmacol. 114, 313326.[CrossRef]
McCullagh, P., and Nelder, J. A. (1989). Generalized Linear Models, 2nd edition. New York: Chapman and Hall.
Meadows, S. L., Gennings, C., Carter, W. H., Jr., and Bae, D.-S. (2002). Experimental designs for mixtures of chemicals along fixed ratio rays. Environ. Health Perspect. 110(Suppl. 6), 979983.[ISI][Medline]
Meadows-Shropshire, S. L., Gennings, C., and Carter, W. H., Jr. (2005). Sample size and power determination for detecting interactions in mixtures of chemicals. J. Agr. Biol. Environ. Stat. 10, 104117.[CrossRef][ISI]
Muller, K. E., and Benignus, V. A. (1992). Increasing scientific power with statistical power. Neurotoxicol. Teratol. 14, 211219.[CrossRef][ISI][Medline]
Muller, K. E., LaVange, L. M., Ramey, S. L., and Ramey, C. T. (1992). Power calculations for general linear multivariate models including repeated measures applications. J. Am. Stat. Assoc. 87, 12091226.[ISI]
Muller, K. E., Otto, D. A., and Benignus, V. A. (1983). Design and analysis issues and strategies in psychophysiological research. Psychophysiology 20, 212218.[ISI][Medline]
Myers, R. H., and Montgomery, D. C. (2002). Response Surface Methodology, pp. 393394. John Wiley & Sons: New York.
Myers, R. H., Khuri, A., and Carter, W. H., Jr. (1989). Response surface methodology: 19661988. Technometrics 31, 137157.[ISI]
Nelder, J. A., and Mead, R. (1965). A simplex method for function minimization. Comput. J. 7, 308313.[ISI]
Neter, J., Kutner, M. H., Nachtsheim, C. J., and Wasserman, W. (1996). Applied Linear Statistical Models, 4th edition. Chicago: The McGraw-Hill Companies, Inc.
SAS Institute, Inc. (1999). SAS/OR User's Guide: Mathematical Programming, Version 8 Edition. Cary, NC: SAS Institute, Inc.
Schwartz, P. F., Gennings, C., and Chinchilli, V. M. (1995). Threshold models for combination data from reproductive and developmental experiments. J. Am. Stat. Assoc. 90, 862870.[ISI]
Simmons, J. E. (1995). Chemical mixtures: Challenge for toxicology and risk assessment. Toxicology 105, 111119.[CrossRef][ISI][Medline]
Solana, R. P., Chinchilli, V. M., Carter, W. H., Jr., Wilson, J. D., and Carchman, R. A. (1987). The evaluation of biological interactions using response surface methodology. Cell Biol. Toxicol. 3, 263277.[CrossRef][ISI][Medline]
Slob, W., Moerbeek, M., Rauniomaa, E., and Piersma, A. H. (2005). A statistical evaluation of toxicity study designs for the estimation of the benchmark dose in continuous endpoints. Toxicol. Sci. 84, 167185.
USEPA (United States Environmental Protection Agency). (2000). Supplementary guidance for conducting health risk assessment of chemical mixtures. EPA/630/R-00/002.
Weller, E. A., Catalano, P. J., and Williams, P. L. (1995). Implications of developmental toxicity and study design for quantitative risk assessment. Risk Analysis 15, 567574.[ISI]
|