A Novel Use of Equilibrium Frequencies in Models of Sequence Evolution

Nick Goldman and Simon Whelan

Department of Zoology, University of Cambridge, U.K


    Abstract
 TOP
 Abstract
 Introduction
 Methods
 Results and Discussion
 Conclusions
 Acknowledgements
 References
 
Current mathematical models of amino acid sequence evolution are often applied in variants that match their expected amino acid frequencies to those observed in a data set under analysis. This has been achieved by setting the instantaneous rate of replacement of a residue i by another residue j proportional to the observed frequency of the resulting residue j. We describe a more general method that maintains the match between expected and observed frequencies but permits replacement rates to be proportional to the frequencies of both the replaced and resulting residues, raised to powers other than 1. Analysis of a database of amino acid alignments shows that the description of the evolutionary process in a majority (approximately 70% of 182 alignments) is significantly improved by use of the new method, and a variety of analyses indicate that parameter estimation with the new method is well-behaved. Improved evolutionary models increase our understanding of the process of molecular evolution and are often expected to lead to improved phylogenetic inferences, and so it seems justified to consider our new variants of existing standard models when performing evolutionary analyses of amino acid sequences. Similar methods can be used with nucleotide substitution models, but we have not found these to give corresponding significant improvements to our ability to describe the processes of nucleotide sequence evolution.


    Introduction
 TOP
 Abstract
 Introduction
 Methods
 Results and Discussion
 Conclusions
 Acknowledgements
 References
 
Research into better mathematical models of molecular sequence evolution continues to be of interest for many reasons. When a complex model gives a statistically significant improvement in fit to observed data compared with a simpler model, the biological factors corresponding to the additional complexity can be taken to be important in the process of evolution for those sequences. This increases our understanding of molecular evolution, and the models may be used to investigate these biological factors in greater detail than before. An example is the improved ability to detect molecular adaptation that has come from new models of selective pressures operating on DNA, reviewed by Yang and Bielawski (2000)Citation .

We may also expect more realistic models to give more reliable inference of biological factors they share with simpler models, for example phylogenetic topologies and branch lengths. This improvement could arise from their improved ability to account for factors that simpler models neglect and whose influence on observed data might otherwise be misinterpreted. This expectation has generally been confirmed by both theoretical results from simulation studies (e.g., Kuhner and Felsenstein 1994Citation ; Zhang 1999Citation ) and empirical results (e.g., Cunningham, Zhu, and Hillis 1998Citation ; Takezaki and Gojobori 1999Citation ; Philippe and Germot 2000Citation ; Yoder and Yang 2000Citation ), although Posada and Crandall (2001)Citation describe an interesting exception.

Much progress has recently been made with improving models of sequence evolution (reviewed, e.g., by Liò and Goldman 1998Citation ; Thorne 2000Citation ; Whelan, Liò, and Goldman 2001Citation ). This work relies on statistical tests that can compare competing models and diagnose their shortcomings (Felsenstein 1981Citation ; Goldman 1993a,Citation 1993b;Citation Yang, Goldman, and Friday 1994Citation ; Whelan and Goldman 1999Citation ; Goldman and Whelan 2000Citation ; Ota et al. 2000Citation ). Amino acid replacement models have been improved by the use of maximum likelihood (ML) methods to infer replacement rate parameters (Adachi and Hasegawa 1996Citation ; Yang, Nielsen, and Hasegawa 1998Citation ; Adachi et al. 2000Citation ; Whelan and Goldman 2001Citation ). Both amino acid replacement and DNA substitution models have been improved by the incorporation of amongst-site heterogeneity of evolutionary rate (Yang 1994a,Citation 1996Citation ). Codon-level models can now test for effects of selection on sequence evolution and permit detection of individual sites where selection acts (Nielsen and Yang 1998Citation ; Yang et al. 2000Citation ; Anisimova, Bielawski, and Yang 2001Citation ).

The expected frequencies of nucleotides, amino acids, or codons may be matched to those observed in the data under analysis. This generally leads to significantly improved models and has become widespread. For DNA models this has often led to the use of the FEL (Felsenstein 1981Citation ) and HKY (Hasegawa, Kishino, and Yano 1985Citation ) models in preference to the JC (Jukes and Cantor 1969Citation ) and K2P (Kimura 1980Citation ) models. For amino acid models, the same has been achieved by the "+F" method of Cao et al. (1994)Citation . For codon models, analogous methods were first described by Muse and Gaut (1994)Citation and Goldman and Yang (1994)Citation . All of these models achieve equality of the frequencies expected by the model and observed in the data by setting the instantaneous rates of evolutionary changes proportional to the observed frequency of the nucleotide, amino acid, or codon being changed to.

In this article, we describe a generalization of these approaches that allows evolutionary rates to be dependent on the frequency of the nucleotide, amino acid, or codon being replaced as well as on the frequency of the one that forms the replacement. This introduces just one additional parameter (or degree of freedom) to the model. We have applied the new method, denoted "+gwF," to models of DNA substitution and amino acid replacement and demonstrate that the new method gives a statistically significant improvement to the fit of models to data in a large proportion of the amino acid data sets in a database of protein family alignments. Our method is equally applicable to codon models, although we have not yet investigated its utility in this context.


    Methods
 TOP
 Abstract
 Introduction
 Methods
 Results and Discussion
 Conclusions
 Acknowledgements
 References
 
Existing Amino Acid Replacement Models
All models discussed in this article assume that amino acid sites in an alignment evolve independently and according to the same stationary, homogeneous, and reversible Markov process (Swofford et al. 1996Citation ; Liò and Goldman 1998Citation ). The probability of amino acid i being replaced by amino acid j after time t is denoted Pij(t), with i and j each representing one of the 20 different amino acids. These probabilities can be written as a 20 x 20 matrix that may be calculated as P(t) = exp(tQ), where Q is a matrix with off-diagonal elements qij being the instantaneous rates of change of amino acid i to amino acid j and diagonal elements qii being fixed so that the row sums of Q equal 0. The rate matrix Q may also be parameterized qij {equiv} {pi}jsij for all i != j. This identifies frequency parameters {pi}j that describe the equilibrium frequencies of the amino acids and parameters sij (sometimes called exchangeabilities: see, e.g., Whelan and Goldman 2001Citation ; Whelan, Liò, and Goldman 2001Citation ) that form a symmetric matrix (i.e., sij = sji). The matrix Q is scaled so that -{Sigma}i {pi}iqii = 1, causing evolutionary times to be measured in expected replacements per site; for clarity, we omit this scaling from our equations below. Estimation of Q from large sequence databases has led to various standard models of amino acid replacement. Examples derived from globular protein sequences include the Dayhoff (Dayhoff, Schwartz, and Orcutt 1978Citation ), JTT (Jones, Taylor, and Thornton 1992Citation ) and WAG (Whelan and Goldman 2001Citation ) models. We denote estimates from databases with a tilde; for example, ; ij {equiv} jij.

Typical applications of these models to phylogenetic inference from amino acid sequences combine the database estimates with information from the observed sequences using the +F method first described by Cao et al. (1994)Citation . This assumes that in the parameterization ij = jij the exchangeabilities ij are fundamental properties of the amino acids (i, j). In contrast, the frequencies j represent properties that depend on factors such as mutation bias, selective pressure (the relative advantage/disadvantage of different amino acids) and codon usage, which are assumed to differ from one protein sequence data set to another. As a consequence, the +F method proposes that during the analysis of a specific data set the fundamental properties described by the ij derived from a database analysis remain unaltered, but that the j, describing evolutionary pressures acting on the sequences, be replaced with a set of frequencies more appropriate to the data being analyzed. Denoting these frequencies {pi}j, this gives a rate matrix defined by the off-diagonal elements

that uses the values ij derived from a database yet ensures that the expected amino acid frequencies under the model match those of the data being analyzed. If the ij used are those of the JTT model, for example, then the model defined by equation (1) would be denoted JTT+F (i.e., JTT base model with +F method). The {pi}j are usually estimated by simply counting the residues of all the sequences under analysis to find the observed proportions of each amino acid, although they may also be estimated by ML (see also Whelan and Goldman 1999Citation ).

A New Generalization of Amino Acid Replacement Models
The parameterization in equation (1) and the +F method assume that the rate of change of amino acid i to amino acid j is proportional to {pi}j, the equilibrium frequency of j in the sequences under study, and to the exchangeability ij. There seems no reason why this parameterization, and its implicit assumption of the fundamental nature of the exchangeabilities ij, should be the only one considered. Other formulations exist that combine information derived from database analyses (embodied in estimates ) with observed amino acid frequencies in a manner that equates the expected and observed frequencies: for example, making the rate of change of i to j inversely proportional to {pi}i. In the former case, a low frequency of amino acid l (small {pi}l) is explained by there being only low rates of change to (or fixation of) l (qil {propto} {pi}l), perhaps reflecting a selective disadvantage of l. In the latter case it is explained by there being rapid mutation away from l (qlj {propto} 1/{pi}l), perhaps representing a high mutability of l. Both these factors seem biologically plausible.

We generalize the formulations given by Cao et al. (1994)Citation and above by proposing the parameterization


with the cij representing as-yet unknown proportionality constants. We impose two constraints on f, g and the cij. First, to use the information derived from database analyses, we require that if the observed frequencies {pi}j match the j from the database analysis then the rate matrices should also match (i.e., qij = ij). From equation (2) , this is achieved when cij = fi-gjij. Second, to ensure that this model has the required equilibrium distribution, qij/{pi}j must be symmetric in i and j. Noting the previous expression for cij and the fact that the ij/j are symmetric, this is achieved only if g = 1 - f. This leads to:


Because database estimates are often reported in terms of their frequencies and exchangeabilities j and ij, the following equivalent formulation may be useful:


We propose the suffix "+gwF" (generalized weighted Frequencies) to indicate use of the model of equation (3) . The +gwF formulation requires the estimation of amino acid frequencies for the observed data ({pi}j), as do +F models, and it includes one extra free parameter (f) that may generally take any value (but see below) and may be estimated by ML.

Occasionally, sequence alignments may be observed in which one or more amino acids do not appear; that is, {pi}z = 0 for some amino acid z. (We assume that this is never the case for the j because any reasonable database is expected to contain each amino acid at least once.) This causes no problem when f < 0, but equation (3) generates infinite rates of replacement of z (qzj) when f >= 0. Note, however, that the proportion of all replacements occurring that are from i to z is given by {pi}iqiz = ({pi}i{pi}z)1-ffif-1ziz. This equals 0 when 0 <= f <= 1: amino acid z never arises, and so the infinite values of qzj suggested by equation (3) can be replaced with arbitrary finite values without altering the probabilities P(t) necessary for likelihood calculations. If f > 1, amino acid z both arises and is replaced at an infinite rate: the new model is then meaningless in the context of sequence evolution. In effect, f must be <=1 when some observed amino acid frequencies equal zero.

When f = 0, equation (4) reduces to equation (1) and the +F method results. From equation (3) above, the dependency of the model on the observed data is then of the form qij {propto} {pi}j/j and data sets for which the estimate of f (denoted ) is near 0 may be considered to have replacements rates largely determined by factors dependent on the resulting residue j (e.g., mutation bias or selection acting on j). If f = 1 we have qij {propto} i/{pi}i, and data sets with near 1 may have replacement rates largely determined by factors dependent on the replaced residue i (e.g., its mutability). Other values of indicate the relative strength of these two types of factors. Intermediate values indicate a more even combination of both of these effects (e.g., f = 1/2 leads to qij {propto} ({pi}j/j)1/2(i/{pi}i)1/2). More extreme values indicate stronger tendencies for factors dependent on the resulting ( < 0) or replaced ( > 1) residue to determine replacements. The dependence of equation (3) on the terms ({pi}j/j)1-f and (i/{pi}i)f means that the most extreme values of f lead to replacements being dominated by interchanges between the amino acids that are commonest (when f << 0) or rarest (when f >> 1) in the data set under analysis relative to the database values. But we have observed no data sets where such very extreme estimates were found (see Results and Discussion, below).

If the sets of observed and database amino acid frequencies are equal (i.e., {pi}j = j for all j) then the +gwF model has no dependency on the parameter f (see eq. 3 ). Although this is improbable, there will be an effect of decreased dependency on f when the {pi}j are close to the j. We discuss some consequences of this effect below.

Application of Generalized Amino Acid Replacement Models
Application of the new models of amino acid replacement is via standard ML methods, as described by Swofford et al. (1996)Citation . No closed form solution of P(t) = exp(tQ) is generally available for equation (3) , and so spectral decomposition must be used (Liò and Goldman 1998Citation ). The amino acid frequencies j and the or exchangeability parameters ij for the standard Dayhoff, JTT, and WAG models are widely available. We estimate the amino acid frequencies {pi}j for each data set analyzed by counting the residues of the sequences. The parameter f of +gwF models is estimated by ML simultaneously with any other free parameters (branch lengths, etc.).

Our main aim here is to assess the utility of +gwF models, measured by any improvement to the statistical fit of models to observed data. We compare the +F and +gwF versions of the existing JTT and WAG models, each considered both without and with the addition of a discrete (four category) {Gamma} distribution (Yang 1994a,Citation 1996Citation ; denoted "+{Gamma}") to model heterogeneity of evolutionary rates amongst amino acid sites. This leads to a total of eight analyses for each aligned sequence family studied, with the most important comparisons being the following four:

Likelihood ratio tests (LRTs) can be performed to discover whether the additional parameter makes a statistically significant improvement to the fit of the model to observed data for these comparisons (Yang, Goldman, and Friday 1994Citation ; Huelsenbeck and Rannala 1997Citation ). As noted above, equation (1) is recovered from equation (4) when f = 0. This indicates that +F models are nested within the new +gwF models and differ by one degree of freedom. The test statistic of the difference in maximized log-likelihoods is compared with a {chi}21/2 distribution (Yang, Goldman, and Friday 1994Citation ; Whelan and Goldman 1999Citation ) and a value in excess of the 95%-point of this distribution ({chi}21,95%/2 = 1.92) indicates the rejection of the simpler (+F) model in favor of the more complex (+gwF) model.

An asymptotically equivalent test of the significance of the +gwF model is to estimate a confidence interval (CI) for the parameter f and see if that CI excludes 0, the value of f at which the +gwF model reduces to the +F form. The required CI can be estimated by the curvature method (Kendall and Stuart 1979Citation , pp. 45–49; Yang, Goldman, and Friday 1995Citation ).

A New Generalization of Nucleotide Substitution Models
For models of nucleotide substitution, standard parameters ij or j and ij have not been derived from large databases. Instead, ij have often been taken to equal 1 for all substitutions, or else taken to equal {kappa} (an unknown parameter, often to be estimated from observed data) when the substitution i to j is a transition (A {leftrightarrow} G, C {leftrightarrow} T) and 1 otherwise (transversions A, G {leftrightarrow} C, T). These exchangeability parameters have been used either without consideration of observed {pi}j (effectively setting {pi}j = 1/4 for all j), as in the models JC (Jukes and Cantor 1969Citation ) and K2P (Kimura 1980Citation ), or with the {pi}j estimated from the observed sequences, as in the models FEL (Felsenstein 1981Citation ) and HKY (Hasegawa, Kishino, and Yano 1985Citation ). Following the notation used for amino acid models, we note that the nucleotide models FEL and HKY might equally be denoted JC+F and K2P+F, respectively.

Development of +gwF models for nucleotide substitution follows the same arguments as for amino acid replacement models. In the absence of nucleotide frequency values from databases, we set j = 1/4 for all j. Because this is a constant and all rates qij are ultimately scaled so that the mean rate of evolution is 1, for clarity we can omit the j and the scaling factor from our equations. Using ij = 1 for all nucleotides i and j we get a generalized version of the JC model, denoted JC+gwF, defined by


This reduces to the FEL (JC+F) model when f = 0. Alternatively, we can derive a generalized version of the K2P model, denoted K2P+gwF, defined by


This reduces to the HKY (K2P+F) model when f = 0. The case of {pi}z = 0 is ignored because it is unlikely to arise for realistic data sets. Application of these models is again by standard ML methods, with the new parameter f estimated by ML simultaneously with branch lengths and other parameters of the substitution model (e.g., {kappa} in eq. 6 ).

Utility of the new models in terms of any improved fit to observed data may be assessed via the following comparisons:

Note that the general time reversible model for DNA substitution (REV; Yang 1994bCitation ) is more complex than other existing models and subsumes the +gwF models described here. It is of interest to see whether this extra complexity is justified relative to the K2P+gwF model. All the above comparisons are between nested models and can be assessed using LRTs with test statistics based on a {chi}21 distribution (all FEL vs. JC+gwF and HKY vs. K2P+gwF comparisons, with or without +{Gamma}) or a {chi}23 distribution (all K2P+gwF vs. REV comparisons).

Data Used for Investigating New Models
To investigate the performance of the new +gwF models of amino acid replacement, we analyzed multiple sequence alignments from the BRKALN database (D. Jones, personal communication). Our working version of this database contains 182 aligned protein families, totaling 3,905 sequences. These data have previously been used to estimate the WAG model of amino acid replacement (Whelan and Goldman 2001Citation ) and amino acid replacement models specific to different protein secondary structures (Thorne, Goldman, and Jones 1996Citation ; Goldman, Thorne, and Jones 1998Citation ). For each alignment in our database only one, previously established, topology was considered; see Whelan and Goldman (2001)Citation for details of how these topologies were derived. Although there are likely to be some suboptimal topologies amongst those used, we expect that on the whole the topologies are optimal or near optimal and no systematic errors or biassing of results will occur (see also Whelan and Goldman 2001Citation ).

Investigation of the performance of +gwF models of nucleotide substitution used two data sets: the well-known 895-bp alignment of mtDNA sequences of five primates (Brown et al. 1982Citation ), and an alignment of 2000 bp from the gag and pol genes of six isolates of HIV-1 (Goldman, Anderson, and Rodrigo 2000Citation ).


    Results and Discussion
 TOP
 Abstract
 Introduction
 Methods
 Results and Discussion
 Conclusions
 Acknowledgements
 References
 
Generalized Amino Acid Replacement Models
Likelihoods and Fit of Models to Data
Figure 1 shows the log-likelihood surface for an alignment of catalase sequences, one of the families of our database, under the WAG+gwF+{Gamma} model (log-likelihood maximized over branch lengths for the single topology studied, as a function of parameters f and {alpha} of the +gwF and +{Gamma} components, respectively). The log-likelihood surfaces for all analyses performed were generally similarly well-behaved (e.g., smooth, no strong correlation between parameters, easily identified maxima) and posed few difficulties for finding ML values and parameter estimates. Some care had to be used when parameter estimates were near to their boundaries (e.g., {alpha} -> {infty}, or f {approx} 1 when some {pi}z = 0). An animated version of figure 1 can be viewed at http://www.ebi.ac.uk/goldman/publs/gwF.html, as can an animation illustrating how the instantaneous rate matrix Q and the log-likelihood vary with f.



View larger version (60K):
[in this window]
[in a new window]
 
Fig. 1.—Typical log-likelihood surface. The surface shows the log-likelihood value maximized over branch lengths and as a function of parameters f and {alpha} for the WAG+gwF+{Gamma} model applied to an alignment of 29 catalase sequences. The global maximum, log L = -17329.68 occurring when f = 0.72, {alpha} = 0.93, is indicated and the contours and maximum point are also projected onto the (f, {alpha})-plane

 
Table 1 , rows A–D, summarize the results of four model comparisons (described above) designed to show the utility of the +gwF method and applied to each of the 182 alignments in our database. In each comparison, it is evident that the +gwF models have an improved fit to the observed data for the majority of the alignments, with statistically significant improvements in approximately 70% of cases.


View this table:
[in this window]
[in a new window]
 
Table 1 Summary of Numbers of Cases for Which +gwF Models of Amino Acid Replacement are Significantly Better than +F Models Under Different Testing Scenarios

 
In a typical analysis it is likely that the choice of evolutionary model (e.g., JTT or WAG, +F or +gwF, no rate heterogeneity or +{Gamma}) will be made with reference to the data, and not predetermined as with the comparisons above. For this reason, we also considered the following more realistic and commonly used model selection scenarios:

Scenario G probably most resembles a typical phylogenetic analysis. Summaries of the results of applying scenarios E–G to each of our 182 alignments are given in table 1 . We still see the +gwF models giving a significant improvement over their +F versions in the final stage of each scenario in approximately 70% of cases. Of the 182 alignments studied, 116 show the +gwF model giving a significant improvement in the fit of evolutionary model to observed data in every one of the seven LRT comparisons A–G.


View this table:
[in this window]
[in a new window]
 
Table 2 Likelihood Ratio Tests of +gwF Models of DNA Substitution

 
When the CI procedure is followed for assessing the significance of comparisons A–D and G, the results correlate very well with those already described (see table 1 ). The +gwF model is significantly better than +F for almost the same sets of families when assessed by the LRT or CI methods. All the results of LRTs and CI tests indicate that assessment of the improvement of +gwF models over +F models is not strongly affected by other components (e.g., base model JTT or WAG; no rate heterogeneity or +{Gamma}) of the models used.

We also note that in comparison G, 142 out of the 182 alignments (78.0%) lead to a model based on the WAG standard model being preferred, reinforcing evidence suggesting that WAG is a useful alternative to JTT (Whelan and Goldman 2001Citation ).

Figure 2 shows the relationship between the improvements in log-likelihood ({Delta}log L) and for comparison B of table 1 , and the distribution of over 182 sequence alignments under the JTT+gwF+{Gamma} model. This plot is typical of those obtained for any of the comparisons and models described in this article. Recall that when = 0, +gwF reduces to +F and {Delta}log L = 0 necessarily. In figure 2 the distinction is made between cases when the +gwF model is statistically preferred to +F according to the LRT, and cases where it is not (i.e., whether or not {Delta}log L > 1.92). Over the 182 alignments studied, and for whichever +gwF model is used, we find that the statistically significant inferred values of are in the main distributed between 0.25 and 1.5, with a peak around 0.6 (e.g., under the best +gwF model as selected by scenario G above, the distribution of values of significantly different from 0 has mean = 0.69, median = 0.64, standard deviation (SD) 0.42, interquartile range = 0.26).



View larger version (28K):
[in this window]
[in a new window]
 
Fig. 2.—Log-likelihood improvements ({Delta}log L) and the distribution of optimal values for the JTT+gwF+{Gamma} model (table 1 , row B). The upper part of the graph shows how {Delta}log L and are related for each of the 182 alignments in our database. Solid points are used for cases where the JTT+gwF+{Gamma} model is significantly better than JTT+F+{Gamma} according to the LRT; open points are used for cases where it is not. The inset is an expanded version of the most densely populated area of the plot. The lower part of the graph shows the distribution of estimates , with significant cases plotted in black and nonsignificant cases in white. The distribution for the significant cases has mean = 0.83, median = 0.69, SD = 1.30, interquartile range = 0.39

 
Although a number of values of shown in figure 2 are <0, notice that only one such is statistically significant ( = -2.36 with {Delta}log L = 2.09)—this is the only statistically significant < 0 under any model studied in this article, according to a LRT. No values of < 0 are significant according to the CI test.

As noted above, if the observed {pi}j values are close to the database values j then the dependency of +gwF models on f is reduced. Measuring the similarity of the {pi}j and j by the G statistic of the LRT test of the goodness-of-fit of the {pi}j to the j (Sokal and Rohlf 1994Citation , p. 690; G = 0 when {pi}j = j for all j, and increasing values of G indicate decreasing similarity), we find no correlations between G and estimates but negative correlations between G and the widths of CIs for f (results not shown). This demonstrates that similarity of the {pi}j and j has no biassing effect on estimates of f, but reduces the information available about f (e.g., making it harder to reject the null hypothesis f = 0).

Behavior of +gwF Models
The statistical tests described above indicate that +gwF models of amino acid sequence evolution give significant improvements in many cases. It is also interesting to see if the parameter f is "well-behaved." If so, this is a further indication that the new model is accurately reflecting a biological feature of sequence evolution and not simply improving the fit of model to data by the addition of a meaningless parameter to a poor model. We performed various analyses to investigate this.

Figure 3A shows the correlation of estimates derived from the 182 alignments in our database under the WAG+gwF and WAG+gwF+{Gamma} models and distinguishes the cases where neither, one, or both of these models give a significant improvement over their respective +F versions. The estimates are generally approximately the same under the two models, and the correlation is high (for the 121 alignments for which WAG+gwF and WAG+gwF+{Gamma} are significantly better than WAG+F and WAG+F+{Gamma}, respectively, Spearman's rank correlation coefficient {rho} = 0.87, P < 0.001). Figure 3B illustrates the same effect in the comparison of the JTT+gwF and WAG+gwF models. Here, the estimates are less closely related ({rho} = 0.67, P < 0.001, for the 119 cases in which JTT+gwF and WAG+gwF are significantly better than JTT+F and WAG+F, respectively) and it appears that choice of base model has a greater effect on inferred values than does inclusion of +{Gamma}. Nevertheless, estimates of f are clearly not strongly affected by either the base model or other components of the model used.



View larger version (21K):
[in this window]
[in a new window]
 
Fig. 3.—Correlation of estimates under different +gwF models. A, comparison of estimated under WAG+gwF and WAG+gwF+{Gamma} models. Cases distinguished are: {circ}, neither model significantly better than its +F version; x, WAG+gwF significantly better than WAG+F; +, WAG+gwF+{Gamma} significantly better than WAG+F+{Gamma}; •, both models significantly better than their +F versions. B, comparison of estimated under JTT+gwF and WAG+gwF models. Cases distinguished are: {circ}, neither model significantly better than its +F version; x, JTT+gwF significantly better than JTT+F; +, WAG+gwF significantly better than WAG+F; •, both models significantly better than their +F versions

 
The interaction of the +gwF and other components of evolutionary models can also be assessed by looking at the relative improvements in likelihood when one component (e.g., +gwF) is added either with or without another component (e.g., +{Gamma}) already present. If the components are capturing information on entirely independent factors in sequence evolution, the changes in likelihood due to the incorporation of each component will be independent. We investigated the increase in likelihood caused by the replacement of +F by +gwF and the incorporation of +{Gamma}, each either with or without the other already being applied. For example, figure 4A plots the relationship between {Delta}log L(WAG±gwF) (defined as log L(WAG+gwF) - log L(WAG+F)) and {Delta}log L(WAG±gwF+{Gamma}) (defined as log L(WAG+gwF+{Gamma}) - log L(WAG+F+{Gamma})) for the 182 sequence alignments in our database. This shows how the use of +{Gamma} affects the increase in likelihood afforded by the use of +gwF when using the WAG base model. We see there is a good correlation between the log-likelihood differences ({rho} = 0.98, P < 0.001), indicating that in general +gwF and +{Gamma} are responding independently to different evolutionary signals in the data. For the larger improvements, note that the log-likelihood improvement gained from using +gwF tends to be greater in the absence of +{Gamma} than with it (i.e., points fall below the 45° line). This nonindependence may be because without +{Gamma}, +gwF may also be able to adapt the evolutionary model to represent some of the effects of rate heterogeneity, whereas with +{Gamma} implemented these effects are accounted for elsewhere and are not picked up by +gwF.



View larger version (42K):
[in this window]
[in a new window]
 
Fig. 4.—Effects of other model components on likelihood improvements afforded by +gwF and +{Gamma}. Insets are expanded versions of the most densely populated areas of the plot. A, effect of +{Gamma} on likelihood improvement given by +gwF with WAG base model. B, effect of +gwF on likelihood improvement given by +{Gamma} with WAG base model. C, effect of choice of base model on likelihood improvement given by +gwF. D, effect of +{Gamma} and choice of base model on likelihood improvement given by +gwF

 
Conversely, figure 4B plots the relationship between {Delta}log L(WAG+F±{Gamma}) (defined as log L(WAG+F+{Gamma}) - log L(WAG+F)) and {Delta}log L(WAG+gwF±{Gamma}) (defined as log L(WAG+gwF+{Gamma}) - log L(WAG+gwF)). This shows how the use of +gwF affects the increase in likelihood afforded by the use of +{Gamma} when using the WAG base model. Note again the very high correlation ({rho} = 1.00, P < 0.001) and adherence to the 45° line, confirming that these two model components are largely independent.

Choice of base model has a greater effect on the improvement in likelihood afforded by the +gwF method. This is illustrated by comparing {Delta}log L(JTT±gwF) and {Delta}log L(WAG±gwF), (fig. 4C ) and {Delta}log L(JTT±gwF +{Gamma}) and {Delta}log L(WAG±gwF+{Gamma}) (fig. 4D ). Note that the correlations, though lower, are still highly significant (both have {rho} = 0.93, P < 0.001). These plots also show a tendency for points to fall below the 45° line, indicating that greater improvements in likelihoods tend to be obtained with the JTT base model than with WAG. This may be because of the superiority of WAG over JTT for the majority of alignments in our database (see above and Whelan and Goldman 2000), leading to a greater scope for +gwF to deliver improvements in likelihoods under JTT than under WAG.

We also investigated the effect the use of +gwF has on estimates of the parameter {alpha} of the {Gamma} distribution that describes heterogeneity of evolutionary rates amongst sequence sites. Figure 5A illustrates this with a comparison of values estimated under the WAG+F+{Gamma} and WAG+gwF+{Gamma} models. These are shown for the 133 alignments in our database for which the WAG+gwF+{Gamma} model is significantly better than the WAG+gwF model—in other words, alignments for which there is reasonable evidence that +{Gamma} is contributing to an improved fit of evolutionary model to observed data. We see a very high correlation of estimates ({rho} = 0.97, P < 0.001), with the estimates being almost equal under the two models for most data sets. This also confirms that the +gwF and +{Gamma} components of evolutionary models are broadly independent, with no awkward interactions between them suggesting any weaknesses in their joint use.



View larger version (17K):
[in this window]
[in a new window]
 
Fig. 5.—Estimates of the parameter {alpha} of the {Gamma} distribution used to model rate heterogeneity. A, comparison of estimates under WAG+F+{Gamma} and WAG+gwF+{Gamma} models. B, distribution of estimates from 133 amino acid sequence alignments that indicate significant rate heterogeneity. See text for further details. The distribution has mean = 1.31, median = 1.25, SD = 0.61, interquartile range = 0.62

 
Heterogeneity of Evolutionary Rate Within Amino Acid Sequences
Many studies have used a {Gamma} distribution to study heterogeneity of evolutionary rates amongst the sites of DNA sequences (see Yang 1996Citation ). When these models are used for the evolutionary analysis of protein-coding DNA sequences it is generally assumed that rate heterogeneity is due to the genetic code affecting the conservativeness of different nucleotide substitutions at different codon positions and selection for protein function. {Gamma} distributions, now modeling simply selection for function, are also often found to improve the statistical fit of evolutionary models to amino acid sequence data. We know of no compilations of estimates of {alpha} obtained in amino acid sequence studies, and so it is of interest to look at the distribution of values we obtain from our database. This is shown in figure 5B, which is derived from the 133 families in our database for which the optimum model defined by scenario G above includes a {Gamma} distribution. We note an approximately bell-shaped distribution, with its upper tail somewhat elongated, and find in general that the estimates of {alpha} are higher than are often found for DNA sequence alignments (see Yang 1996Citation for a compilation of values estimated from DNA). This indicates lower levels of rate heterogeneity among amino acid positions of protein sequences than among the sites of nucleotide sequences, as would be expected from the biological interpretations above.

Effects on Branch Length Estimates
Our primary interest so far has been to see if the new +gwF method is able to improve the fit of evolutionary model to observed data. To investigate the potential of +gwF for improving phylogenetic inferences, we studied its effect on inferred branch lengths. For almost all families in our database, branch length estimates were only very slightly affected by the addition of the +gwF method to the JTT or WAG base model (results not shown). The implications of this finding are discussed below.

Generalized Nucleotide Replacement Models
Table 2 shows the results of various LRTs involving the +gwF method for the mtDNA and HIV-1 data sets described above. Qualitatively equivalent results are obtained whether or not the models tested include the +{Gamma} option (i.e., top/bottom half of table 2 ). For the mtDNA sequences, the +gwF models do not give a significant improvement over their corresponding +F versions. For the HIV-1 sequences, the K2P+gwF and K2P+gwF+{Gamma} models do lead to significant improvements over the HKY and HKY+{Gamma} substitution models, respectively. In both cases, however, the corresponding REV models are significantly better still.

Consequently, neither the mtDNA or HIV-1 data set gives an example of a case in which a +gwF model would be statistically the best description of the sequences' evolution. For this case to arise we need, for example, a data set where K2P+gwF+{Gamma} is preferred to HKY+{Gamma} and where REV+{Gamma} is not significantly better than K2P+gwF+{Gamma}.

Our use of j = 1/4 for all nucleotides j may be one of the reasons that the +gwF nucleotide substitution models do not perform well. Whereas for the amino acid models the effect of the database values j is to incorporate information on an underlying distribution of amino acids common to all protein sequences, we have not yet included equivalent information into the nucleotide models. Perhaps in future the estimation of j from large nucleotide databases, and indeed the (empirical) estimation of to derive replacements for the commonly used (parametrically inspired) values of 1 or {kappa} for sij, will lead to greater success. Because the +gwF models of nucleotide substitution are subsumed by the REV model, which it is computationally feasible to optimize for most data sets, it is not clear that the +gwF models will ever offer any important advantage.


    Conclusions
 TOP
 Abstract
 Introduction
 Methods
 Results and Discussion
 Conclusions
 Acknowledgements
 References
 
We have shown that the new +gwF versions of two standard amino acid replacement models lead to a significantly improved fit to observed data in approximately 70% of 182 multiple sequence alignments analyzed. Evidently it can be useful to use both database-derived amino acid frequencies (j) and data-derived frequencies ({pi}j) in the more general manner indicated in equations (2)–(4) . The assumptions of the fundamental nature of the exchangeabilities ij and that rates of replacement be linearly proportional to the (observed) {pi}j are not necessarily correct.

All the analyses performed indicate that inference under +gwF amino acid models is well-behaved, with no undue interactions between the new parameter f and other parameters and having stability with respect to other variations in models. This suggests that the +gwF models are reacting to evolutionary information in aligned sequence data sets that is not detected by existing models. Various analyses of CIs for and likelihood scores show that f may be reliably estimated for a range of data sets representative of those used in typical phylogenetic studies.

In the expectation that improved evolutionary models may lead to improved understanding of the process of evolution, it seems justified to recommend that +gwF versions of the Dayhoff (Dayhoff, Schwartz, and Orcutt 1978Citation ), JTT (Jones, Taylor, and Thornton 1992Citation ) and WAG (Whelan and Goldman 2001Citation ) models be considered when analyzing amino acid sequences. The same recommendation can also be extended to replacement models derived specifically for mitochondrial (Adachi and Hasegawa 1996Citation ; Yang, Nielsen, and Hasegawa 1998Citation ) and chloroplast (Adachi et al. 2000Citation ) amino acid sequences. Given an inferred value of for a particular data set we may now make an inference about the relative importance of selective or mutational forces acting on that protein, as described in the Methods section above.

We have not yet implemented the +gwF method within any codon models of sequence evolution (e.g., Goldman and Yang 1994Citation ; Muse and Gaut 1994Citation ; Nielsen and Yang 1998Citation ; Yang et al. 2000Citation ). These are effectively +F models, with instantaneous rates of codon substitutions typically being proportional to frequencies of replacing codons, estimated either (1) directly from the observed frequencies of each of the sense codons or (2) from the products of the observed frequencies of each nucleotide at each codon position. We also note that these models disallow instantaneous changes of more than one nucleotide within a codon, meaning that observed changes of two or more nucleotides within one codon have to be assumed to take place only via one or more intermediate codons. If these intermediates are rarely observed (in case (1) above), or consist of a combination of nucleotides rarely observed at those codon positions (in case (2) above), the observed changes are deemed virtually impossible by the model despite their perhaps common occurrence in a data set. This could lead to a poor fit of evolutionary model to observed data, misinterpretation of the evolutionary signal in a data set, and inaccurate phylogenetic inferences. These effects could be more pronounced in cases of unusual or extreme codon usage. In contrast, +gwF models could allow codon substitution rates to be inversely related to observed codon frequencies (cf. eq. 3 above with f > 0) and so could explain observed changes of two or three nucleotides within a codon by permitting the appearance and then rapid loss of the necessary but rarely observed intermediates. Future work will investigate the utility of codon models incorporating the +gwF method.

Because of the large scale of the analyses we have performed, only one topology could be considered for each amino acid sequence alignment in our database. Consequently, it has not been possible to study the effect the new models have on inferred topologies. The analysis we have reported of branch length estimates under different models does not lead us to expect systematic changes in branch length estimates or different inferred topologies. Until such indications are found, the new +gwF models seem to be contributing mostly to improved fit of models to data and thus to our understanding of the processes and patterns of amino acid sequence evolution.


    Acknowledgements
 TOP
 Abstract
 Introduction
 Methods
 Results and Discussion
 Conclusions
 Acknowledgements
 References
 
The authors are supported by the Wellcome Trust. We thank two anonymous referees for comments that inspired substantial improvements to the article.


    Footnotes
 
Manolo Gouy, Reviewing Editor

Keywords: amino acid frequencies Markov process models model comparison molecular phylogenetics nucleotide frequencies Back

Address for correspondence and reprints: Nick Goldman, EMBL-European Bioinformatics Institute, Wellcome Trust Genome Campus, Hinxton, Cambridge CB10 1SD, U.K. goldman{at}ebi.ac.uk . Back


    References
 TOP
 Abstract
 Introduction
 Methods
 Results and Discussion
 Conclusions
 Acknowledgements
 References
 

    Adachi J., M. Hasegawa, 1996 Model of amino acid substitution in proteins encoded by mitochondrial DNA J. Mol. Evol 42:459-468[ISI][Medline]

    Adachi J., P. J. Waddell, W. Martin, M. Hasegawa, 2000 Plastid genome phylogeny and a model of amino acid substitution for proteins encoded by chloroplast DNA J. Mol. Evol 50:348-358[ISI][Medline]

    Anisimova M., J. P. Bielawski, Z. Yang, 2001 Accuracy and power of the likelihood ratio test in detecting adaptive molecular evolution Mol. Biol. Evol 18:1585-1592[Abstract/Free Full Text]

    Brown W. M., E. M. Prager, A. Wang, A. C. Wilson, 1982 Mitochondrial DNA sequences of primates: tempo and mode of evolution J. Mol. Evol 18:225-239.[ISI][Medline]

    Cao Y., J. Adachi, A. Janke, S. Pääbo, M. Hasegawa, 1994 Phylogenetic relationships among eutherian orders estimated from inferred sequences of mitochondrial proteins: instability of a tree based on a single gene J. Mol. Evol 39:519-527[ISI][Medline]

    Cunningham C. W., H. Zhu, D. M. Hillis, 1998 Best-fit maximum-likelihood models for phylogenetic inference: empirical tests with known phylogenies Evolution 52:978-987[ISI]

    Dayhoff M. O., R. M. Schwartz, B. C. Orcutt, 1978 A model of evolutionary change in proteins Pp. 345–352 in M. O. Dayhoff, ed. Atlas of protein sequence and structure, Vol. 5, Suppl. 3. National Biomedical Research Foundation, Washington, DC

    Felsenstein J., 1981 Evolutionary trees from DNA sequences: a maximum likelihood approach J. Mol. Evol 17:368-376[ISI][Medline]

    Goldman N., 1993a. Simple diagnostic statistical tests of models for DNA substitution J. Mol. Evol 37:650-661[ISI][Medline]

    ———. 1993b. Statistical tests of models of DNA substitution J. Mol. Evol 36:182-198[ISI][Medline]

    Goldman N., J. P. Anderson, A. G. Rodrigo, 2000 Likelihood-based tests of topologies in phylogenetics Syst. Biol 49:652-670[ISI][Medline]

    Goldman N., J. L. Thorne, D. T. Jones, 1998 Assessing the impact of secondary structure and solvent accessibility on protein evolution Genetics 149:445-458[Abstract/Free Full Text]

    Goldman N., S. Whelan, 2000 Statistical tests of gamma-distributed rate heterogeneity in models of sequence evolution in phylogenetics Mol. Biol. Evol 17:975-978[Free Full Text]

    Goldman N., Z. Yang, 1994 A codon-based model of nucleotide substitution for protein-coding DNA sequences Mol. Biol. Evol 11:725-736[Abstract/Free Full Text]

    Hasegawa M., H. Kishino, T. Yano, 1985 Dating of the human-ape splitting by a molecular clock of mitochondrial DNA J. Mol. Evol 22:160-174[ISI][Medline]

    Huelsenbeck J. P., B. Rannala, 1997 Phylogenetic methods come of age: testing hypotheses in an evolutionary context Science 276:227-232[Abstract/Free Full Text]

    Jones D. T., W. R. Taylor, J. M. Thornton, 1992 The rapid generation of mutation data matrices from protein sequences CABIOS 8:275-282[Abstract]

    Jukes T. H., C. R. Cantor, 1969 Evolution of protein molecules Pp. 21–132 in H. N. Munro, ed. Mammalian protein metabolism, Vol. 3. Academic Press, New York

    Kendall M., A. Stuart, 1979 The advanced theory of statistics. 4th edition. Vol. 2 Charles Griffin, London

    Kimura M., 1980 A simple method for estimating evolutionary rates of base substitutions through comparative studies of nucleotide sequences J. Mol. Evol 16:111-120[ISI][Medline]

    Kuhner M. K., J. Felsenstein, 1994 A simulation comparison of phylogeny algorithms under equal and unequal evolutionary rates Mol. Biol. Evol 11:459-468 (see also: Erratum. Mol. Biol. Evol. 12:525 [1995]) [Abstract]

    Liò P., N. Goldman, 1998 Models of molecular evolution and phylogeny Genome Res 8:1233-1244[Abstract/Free Full Text]

    Muse S. V., B. S. Gaut, 1994 A likelihood approach for comparing synonymous and nonsynonymous nucleotide substitution rates, with application to the chloroplast genome Mol. Biol. Evol 11:715-724[Abstract/Free Full Text]

    Nielsen R., Z. Yang, 1998 Likelihood models for detecting positively selected amino acid sites and applications to the HIV-1 envelope gene Genetics 148:929-936[Abstract/Free Full Text]

    Ota R., P. J. Waddell, M. Hasegawa, H. Shimodaira, H. Kishino, 2000 Appropriate likelihood ratio tests and marginal distributions for evolutionary tree models with constraints on parameters Mol. Biol. Evol 17:798-804[Abstract/Free Full Text]

    Philippe H., A. Germot, 2000 Phylogeny of eukaryotes based on ribosomal RNA: long-branch attraction and models of sequence evolution Mol. Biol. Evol 17:830-834[Free Full Text]

    Posada D., K. A. Crandall, 2001 Simple (wrong) models for complex trees: a case from the Retroviridae Mol. Biol. Evol 18:271-275[Free Full Text]

    Sokal R. R., F. J. Rohlf, 1994 Biometry. 3rd edition W. H. Freeman and Co., New York

    Swofford D. L., G. J. Olsen, P. J. Waddell, D. M. Hillis, 1996 Phylogenetic inference Pp. 407–514 in D. M. Hillis, C. Moritz, and B. K. Mable, eds. Molecular systematics. Sinauer, Sunderland, Mass

    Takezaki N., T. Gojobori, 1999 Correct and incorrect vertebrate phylogenies obtained by the entire mitocohndrial DNA sequences Mol. Biol. Evol 16:590-601[Abstract]

    Thorne J. L., 2000 Models of protein sequence evolution and their applications Curr. Opin. Genet. Dev 10:602-605[ISI][Medline]

    Thorne J. L., N. Goldman, D. T. Jones, 1996 Combining protein evolution and secondary structure Mol. Biol. Evol 13:666-673[Abstract]

    Whelan S., N. Goldman, 1999 Distributions of statistics used for the comparison of models of sequence evolution in phylogenetics Mol. Biol. Evol 16:1292-1299[Free Full Text]

    ———. 2001 A general empirical model of protein evolution derived from multiple protein families using a maximum-likelihood approach Mol. Biol. Evol 18:691-699[Abstract/Free Full Text]

    Whelan S., P. Liò, N. Goldman, 2001 Molecular phylogenetics: state of the art methods for looking into the past Trends Genet 17:262-272[ISI][Medline]

    Yang Z., 1994a. Maximum likelihood phylogenetic estimation from DNA sequences with variable rates over sites: approximate methods J. Mol. Evol 39:306-314[ISI][Medline]

    ———. 1994b. Estimating the pattern of nucleotide substitution J. Mol. Evol 39:105-111[ISI][Medline]

    ———. 1996 Among-site rate variation and its impact on phylogenetic analysis TREE 11:367-372

    Yang Z., J. P. Bielawski, 2000 Statistical methods for detecting molecular adaptation TREE 15:496-503[Medline]

    Yang Z., N. Goldman, A. Friday, 1994 Comparison of models for nucleotide substitution used in maximum-likelihood phylogenetic estimation Mol. Biol. Evol 11:316-324[Abstract]

    ———. 1995 Maximum likelihood trees from DNA sequences: a peculiar statistical estimation problem Syst. Biol 44:384-399[ISI]

    Yang Z., R. Nielsen, N. Goldman, A.-M. K. Pedersen, 2000 Codon-substitution models for heterogeneous selection pressure at amino acid sites Genetics 155:431-449[Abstract/Free Full Text]

    Yang Z., R. Nielsen, M. Hasegawa, 1998 Models of amino acid substitution and applications to mitochondrial protein evolution Mol. Biol. Evol 15:1600-1611[Abstract/Free Full Text]

    Yoder A. D., Z. Yang, 2000 Estimation of primate speciation dates using local molecular clocks Mol. Biol. Evol 17:1081-1090[Abstract/Free Full Text]

    Zhang J., 1999 Performance of likelihood ratio tests of evolutionary hypotheses under inadequate substitution models Mol. Biol. Evol 16:868-875[Abstract]

Accepted for publication June 2, 2002.