##
**Coalescence in a random background.**
*(English)*
Zbl 1060.60100

A single genetic locus which carries two alleles labelled \(P\) and \(Q\) is considered. For the Wright-Fisher model a system of algebraic equations is given for the probabilities of identity in state for a sample of size two from such a population. In order to obtain the diffusion approximation it is convenient to work with the continuous time counterpart of the Wright-Fisher model, the Moran model. For such a model, assuming that the frequencies of the selected alleles, \(P\) and \(Q\), have reached stationarity, it is written the generator of the process that encodes the backward in time evolution of the selected allele frequencies and the numbers of ancestors of the sample of neutral alleles alive at time \(t\) before the present, labeled according to their background (\(P\) or \(Q\)). The parameters of the model are rescaled and the form of the generator of the corresponding diffusion appraximation is established. Also the existence of a stochastic process with this generator and convergence of the rescaled processes to this limit are established. A system of differential equations for the distribution of coalescence times and hence, for the probability of identity in state in a sample of size two, is written. An iterative solution to the system is established. The extension to larger samples and more complex genetic backgrounds is indicated. Also, numerical examples are presented that illustrate the accuracy and predictions of the diffusion approximation.

Reviewer: Utkir Rozikov (Tashkent)

### MSC:

60K37 | Processes in random environments |

60J60 | Diffusion processes |

60J70 | Applications of Brownian motions and diffusion theory (population genetics, absorption problems, etc.) |

60J80 | Branching processes (Galton-Watson, birth-and-death, etc.) |

60J85 | Applications of branching processes |

60K35 | Interacting random processes; statistical mechanics type models; percolation theory |

PDF
BibTeX
XML
Cite

\textit{N. H. Barton} et al., Ann. Appl. Probab. 14, No. 2, 754--785 (2004; Zbl 1060.60100)

### References:

[1] | Barton, N. H., Depaulis, F. and Etheridge, A. M. (2002). Neutral evolution in spatially continuous populations. Theoretical Population Biology 61 31–48. · Zbl 1038.92028 |

[2] | Barton, N. H. and Etheridge, A. M. (2004). The effect of selection on the distribution of coalescence times. Genetics . · Zbl 1060.60100 |

[3] | Barton, N. H. and Navarro, A. (2002). Extending the coalescent to multilocus systems: The case of balancing selection. Genetical Research 79 129–139. |

[4] | Darden, T., Kaplan, N. L. and Hudson, R. B. (1989). A numerical method for calculating moments of coalescent times in finite populations with selection. J. Math. Biol. 27 355–368. · Zbl 0715.92012 |

[5] | Donnelly, P. J. and Kurtz, T. G. (1999). Genealogical processes for Fleming–Viot models with selection and recombination. Ann. Appl. Probab. 9 1091–1148. · Zbl 0964.60075 |

[6] | Ethier, S. N. and Kurtz, T. G. (1986). Markov Processes: Characterization and Convergence . Wiley, New York. · Zbl 0592.60049 |

[7] | Feller, W. M. (1966). An Introduction to Probability Theory 2 . Wiley, New York. · Zbl 0138.10207 |

[8] | Herbots, H. M. (1997). The structured coalescent. In Progress of Population Genetics and Human Evolution (P. Donnelly and S. Tavare, eds.) 231–255. Springer, New York. · Zbl 0907.92018 |

[9] | Kaplan, N. L., Darden, T. and Hudson, R. B. (1988). The coalescent process in models with selection. Genetics 120 819–829. |

[10] | Kingman, J. F. C. (1982a). On the genealogy of large populations. J. Appl. Probab. 19A 27–43. · Zbl 0516.92011 |

[11] | Kingman, J. F. C. (1982b). The coalescent. Stochastic Process. Appl. 13 235–248. · Zbl 0491.60076 |

[12] | Krone, S. M. and Neuhauser, C. (1997). Ancestral processes with selection. Theoretical Population Biology 51 210–237. · Zbl 0910.92024 |

[13] | Nagylaki, T. (1989). Gustave Malecot and the transition from classical to modern population genetics. Genetics 122 253–268. |

[14] | Nordborg, M. (1997). Structured coalescent processes on different timescales. Genetics 146 1501–1514. |

[15] | Notohara, M. (1990). The coalescent and the genealogical process in geographically structured populations. J. Math. Biol. 31 841–852. · Zbl 0726.92014 |

[16] | Przeworski, M., Charlesworth, B. and Wall, J. D. (1999). Genealogies and weak purifying selection. Molecular Biology Evolution 16 246–252. |

[17] | Simmons, G. F. (1972). Differential Equations . McGraw-Hill, New York. · Zbl 0231.34001 |

[18] | Stroock, D. W. and Varadhan, S. R. S. (1979). Multidimensional Diffusion Processes . Springer, New York. · Zbl 0426.60069 |

This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.