×

A direct search algorithm for optimization with noisy function evaluations. (English) Zbl 1035.90106

Summary: We consider the unconstrained optimization of a function when each function evaluation is subject to a random noise. We assume that there is some control over the variance of the noise term, in the sense that additional computational effort will reduce the amount of noise. This situation may occur when function evaluations involve simulation or the approximate solution of a numerical problem. It also occurs in an experimental setting when averaging repeated observations at the same point can lead to a better estimate of the underlying function value. We describe a new direct search algorithm for this type of problem. We prove convergence of the new algorithm when the noise is controlled so that the standard deviation of the noise approaches zero faster than the step size. We also report some numerical results on the performance of the new algorithm.

MSC:

90C56 Derivative-free methods and methods using generalized derivatives
49K45 Optimality conditions for problems involving randomness
49M30 Other numerical methods in calculus of variations (MSC2010)

Software:

minpack; SIGMA_
PDFBibTeX XMLCite
Full Text: DOI