an:00773872
Zbl 0828.65064
Gilmore, P.; Kelley, C. T.
An implicit filtering algorithm for optimization of functions with many local minima
EN
SIAM J. Optim. 5, No. 2, 269-285 (1995).
00027018
1995
j
65K05 90C30
filtering algorithm; finite difference projected gradient-Armijo method; performance; quasi-Newton method
The paper is concerned with the minimization of a function \(f\) subject to simple bound constraints: \(x \in \Omega = \{x \mid e^i \leq x^i \leq u^i\}\), where \(x^i\) denotes the \(i\)th component of the vector \(x \in \mathbb{R}^n\), but that \(\widehat {f} = f + \phi\), where \(\phi\) is small in magnitude relative to \(f\) but has high frequency oscillations that cause local minima.
One way to avoid such local minima is to filter the high frequency components from some expansion of \(\widehat f\). In the filtering algorithm proposed in this paper, a finite difference projected gradient- Armijo method is used with a step size in the difference chosen as it would be if \(\phi\) were floating point round-off. The strategy for selection of the decreasing sequence of the step sizes is a heuristic one.
The iterative process is terminated after a predetermined value of the step size is reached or when no further progress is being made. The algorithm is called ``implicit filtering'' because the differencing is used to ``step over'' the noise \(\phi\) at varying levels of resolution, hence implicitly filtering the objective. The performance of the algorithm in the terminal phase of the iteration can be accelerated by a quasi-Newton method.
F.Luban (Bucure??ti)