zbMATH — the first resource for mathematics

Combining automatic differentiation methods for high-dimensional nonlinear models. (English) Zbl 1251.65035
Forth, Shaun (ed.) et al., Recent advances in algorithmic differentiation. Selected papers based on the presentations at the 6th international conference on automatic differentiation (AD2012), Fort Collins, CO, USA, July 23–27, 2012. Berlin: Springer (ISBN 978-3-642-30022-6/hbk; 978-3-642-30023-3/ebook). Lecture Notes in Computational Science and Engineering 87, 23-33 (2012).
Summary: Earlier work has shown that the efficient subspace method can be employed to reduce the effective size of the input data stream for high-dimensional models when the effective rank of the first-order sensitivity matrix is orders of magnitude smaller than the size of the input data. Here, the method is extended to handle nonlinear models, where the evaluation of higher-order derivatives is important but also challenging because the number of derivatives increases exponentially with the size of the input data streams. A recently developed hybrid approach is employed to combine reverse-mode automatic differentiation to calculate first-order derivatives and perform the required reduction in the input data stream, followed by forward-mode automatic differentiation to calculate higher-order derivatives with respect only to the reduced input variables. Three test cases illustrate the viability of the approach.
For the entire collection see [Zbl 1247.65002].
65D25 Numerical differentiation
OpenAD/F; Rapsodia; SAS4A
Full Text: DOI