×
Bartholomew-Biggs, Michael; Brown, Steven; Christianson, Bruce; Dixon, Laurence

Automatic differentiation of algorithms. (English) Zbl 0994.65020

J. Comput. Appl. Math. 124, No. 1-2, 171-190 (2000).
Summary: We introduce the basic notions of automatic differentiation, describe some extensions which are of interest in the context of nonlinear optimization and give some illustrative examples.

Cited in 23 Documents

MSC:

65D25 Numerical differentiation
65Y05 Parallel numerical computation
65G40 General methods in interval analysis
65K05 Numerical mathematical programming methods
65K10 Numerical optimization and variational techniques
49M30 Other numerical methods in calculus of variations (MSC2010)
90C30 Nonlinear programming
68W30 Symbolic computation and algebraic computation

Keywords:

numerical examples; adjoint programming; algorithm; automatic differentiation; checkpoints; error analysis; function approximation; implicit equations; interval analysis; nonlinear optimization; optimal control; parallelism; penalty functions; program transformation; variable momentum
PDF BibTeX XML Cite
\textit{M. Bartholomew-Biggs} et al., J. Comput. Appl. Math. 124, No. 1--2, 171--190 (2000; Zbl 0994.65020)
Full Text: DOI
  • logo of hbz
  • logo of WorldCat

References:

[1] Bartholomew-Biggs, M., Using forward accumulation for automatic differentiation of implicitly defined functions, Comput. optim. appl., 9, 65-84, (1998) · Zbl 0912.65008
[2] Benary, J., Parallelism in the reverse mode, (), 137-147 · Zbl 0866.65017
[3] Berz, M., Computational differentiation: techniques, applications and tools, society for industrial and applied mathematics, (1996), Philadelphia PA
[4] Bischof, C., Structured second- and higher-order derivatives through univariate Taylor series, Optim. methods software, 2, 211-232, (1993)
[5] S. Brown, B. Christianson, Automatic differentiation of computer programs in a parallel computing environment, in: H. Power, J.C. Long (Eds.), Applications of High Performance Computing in Engineering, Vol. V, Computational Mechanics Publications, Southampton, UK, 1997, pp. 169-178.
[6] Christianson, B., A geometric approach to Fletcher’s ideal penalty function, J. optim. theory appl., 84, 2, 433-441, (1993) · Zbl 0823.90111
[7] Christianson, B., Reverse accumulation and implicit functions, Optim. methods software, 9, 4, 307-322, (1998) · Zbl 0922.65013
[8] Christianson, B., Cheap Newton steps for optimal control problems: automatic differentiation and Pantoja’s algorithm, Optim. methods software, 10, 5, 729-743, (1999) · Zbl 0947.65070
[9] Christianson, B.; Dixon, L.; Brown, S., Sharing storage using dirty vectors, (), 107-115 · Zbl 1076.65545
[10] Christianson, B., Giving reverse differentiation a helping hand, Optim. methods software, 8, 1, 53-67, (1997) · Zbl 0891.65017
[11] Dixon, L., Use of automatic differentiation for calculating hessians and Newton steps, (), 114-125 · Zbl 0782.65021
[12] Fletcher, R., A class of methods for nonlinear programming with termination and convergence properties, (), 157-175
[13] Geiring, R.; Kaminski, T., Recipes for adjoint code construction, ACM trans. math. software, 24, 4, 437-474, (1998) · Zbl 0934.65027
[14] Gilbert, J.C., Automatic differentiation and iterative processes, Optim. methods software, 1, 13-21, (1992)
[15] Gries, D., The science of programming, (1981), Springer Berlin · Zbl 0472.68003
[16] Griewank, A., Achieving logarithmic growth of temporal and spatial complexity in reverse automatic differentiation, Optim. methods software, 1, 1, 35-54, (1992)
[17] Griewank, A., Evaluating derivatives: principles and techniques of algorithmic differentiation, society for industrial and applied mathematics, (2000), Philadelphia PA · Zbl 0958.65028
[18] Griewank, A.; Reese, S., On the calculation of Jacobian matrices by the Markowitz rule, (), 126-135 · Zbl 0782.65027
[19] Griewank, A.; Corliss (Eds.), G., Automatic differentiation of algorithms, society for industrial and applied mathematics, (1991), Philadelphia PA
[20] Iri, M., History of automatic differentiation and rounding error estimation, (), 3-16 · Zbl 0782.65028
[21] J.F.A. deO. Pantoja, Differential dynamic programming and Newton’s method, Internat. J. Control 47 (5) (1988) 1539-1553. · Zbl 0669.49014
[22] D. Shiraev, Fast automatic differentiation for vector processors and reduction of the spatial complexity in a source translation environment, Ph.D. Dissertation, Karlsruhe, 1993.
[23] Volin, Yu.M.; Ostrovskii, G.M., Automatic computation of derivatives with the use of the multilevel differentiation technique, Comput. math. appl., 11, 11, 1099-1114, (1985) · Zbl 0595.65019
[24] Wengert, R.E., A simple automatic derivative evaluation program, Comm. ACM, 7, 463-464, (1964) · Zbl 0131.34602
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.