Publication: Symplectic Runge-Kutta Schemes for Adjoint Equations, Automatic Differentiation, Optimal Control, and More
Loading...
Identifiers
Publication date
2016
Defense date
Authors
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
Elsevier
Impact
Export
Abstract
The study of the sensitivity of the solution of a system of differential equations with respect to changes in the initial conditions leads to the introduction of an adjoint system, whose discretization is related to reverse accumulation in automatic differentiation. Similar adjoint systems arise in optimal control and other areas, including classical mechanics. Ad-joint systems are introduced in such a way that they exactly preserve a relevant quadratic invariant (more precisely, an inner product). Symplectic Runge-Kutta and partitioned Runge-Kutta methods are defined through the exact conservation of a differential geometric structure, but may be characterized by the fact that they preserve exactly quadratic invariants of the system being integrated. Therefore, the symplecticness (or lack of symplecticness) of a Runge-Kutta or partitioned Runge-Kutta integrator should be relevant to understanding its performance when applied to the computation of sensitivities, to optimal control problems, and in other applications requiring the use of adjoint systems. This paper examines the links between symplectic integration and those applications and presents in a new, unified way a number of results currently scattered among or implicit in the literature. In particular, we show how some common procedures, such as the direct method in optimal control theory and the computation of sensitivities via reverse accumulation, imply, probably unbeknownst to the user, "hidden" integrations with symplectic partitioned Runge-Kutta schemes.
Description
Keywords
Runge-Kutta methods, Partitioned Runge-Kutta methods, Symplectic integration, Hamiltonian systems, Variational equations, Adjoint equations, Computation of sensitivities, Lagrange multipliers, Automatic differentiation, Optimal control, Lagrangian mechanics, Reflected and transposed Runge-Kutta schemes, Differential-algebraic problems, Constrained controls, Order conditions, Discrete mechanics, Integrators, Systems
Bibliographic citation
Sanz-Serna, J. M. (2016). Symplectic Runge--Kutta Schemes for Adjoint Equations, Automatic Differentiation, Optimal Control, and More. SIAM Review, 58(1), 3–33.