A General Numerical Approach to Sensitivity Analysis and Error Analysis with Adjoint Systems
A note on direct methods for approximations of sparse Hessian matrices
Necessity of computing large sparse Hessian matrices gave birth to many methods for their effective approximation by differences of gradients. We adopt the so-called direct methods for this problem that we faced when developing programs for nonlinear optimization. A new approach used in the frame of symmetric sequential coloring is described. Numerical results illustrate the differences between this method and the popular Powell-Toint method.
Approximation, numerical differentiation and integration based on Taylor polynomial.
Approximations of the partial derivatives by averaging
A straightforward generalization of a classical method of averaging is presented and its essential characteristics are discussed. The method constructs high-order approximations of the l-th partial derivatives of smooth functions u in inner vertices a of conformal simplicial triangulations T of bounded polytopic domains in ℝd for arbitrary d ≥ 2. For any k ≥ l ≥ 1, it uses the interpolants of u in the polynomial Lagrange finite element spaces of degree k on the simplices with vertex a only. The...
Asymptotic optimality of generalized cross-validation for choosing the regularization parameter.
Automatic differentiation and its program realization
Automatic differentiation is an effective method for evaluating derivatives of function, which is defined by a formula or a program. Program for evaluating of value of function is by automatic differentiation modified to program, which also evaluates values of derivatives. Computed values are exact up to computer precision and their evaluation is very quick. In this article, we describe a program realization of automatic differentiation. This implementation is prepared in the system UFO, but its...
Automatic differentiation platform : design
Automatic differentiation (AD) has proven its interest in many fields of applied mathematics, but it is still not widely used. Furthermore, existing numerical methods have been developed under the hypotheses that computing program derivatives is not affordable for real size problems. Exact derivatives have therefore been avoided, or replaced by approximations computed by divided differences. The hypotheses is no longer true due to the maturity of AD added to the quick evolution of machine capacity....
Automatic Differentiation Platform: Design
Automatic differentiation (AD) has proven its interest in many fields of applied mathematics, but it is still not widely used. Furthermore, existing numerical methods have been developed under the hypotheses that computing program derivatives is not affordable for real size problems. Exact derivatives have therefore been avoided, or replaced by approximations computed by divided differences. The hypotheses is no longer true due to the maturity of AD added to the quick evolution of machine capacity....
Averaging of gradient in the space of linear triangular and bilinear rectangular finite elements
An averaging method for the second-order approximation of the values of the gradient of an arbitrary smooth function u = u(x 1, x 2) at the vertices of a regular triangulation T h composed both of rectangles and triangles is presented. The method assumes that only the interpolant Πh[u] of u in the finite element space of the linear triangular and bilinear rectangular finite elements from T h is known. A complete analysis of this method is an extension of the complete analysis concerning the finite...