Transformation of Quadratic Forms to Perfect Squares for Broken Extremals

In this paper we study a quadratic form which corresponds to an extremal with piecewise continuous control in variational problems. This form, compared with the classical one, has some new terms connected with the set of all points of discontinuity of the control. Its positive definiteness is a sufficient optimality condition for broken extremals. We show that if there exists a solution to corresponding Riccati equation satisfying some jump condition at each point of the set , then the quadratic form can be transformed to a perfect square, just as in the classical case. As a result we obtain sufficient conditions for positive definiteness of the quadratic form in terms of the Riccati equation and hence, sufficient optimality conditions for broken extremals.     

Global optimality of extremals: An example

The question of the existence and the location of Darboux points (beyond which global optimality is lost) is crucial for minimal sufficient conditions for global optimality and for computation of optimal trajectories. Here, we investigate numerically the Darboux points and their relationship with conjugate points for a problem of minimum fuel, constant velocity, horizontal aircraft turns to capture a line. This simple second-order optimal control problem shows that ignoring the possible existence of Darboux points may play havoc with the computation of optimal trajectories.The authors are indebted to G. Moyer for his constructive comments. This research was supported, for the first author, by a National Research Council Associateship at NASA Ames Research Center.on leave from the Technion, Israel Institute of Technology, Haifa, Israel.     

Conjugate points and shocks in nonlinear optimal control

We investigate characteristics of the Hamilton-Jacobi-Bellman
equation arising in nonlinear optimal control and their relationship with weak and strong local minima. This leads to an extension of the Jacobi conjugate points theory to the Bolza control problem. Necessary and sufficient optimality conditions for weak and strong local minima are stated in terms of the existence of a solution to a corresponding matrix Riccati differential equation.

     

Second Order Sufficiency Criteria for a Discrete Optimal Control Problem

In this work, we derive second order necessary and sufficient optimality conditions for a discrete optimal control problem with one variable endpoint and the other fixed, and with equality control constraints. In particular, the positivity of the second variation, which is a discrete quadratic functional with appropriate boundary conditions, is characterized in terms of the nonexistence of intervals conjugate to 0, the existence of a certain conjoined basis of the associated linear Hamiltonian difference system, or the existence of a symmetric solution to the implicit and explicit Riccati matrix equations. Some results require a certain minimal normality assumption, and are derived using the sensitivity analysis technique.     

Discrete Optimal Control: Second Order Optimality Conditions

In this paper, we present a survey and refinement of our recent results in the discrete optimal control theory. For a general nonlinear discrete optimal control problem (P) , second order necessary and sufficient optimality conditions are derived via the nonnegativity ( I S 0) and positivity ( I >0) of the discrete quadratic functional I corresponding to its second variation. Thus, we fill the gap in the discrete-time theory by connecting the discrete control problems with the theory of conjugate intervals, Hamiltonian systems, and Riccati equations. Necessary conditions for I S 0 are formulated in terms of the positivity of certain partial discrete quadratic functionals, the nonexistence of conjugate intervals, the existence of conjoined bases of the associated linear Hamiltonian system, and the existence of solutions to Riccati matrix equations. Natural strengthening of each of these conditions yields a characterization of the positivity of I and hence, sufficiency criteria for the original problem (P) . Finally, open problems and perspectives are also discussed.     

New optimality condition of fixed-endpoint regulators for single-input linear digital systems and its application to fixed-endpoint LQ regulators

This note discusses the regulator problem with zero terminal state for a single-input, linear, time-invariant, discrete-time system. The fundamental structure of the regulator for a general additive performance index is obtained. The new optimality condition is expressed by the optimality condition of the induced free-endpoint regulator in the first phase and the deadbeat control in the second phase. Furthermore, a closed-loop expression for the quadratic performance index is obtained.     

A new sufficiency theorem for strong minima in the calculus of variations

Sufficiency for strong local optimality in the calculus of variations involves, in the classical theory, the strengthened condition of Weierstrass. A proof of sufficiency for strong minima, modifying this condition under certain uniform continuity assumptions on the functions delimiting the problem, is presented. The proof is direct in nature as it makes no use of fields, Hamilton–Jacobi theory, Riccati equations or conjugate points. Some examples illustrate clear advantages of the new sufficient condition over the classical one.     

Optimality conditions of the maximum principle type in bilinear control problems

The optimization of a bilinear functional related to a linear state system with a modular control constraint is considered. Exact formulas for the functional increment are used to obtain sufficient conditions for the optimality of extremal controls that supplement the maximum principle. These conditions are represented in the form of inequalities and equalities for one-variable functions on a time interval. The optimization of a quadratic functional with the help of a matrix conjugate function is reduced to the bilinear case.     

A mixed formulation for the direct approximation of <Emphasis Type="Italic">L</Emphasis><Superscript>2</Superscript>-weighted controls for the linear heat equation

This paper deals with the numerical computation of null controls for the linear heat equation. The goal is to compute approximations of controls that drive the solution from a prescribed initial state to zero at a given positive time. In [Fernandez-Cara & Münch, Strong convergence approximations of null controls for the 1D heat equation, 2013], a so-called primal method is described leading to a strongly convergent approximation of distributed control: the controls minimize quadratic weighted functionals involving both the control and the state and are obtained by solving the corresponding optimality conditions. In this work, we adapt the method to approximate the control of minimal square integrable-weighted norm. The optimality conditions of the problem are reformulated as a mixed formulation involving both the state and its adjoint. We prove the well-posedeness of the mixed formulation (in particular the inf-sup condition) then discuss several numerical experiments. The approach covers both the boundary and the inner situation and is valid in any dimension.     

Global Quadratic Minimization over Bivalent Constraints: Necessary and Sufficient Global Optimality Condition

In this paper, we establish global optimality conditions for quadratic optimization problems with quadratic equality and bivalent constraints. We first present a necessary and sufficient condition for a global minimizer of quadratic optimization problems with quadratic equality and bivalent constraints. Then we examine situations where this optimality condition is equivalent to checking the positive semidefiniteness of a related matrix, and so, can be verified in polynomial time by using elementary eigenvalues decomposition techniques. As a consequence, we also present simple sufficient global optimality conditions, which can be verified by solving a linear matrix inequality problem, extending several known sufficient optimality conditions in the existing literature.     

On the Minimal Nonnegative Solution of Nonsymmetric Algebraic Riccati Equation

We study perturbation bound and structured condition number about the minimal nonnegative solution of nonsymmetric algebraic Riccati equation, obtaining a sharp perturbation bound and an accurate condition number. By using the matrix sign function method we present a new method for finding the minimal nonnegative solution of this algebraic Riccati equation. Based on this new method, we show how to compute the desired M-matrix solution of the quadratic matrix equation X^2 - EX - F = 0 by connecting it with the nonsymmetric algebraic Riccati equation, where E is a diagonal matrix and F is an M-matrix.     

The Darboux point

A theory of global optimality based upon the Darboux-point concept is developed. A definition is proposed for the Darboux point, and the Darboux point is shown to exist on nonglobally optimal trajectories under relatively general conditions. A mutually exclusive classification of Darboux points is noted, and several properties are proved for one of these classes (the Type-1 Darboux point). Numerous examples are included to illustrate the Darboux-point definition and properties.     

Coupled intervals in the discrete calculus of variations: necessity and sufficiency

In this work we study nonnegativity and positivity of a discrete quadratic functional with separately varying endpoints. We introduce a notion of an interval coupled with 0, and hence, extend the notion of conjugate interval to 0 from the case of fixed to variable endpoint(s). We show that the nonnegativity of the discrete quadratic functional is equivalent to each of the following conditions: The nonexistence of intervals coupled with 0, the existence of a solution to Riccati matrix equation and its boundary conditions. Natural strengthening of each of these conditions yields a characterization of the positivity of the discrete quadratic functional. Since the quadratic functional under consideration could be a second variation of a discrete calculus of variations problem with varying endpoints, we apply our results to obtain necessary and sufficient optimality conditions for such problems. This paper generalizes our recent work in [R. Hilscher, V. Zeidan, Comput. Math. Appl., to appear], where the right endpoint is fixed.     

Optimal State Feedback Input-Output Stabilization of Infinite-Dimensional Discrete Time-Invariant Linear Systems

We study the optimal input-output stabilization of discrete time-invariant linear systems in Hilbert spaces by state feedback. We show that a necessary and sufficient condition for this problem to be solvable is that the transfer function has a right factorization over H-infinity. A necessary and sufficient condition in terms of an (arbitrary) realization is that each state which can be reached in a finite time from the zero initial state has a finite cost. Another equivalent condition is that the control Riccati equation has a solution (in general unbounded and even non densely defined). The optimal state feedback input-output stabilization problem can then be solved explicitly in terms of the smallest solution of this control Riccati equation. We further show that after renorming the state space in terms of the solution of the control Riccati equation, the closed-loop system is not only input-output stable, but also strongly internally stable. Received: July 4, 2007. Revised: October 17, 2007.     

Stability analysis and optimal control of stochastic singular systems

In this paper, problems of stability and optimal control for a class of stochastic singular systems are studied. Firstly, under some appropriate assumptions, some new results about mean-square admissibility are developed and the corresponding LMI sufficient condition is given. Secondly, finite-time horizon and infinite-time horizon linear quadratic (LQ) control problems for the stochastic singular system are investigated, in which the coefficients are allowed to be random in control input and quadratic criterion. Some results involving new stochastic generalized Riccati equation are discussed as well. Finally, the proposed LQ control model for stochastic singular systems provides an appropriate and effective framework to study the portfolio selection problem in light of the recent development on general stochastic LQ problems.     

ON THE MINIMAL NONNEGATIVE SOLUTION OF ONSYMMETRIC ALGEBRAIC RICCATI EQUATION

We study perturbation bound and structured condition number about the minimalnonnegative solution of nonsymmetric algebraic Riccati equation,obtaining a sharp per-turbation bound and an accurate condition number.By using the matrix sign functionmethod we present a new method for finding the minimal nonnegative solution of this al-gebraic Riccati equation.Based on this new method,we show how to compute the desiredM-matrix solution of the quadratic matrix equation X~2-EX-F=0 by connecting itwith the nonsymmetric algebraic Riccati equation,where E is a diagonal matrix and F isan M-matrix.     

On Exponential Hedging and Related Quadratic Backward Stochastic Differential Equations

The dual optimization problem for the exponential hedging problem is addressed with a cone constraint. Without boundedness conditions on the terminal payoff and the drift of the Ito-type controlled process, the backward stochastic differential equation, which has a quadratic growth term in the drift, is derived as a necessary and sufficient condition for optimality via a variational method and dynamic programming. Further, solvable situations are given, in which the value and the optimizer are expressed in closed forms with the help of the Clark-Haussmann-Ocone formula.     

Indefinite LQ optimal control with cross term for discrete‐time uncertain systems

Recently, there has been an increasing interest in the study on uncertain optimal control problems. In this paper, a linear quadratic (LQ) optimal control with cross term for discrete‐time uncertain systems is considered, whereas the weighting matrices in the cost function are allowed to be indefinite. Firstly, a recurrence equation for the problem is presented based on Bellman's principle of optimality in dynamic programming. Then, a necessary condition for the existence of an optimal linear state feedback control of the indefinite LQ problem is given by the recurrence equation. Moreover, a sufficient condition of well‐posedness for the indefinite LQ problem is presented by introducing a linear matrix inequality (LMI) condition. Furthermore, it is shown that the well‐posedness of the indefinite LQ problem, the solvability of the indefinite LQ problem, the LMI condition, and the solvability of the constrained difference equation are equivalent to each other. Finally, an example is presented to illustrate the results obtained.     

Equivalent conditions to the nonnegativity of a quadratic functional in discrete optimal control

In this paper we provide a characterization of the nonnegativity of a discrete quadratic functional ? with fixed right endpoint in the optimal control setting. This characterization is closely related to the kernel condition earlier introduced by M. Bohner as a part of a focal points definition for conjoined bases of the associated linear Hamiltonian difference system. When this kernel condition is satisfied only up to a certain critical index m, the traditional conditions, which are the focal points, conjugate intervals, implicit Riccati equation, and partial quadratic functionals, must be replaced by a new condition. This new condition is determined to be the nonnegativity of a block tridiagonal matrix, representing the remainder of ? after the index m, on a suitable subspace. Applications of our result include the discrete Jacobi condition, a unification of the nonnegativity and positivity of ? into one statement, and an improved result for the special case of the discrete calculus of variations. Even when both endpoints of ? are fixed, this paper provides a new result. (© 2004 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

On some optimal control problem for a parabolic system with boundary condition involving a time-varying lag

An optimal boundary control problem for a distributed parabolicsystem with boundary condition involving a time-varying lagis considered. The initial condition of this equation is notgiven by a known function, but it belongs to a certain set.Necessary and sufficient conditions of optimality for the Neumannproblem with the quadratic performance functional are derived.A numerical example of application is also presented.