Optimal control of distributed parabolic systems with multiple time delays given in the integral form

Various optimal control problems for linear parabolic systemswith multiple time delays given in the integral form are considered.Necessary and sufficient conditions of optimality are derivedfor the Neumann problem. The optimal control is obtained inthe feedback form. Making use of the results of Schwartz, therepresentation of the optimal feedback control is given. A simpleexample of application is also provided.     

Computation of optimal controls for a nonlinear stochastic third-order system

This paper deals with the computation of optimal feedback control laws for a nonlinear stochastic third-order system in which the nonlinear element is not completely specified. It is shown that, due to the structure of the system, the optimal feedback control law, whenever it exists, is not unique. Also, it is shown that, in order to implement an optimal feedback control law, a nonlinear partial differential equation has to be solved. A finite-difference algorithm for the solution of this equation is suggested, and its efficiency and applicability are demonstrated with examples.     

Optimal production control of a dynamic two-product manufacturing system with setup costs and setup times

This paper deals with the optimal control of a one-machine two-product manufacturing system with setup changes, operating in a continuous time dynamic environment. The system is deterministic. When production is switched from one product to the other, a known constant setup time and a setup cost are incurred. Each product has specified constant processing time and constant demand rate, as well as an infinite supply of raw material. The problem is formulated as a feedback control problem. The objective is to minimize the total backlog, inventory and setup costs incurred over a finite horizon. The optimal solution provides the optimal production rate and setup switching epochs as a function of the state of the system (backlog and inventory levels). For the steady state, the optimal cyclic schedule is determined. To solve the transient case, the system's state space is partitioned into mutually exclusive regions such that with each region, the optimal control policy is determined analytically.     

An applied cell mapping method for optimal control problems

From the application point of view, a series of modifications are proposed for the cell mapping method discussed in Ref. 1 for the optimal control analysis of dynamical systems. The cell order around the target set is rearranged. A set of common discriminate principles is used for the selection of the optimal one among competing control strategies of the same cost. Inequality constraints of the system are taken into account. The number of elements in the set of allowable time intervals is not prescribed, but left open. These modifications seem to make the cell mapping method more efficient for analyzing feedback systems and for obtaining their global optimal control information. The algorithms presented in this paper could broaden the application of the cell mapping approach of Ref. 1 to a wider class of engineering problems.     

Solution of a class of stochastic linear-convex control problems using deterministic equivalents

In this paper, we identify a new class of stochastic linearconvex optimal control problems, whose solution can be obtained by solving appropriate equivalent deterministic optimal control problems. The term linear-convex is meant to imply that the dynamics is linear and the cost function is convex in the state variables, linear in the control variables, and separable. Moreover, some of the coefficients in the dynamics are allowed to be random and the expectations of the control variables are allowed to be constrained. For any stochastic linear-convex problem, the equivalent deterministic problem is obtained. Furthermore, it is shown that the optimal feedback policy of the stochastic problem is affine in its current state, where the affine transformation depends explicitly on the optimal solution of the equivalent deterministic problem in a simple way. The result is illustrated by its application to a simple stochastic inventory control problem.This research was supported in part by NSERC Grant A4617, by SSHRC Grant 410-83-0888, and by an INRIA Post-Doctoral Fellowship.     

Optimal infinite-horizon feedback laws for a general class of constrained discrete-time systems: Stability and moving-horizon approximations

Stability results are given for a class of feedback systems arising from the regulation of time-varying discrete-time systems using optimal infinite-horizon and moving-horizon feedback laws. The class is characterized by joint constraints on the state and the control, a general nonlinear cost function and nonlinear equations of motion possessing two special properties. It is shown that weak conditions on the cost function and the constraints are sufficient to guarantee uniform asymptotic stability of both the optimal infinite-horizon and moving-horizon feedback systems. The infinite-horizon cost associated with the moving-horizon feedback law approaches the optimal infinite-horizon cost as the moving horizon is extended.     

最速反馈控制的不变性

变结构控制对系统模型和扰动具有一定的不变性是众所周知的事实。最速反馈控制是以其开关曲线为滑动曲线的变结构控制。本文用变结构控制理论来讨论修正了的最速反馈控制对一定范围的系统扰动具有完全的不变性,即完全能够抑制一定范围的扰动作用,而且闭环系统的所有轨线,在理论上,都以有限时间到达原点。这就为设计高效非线性反馈提供了一条有效途径,还给出了避免高频颤震来实现最速反馈控制的数字化办法。     

Optimal feedback control of bilinear systems

Feedback synthesis of optimal constrained controls for single-input bilinear systems is considered. Quadratic cost functionals (with and without quadratic control penalization) are modified by the inclusion of additional nonnegative state penalizing functions in the respective cost integrands. The latter functions are chosen so as to regularize the problems, in the sense that feedback solutions of particularly simple form are obtained. Finite and infinite time horizon problem formulations are treated, and associated aspects of feedback stabilization of bilinear systems are discussed.     

Optimal boundary feedback stabilization of a string with moving boundary

Email: gugat{at}am.uni-erlangen.de Received on April 30, 2006; We consider a finite string that is fixed at one end and subjectto a feedback control at the other end which is allowed to move.We show that the behaviour is similar to the situation whereboth ends are fixed: As long as the movement is not too fast,the energy decays exponentially and for a certain parameterin the feedback law it vanishes in finite time. We considermovements of the boundary that are continuously differentiablewith a derivative whose absolute value is smaller than the wavespeed. We solve a problem of worst-case optimal feedback control,where the parameter in the feedback law is chosen such thatthe worst-case L^p-norm of the space derivative at the fixedend of the string is minimized (p [1, )). We consider the worstcase both with respect to the initial conditions and with respectto the boundary movement. It turns out that the parameter forwhich the energy vanishes in finite time is optimal in thissense for all p.     

Control of the Burgers Equation by a Reduced-Order Approach Using Proper Orthogonal Decomposition

Proper orthogonal decomposition (POD) is a method to derive reduced-order models for dynamical systems. In this paper, POD is utilized to solve open-loop and closed-loop optimal control problems for the Burgers equation. The relative simplicity of the equation allows comparison of POD-based algorithms with numerical results obtained from finite-element discretization of the optimality system. For closed-loop control, suboptimal state feedback strategies are presented.     

Optimal NPID Stabilization of Linear Systems

We consider the problem of finding the optimal, robust stabilization of linear systems within a family of nonlinear feedback laws. Investigation of the efficiency of full-state based and partial-state based so-called NPID feedback schemes proposed for the stabilization of systems in robotic applications has provided the motivation for our work. We prove that, for a given quadratic Lyapunov function and a given family of nonlinear feedback laws, there exist optimal piecewise linear feedbacks that make the generalized Lyapunov derivative of the closed-loop system minimal. The result provides improved stabilization over the nonlinear stabilizing feedback law proposed in Ref. 1 as demonstrated in simulations of the Sarcos Dextrous Manipulator.     

Transient and steady-state analysis of a manufacturing system with setup changes

This paper deals with the optimal scheduling of a one-machine two-product manufacturing system with setup, operating in a continuous time dynamic environment. The machine is reliable. A known constant setup time is incurred when switching over from a part to the other. Each part has specified constant processing time and constant demand rate, as well as an infinite supply of raw material. The problem is formulated as a production flow control problem. The objective is to minimize the sum of the backlog and inventory costs incurred over a finite planning horizon. The global optimal solution, expressed as an optimal feedback control law, provides the optimal production rate and setup switching epochs as a function of the state of the system (backlog and inventory levels). For the steady-state, the optimal cyclic schedule (Limit Cycle) is determined. This is equivalent to solving a one-machine two-product Lot Scheduling Problem. To solve the transient case, the system's state space is partitioned into mutually exclusive regions such that with each region is associated an optimal control policy. A novel algorithm (Direction Sweeping Algorithm) is developed to obtain the optimal state trajectory (optimal policy that minimizes the sum of inventory and backlog costs) for this last case.     

A general approach to nonlinear multiple control problems with perturbation consideration

In this paper, we consider a general nonlinear optimal control problem involving multiple criteria. We show that the problem can be transformed into a standard optimal control problem, and hence, is solvable by conventional techniques. However, the optimal control so obtained is of open loop nature and is rather sensitive to perturbations. Based on the first-order approximation, neighboring extremal approach is used to obtain a local linear feedback correction control law, leading to a combined controller. Two numerical examples are solved using the proposed method to demonstrate the effectiveness of the combined control.     

A dual dynamic programming for minimax optimal control problems governed by parabolic equation

In the article, minimax optimal control problems governed by parabolic equations are considered. We apply a new dual dynamic programming approach to derive sufficient optimality conditions for such problems. The idea is to move all the notions from a state space to a dual space and to obtain a new verification theorem providing the conditions, which should be satisfied by a solution of the dual partial differential equation of dynamic programming. We also give sufficient optimality conditions for the existence of an optimal dual feedback control and some approximation of the problem considered, which seems to be very useful from a practical point of view.     

On the existence of optimal controls for nonlinear infinite dimensional systems

We consider nonlinear systems with a priori feedback. We establish the existence of admissible pairs and then we show that the Lagrange optimal control problem admits an optimal pair. As application we work out in detail two examples of optimal control problems for nonlinear parabolic partial differential equations.     

A novel feedforward–feedback suboptimal control of linear time-delay systems

This paper presents a new approach for solving the optimal control problem of linear time-delay systems with a quadratic cost functional. In this approach, a method of successive substitution is employed to convert the original time-delay optimal control problem into a sequence of linear time-invariant ordinary differential equations (ODEs) without delay and advance terms. The obtained optimal control consists of a linear state feedback term and a forward term. The feedback term is determined by solving a matrix Riccati differential equation. The forward term is an infinite sum of adjoint vectors, which can be obtained by solving recursively the above-mentioned sequence of linear non-delay ODEs. A fast-converging iterative algorithm for this purpose is presented which provides a promising possible reduction of computational efforts. Numerical examples demonstrating the efficiency, simplicity and high accuracy of the suggested technique have been included. Simulation results reveal that just a few iterations of the proposed algorithm are required to find an accurate enough feedforward–feedback suboptimal control.     

粘性解框架下的完全耦合正倒向随机系统最优控制问题的验证定理

研究了完全耦合正倒向随机控制系统的最优控制问题.得到了粘性解框架下的,控制变量同时出现在正倒向随机系统的漂移项和扩散项中的最优控制问题的验证定理.还讨论了验证定理在构造随机最优反馈控制中的应用.     

Forward-backward Stochastic Differential Equations and Backward Linear Quadratic Stochastic Optimal Control Problem

In this paper, we use the solutions of forward-backward stochastic differential equations to get the optimal control for backward stochastic linear quadratic optimal control problem. And we also give the linear feedback regulator for the optimal control problem by using the solutions of a group of Riccati equations.     

Robust inverse optimal control for flexible structures

An inverse optimal control problem is formulated to develop robust control laws for purely oscillatory systems. The optimal control solution requires output feedback with specified constraints, leading to robustness with respect to unmodeled modes and a large class of parameter variations. The robustness properties are proved directly from known properties of control laws resulting from quadratic performance indices. The control laws are useful for poorly damped flexible structures.This research was supported by the Office of Naval Research, Contract No. N00014-77-C-0247.