On the time transformation of mixed integer optimal control problems using a consistent fixed integer control function

Nonlinear control systems with instantly changing dynamical behavior can be modeled by introducing an additional control function that is integer valued in contrast to a control function that is allowed to have continuous values. The discretization of a mixed integer optimal control problem (MIOCP) leads to a non differentiable optimization problem and the non differentiability is caused by the integer values. The paper is about a time transformation method that is used to transform a MIOCP with integer dependent constraints into an ordinary optimal control problem. Differentiability is achieved by replacing a variable integer control function with a fixed integer control function and a variable time allows to change the sequence of active integer values. In contrast to other contributions, so called control consistent fixed integer control functions are taken into account here. It is shown that these control consistent fixed integer control functions allow a better accuracy in the resulting trajectories, in particular in the computed switching times. The method is verified on analytical and numerical examples.     

Relaxing mixed integer optimal control problems using a time transformation

Mixed integer control systems are used to model dynamical behavior that can change instantly, for example a driving car with different gears. Changing a gear corresponds to an instant change of the differential equation what is achieved in the model by changing the value of the integer control function. The optimal control of a mixed integer control system by a discretize-then-optimize approach leads to a mixed integer optimization problem that is not differentiable with respect to the integer variables, such that gradient based optimization methods can not be applied. In this work, differentiability with respect to all optimization variables is achieved by reformulating the mixed integer optimal control problem (MIOCP). A fixed integer control function and a time transformation are introduced. The combination of both allows to change the sequence of active differential equations by partially deactivating the fixed integer control function. In contrast to other works, here different fixed integer control functions are taken into account. Advantages of so called control consistent (CC) fixed integer control functions are discussed and confirmed on a numerical example. (© 2015 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Discrete mechanics and mixed integer optimal control of dynamical systems

Mixed integer optimal control problems are a generalization of ordinary optimal control problems that include additional integer valued control functions. The integer control functions are used to switch instantaneously from one system to another. We use a time transformation (similar as in [1]) to get rid of the integer valued functions. This allows to apply gradient based optimization methods to approximate the mixed integer optimal control problem. The time transformation from [1] is adapted such that problems with distinct state domains for each system can be solved and it is combined with the direct discretization method DMOC [2,3] (Discrete Mechanics and Optimal Control) to approximate trajectories of the underlying optimal control problems. Our approach is illustrated with the help of a first example, the hybrid mass oscillator. (© 2014 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Some models for water distribution systems

In this paper the results of our investigation of methods and algorithms for operative and dynamical control of water distribution systems are presented. Our investigation was directed to the distribution system equipped with a variety of components—pipes, consumers, valves and the inner water store (a reservoir) as the most important one. The final model of the optimization problem containing all necessary restrictions is so complex that it is impossible to solve it without some special techniques. In the presented study we propose a multilevel approach based on the idea of aggregation of the pipelines network. In the paper the method of determination of aggregated model of the network is presented. The usefulness of this method in the optimization of water supply systems is examined. Based on an aggregated network model one determines optimal strategies for control of pumping stations. The optimization model consists of a linear objective function and quadratic constraints. A nonlinear mixed integer programming problem which is solved by modified branch and bound method is obtained.     

Solving Optimal Control Problems by Exploiting Inherent Dynamical Systems Structures

Computing globally efficient solutions is a major challenge in optimal control of nonlinear dynamical systems. This work proposes a method combining local optimization and motion planning techniques based on exploiting inherent dynamical systems structures, such as symmetries and invariant manifolds. Prior to the optimal control, the dynamical system is analyzed for structural properties that can be used to compute pieces of trajectories that are stored in a motion planning library. In the context of mechanical systems, these motion planning candidates, termed primitives, are given by relative equilibria induced by symmetries and motions on stable or unstable manifolds of e.g. fixed points in the natural dynamics. The existence of controlled relative equilibria is studied through Lagrangian mechanics and symmetry reduction techniques. The proposed framework can be used to solve boundary value problems by performing a search in the space of sequences of motion primitives connected using optimized maneuvers. The optimal sequence can be used as an admissible initial guess for a post-optimization. The approach is illustrated by two numerical examples, the single and the double spherical pendula, which demonstrates its benefit compared to standard local optimization techniques.     

A decomposition approach for optimal control problems with integer innerpoint state constraints

A large class of optimal control problems for hybrid dynamic systems can be formulated as mixed‐integer optimal control problems (MIOCPs). A decomposition approach is suggested to solve a special subclass of MIOCPs with mixed integer inner point state constraints. It is the intrinsic combinatorial complexity of the discrete variables in addition to the high nonlinearity of the continuous optimal control problem that forms the challenges in the theoretical and numerical solution of MIOCPs. During the solution procedure the problem is decomposed at the inner time points into a multiphase problem with mixed integer boundary constraints and phase transitions at unknown switching points. Due to a discretization of the state space at the switching points the problem can be decoupled into a family of continuous optimal control problems (OCPs) and a problem similar to the asymmetric group traveling salesman problem (AGTSP). The OCPs are transcribed by direct collocation to large‐scale nonlinear programming problems, which are solved efficiently by an advanced SQP method. The results are used as weights for the edges of the graph of the corresponding TSP‐like problem, which is solved by a Branch‐and‐Cut‐and‐Price (BCP) algorithm. The proposed approach is applied to a hybrid optimal control benchmark problem for a motorized traveling salesman. (© 2004 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

A fast heuristic method for minimizing traffic congestion on reconfigurable ring topologies

We describe the development of fast heuristics and methodologies for congestion minimization problems in directional wireless networks, and we compare their performance with optimal solutions. The focus is on the network layer topology control problem (NLTCP) defined by selecting an optimal ring topology as well as the flows on it. Solutions to NLTCP need to be computed in near realtime due to changing weather and other transient conditions and which generally preclude traditional optimization strategies. Using a mixed-integer linear programming formulation, we present both new constraints for this problem and fast heuristics to solve it. The new constraints are used to increase the lower bound from the linear programming relaxation and hence speed up the solution of the optimization problem by branch and bound. The upper and lower bounds for the optimal objective function to the mixed integer problem then serve to evaluate new node-swapping heuristics which we also present. Through a series of tests on different sized networks with different traffic demands, we show that our new heuristics achieve within about 0.5% of the optimal value within seconds.     

Predictive control for hybrid systems. Implications of polyhedral pre-computations

The present paper deals with the predictive control laws for hybrid systems. The modelling formalism used will be the Mixed Logical Dynamical (MLD) which offers the advantage of a compact expression of the dynamics in terms of linear equalities and inequalities on the logical and continuous-time states and inputs. Being an optimization-based control technique, the predictive control needs an efficient implementation scheme in order to be effective in real time.

Several studies assess the importance of the prediction horizon and the terminal constraints due to their implications in the structure of the associated optimal control problem. Lately it has been shown that as long as the constraints remain linear, the polyhedral computations can serve as tools for the migration of the on-line computational effort to off-line explicit constructions in terms of explicit solutions which can avoid a costly on-line optimum seeking and thus pushing the application of predictive laws to even higher sampling rates.

This paper reviews the on-line optimization techniques proposed for the predictive control of hybrid systems based on mixed integer optimization problems. Further, the explicit solutions are analyzed using a parameterized polyhedron approach.     

Branch-and-bound algorithms for the partial inverse mixed integer linear programming problem

This paper presents branch-and-bound algorithms for the partial inverse mixed integer linear programming (PInvMILP) problem, which is to find a minimal perturbation to the objective function of a mixed integer linear program (MILP), measured by some norm, such that there exists an optimal solution to the perturbed MILP that also satisfies an additional set of linear constraints. This is a new extension to the existing inverse optimization models. Under the weighted $L_1$ and $L_\infty $ norms, the presented algorithms are proved to finitely converge to global optimality. In the presented algorithms, linear programs with complementarity constraints (LPCCs) need to be solved repeatedly as a subroutine, which is analogous to repeatedly solving linear programs for MILPs. Therefore, the computational complexity of the PInvMILP algorithms can be expected to be much worse than that of MILP or LPCC. Computational experiments show that small-sized test instances can be solved within a reasonable time period.     

Determination of Periodic Trajectories of Dynamic Systems Subject to Switching Input Constraints

The present paper is concerned with the determination of periodic state trajectories of discrete-time dynamic systems resulting from the application of bidirectional on/off input sequences subject to switching constraints. The main contribution consists of characterizing the feasible input sequences and associated state trajectories in terms of a set of linear constraints involving integer variables. For practical purposes, the resulting solutions obtained by an integer linear solver can be evaluated in terms of engineering criteria such as amplitude or fuel expense in order to choose an appropriate trajectory to be used as target in a control law. A numerical example involving a double-integrator system is presented to illustrate the use of the proposed constraint formulation for the determination of feasible periodic state trajectories.     

An exact penalty function method for nonlinear mixed discrete programming problems

In this paper, we consider a general class of nonlinear mixed discrete programming problems. By introducing continuous variables to replace the discrete variables, the problem is first transformed into an equivalent nonlinear continuous optimization problem subject to original constraints and additional linear and quadratic constraints. Then, an exact penalty function is employed to construct a sequence of unconstrained optimization problems, each of which can be solved effectively by unconstrained optimization techniques, such as conjugate gradient or quasi-Newton methods. It is shown that any local optimal solution of the unconstrained optimization problem is a local optimal solution of the transformed nonlinear constrained continuous optimization problem when the penalty parameter is sufficiently large. Numerical experiments are carried out to test the efficiency of the proposed method.     

Optimal control of switched systems with time delay

In this note, we develop a computational method for solving an optimal control problem which is governed by a switched dynamical system with time delay. Our approach is to parameterize the switching instants as a new parameter vector to be optimized. Then, we derive the required gradient of the cost function which is obtained via solving a number of delay differential equations forward in time. On this basis, the optimal control problem can be solved as a mathematical programming problem.     

基于高斯伪谱的最优控制求解及其应用

研究一种基于高斯伪谱法的具有约束受限的最优控制数值计算问题.方法将状态演化和控制规律用多项式参数化近似,微分方程用正交多项式近似.将最优控制问题求解问题转化为一组有约束的非线性规划求解.详细论述了该种近似方法的有效性.作为该种方法的应用,讨论了一个障碍物环境下的机器人最优路径生成问题.将机器人路径规划问题转化为具有约束条件最优控制问题,然后用基于高斯伪谱的方法求解,并给出了仿真结果.     

Numerical optimization methods for controlled systems with parameters

First- and second-order numerical methods for optimizing controlled dynamical systems with parameters are discussed. In unconstrained-parameter problems, the control parameters are optimized by applying the conjugate gradient method. A more accurate numerical solution in these problems is produced by Newton’s method based on a second-order functional increment formula. Next, a general optimal control problem with state constraints and parameters involved on the righthand sides of the controlled system and in the initial conditions is considered. This complicated problem is reduced to a mathematical programming one, followed by the search for optimal parameter values and control functions by applying a multimethod algorithm. The performance of the proposed technique is demonstrated by solving application problems.     

Time Optimal Path Planning for Industrial Robots: A Dynamic Programming Approach Considering Torque Derivative and Jerk Constraints

This paper presents a dynamic programming approach for calculating time optimal trajectories for industrial robots, subject to various physical constraints. In addition to path velocity, motor torque, joint velocity and acceleration constraints, the present contribution also shows how to deal with torque derivative and joint jerk limitations. First a Cartesian path for the endeffector is defined by splines using Bernstein polynomials as basis functions and is parameterized via a scalar path parameter. In order to compute the belonging quantities in configuration space, inverse kinematics is solved numerically. Using this and in combination with the dynamical model, joint torques as well as their derivatives can be constrained. For that purpose the equations of motion are calculated with the help of the Projection Equation. As a consequence of the used optimization problem formulation, the dynamical model as well as the restrictions have to be transformed to path parameter space. Due to the additional consideration of jerk and torque derivative constraints, the phase plane is expanded to a phase space. The parameterized restrictions lead to feasible regions in this space, in which the optimal solution is sought. Result of the optimization is the time behavior of the path parameter and subsequently the feed forward torques for the optimal motion on the spatial path defined by previously mentioned splines. Simulation results as well as experimental results for a three axes industrial robot are presented. (© 2014 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Numerical algorithm for a class of constrained optimal control problems of switched systems

In this paper, we consider an optimal control problem of switched systems with continuous-time inequality constraints. Because of the complexity of such constraints and switching laws, it is difficult to solve this problem by standard optimization techniques. To overcome the difficulty, we adopt a bi-level algorithm to divide the problem into two nonlinear constrained optimization problems: one continuous and the other discrete. To solve the problem, we transform the inequality constraints into equality constraints which is smoothed using a twice continuously differentiable function and treated as a penalty function. On this basis, the smoothed problem can be solved by any second-order gradient algorithm, e.g., Newton’s Method. Finally, numerical examples show that our method is effective compared to existing algorithms.     

Computational method for optimal control of switched systems with input and state constraints

In this paper, we consider an optimal control problem of switched systems with input and state constraints. Since the complexity of such constraint and switching laws, it is difficult to solve the problem using standard optimization techniques. In addition, although conjugate gradient algorithms are very useful for solving nonlinear optimization problem, in practical implementations, the existing Wolfe condition may never be satisfied due to the existence of numerical errors. And the mode insertion technique only leads to suboptimal solutions, due to only certain mode insertions being considered. Thus, based on an improved conjugate gradient algorithm and a discrete filled function method, an improved bi-level algorithm is proposed to solve this optimization problem. Convergence results indicate that the proposed algorithm is globally convergent. Three numerical examples are solved to illustrate the proposed algorithm converges faster and yields a better cost function value than existing bi-level algorithms.     

Pontryagin's Principle of Mixed Control-State Constrained Optimal Control Governed by Fluid Dynamic Systems

This article deals with Pontryagin's minimum principle for optimal control problems governed by an abstract fluid dynamical system with mixed control-state constraints. Two techniques are mainly used to obtain our results: ?-perturbation for admissible control set and diffuse perturbation for admissible control. Using these results, the necessary conditions for L ²-local optimal solution of our control problems can be studied under some assumptions. In the end of this article, these results are applied to some special fluid dynamical systems which contain the fluid systems driven by its boundary and magnetohydrodynamics(MHD).     

An Exact Penalty Function Method for Continuous Inequality Constrained Optimal Control Problem

In this paper, we consider a class of optimal control problems subject to equality terminal state constraints and continuous state and control inequality constraints. By using the control parametrization technique and a time scaling transformation, the constrained optimal control problem is approximated by a sequence of optimal parameter selection problems with equality terminal state constraints and continuous state inequality constraints. Each of these constrained optimal parameter selection problems can be regarded as an optimization problem subject to equality constraints and continuous inequality constraints. On this basis, an exact penalty function method is used to devise a computational method to solve these optimization problems with equality constraints and continuous inequality constraints. The main idea is to augment the exact penalty function constructed from the equality constraints and continuous inequality constraints to the objective function, forming a new one. This gives rise to a sequence of unconstrained optimization problems. It is shown that, for sufficiently large penalty parameter value, any local minimizer of the unconstrained optimization problem is a local minimizer of the optimization problem with equality constraints and continuous inequality constraints. The convergent properties of the optimal parameter selection problems with equality constraints and continuous inequality constraints to the original optimal control problem are also discussed. For illustration, three examples are solved showing the effectiveness and applicability of the approach proposed.     

Combined time and energy optimal trajectory planning with quadratic drag for mixed discrete-continuous task planning

ABSTRACT

The problem of mixed discrete-continuous task planning for mechanical systems, such as aerial drones or other autonomous units, can be often treated as a sequence of point-to-point trajectories. In this work, the problem of optimal trajectory planning under a combined completion time and energy criterion, for a straight point to point path for a second-order system with quadratic under state (velocity) and control (acceleration) constraints is considered. The solution is obtained and proved to be optimal using the Pontryagin Maximum Principle. Simulation results for different cases are presented and compared with a customary numerical optimal control solver.