Robust Averaged Control of Vibrations for the Bernoulli–Euler Beam Equation

This paper proposes an approach for the robust averaged control of random vibrations for the Bernoulli–Euler beam equation under uncertainty in the flexural stiffness and in the initial conditions. The problem is formulated in the framework of optimal control theory and provides a functional setting, which is so general as to include different types of random variables and second-order random fields as sources of uncertainty. The second-order statistical moment of the random system response at the control time is incorporated in the cost functional as a measure of robustness. The numerical resolution method combines a classical descent method with an adaptive anisotropic stochastic collocation method for the numerical approximation of the statistics of interest. The direct and adjoint stochastic systems are uncoupled, which permits to exploit parallel computing architectures to solve the set of deterministic problem that arise from the stochastic collocation method. As a result, problems with a relative large number of random variables can be solved with a reasonable computational cost. Two numerical experiments illustrate both the performance of the proposed method and the significant differences that may occur when uncertainty is incorporated in this type of control problems.     

Forward–Backward Stochastic Differential Games and Stochastic Control under Model Uncertainty

We study optimal stochastic control problems with jumps under model uncertainty. We rewrite such problems as stochastic differential games of forward–backward stochastic differential equations. We prove general stochastic maximum principles for such games, both in the zero-sum case (finding conditions for saddle points) and for the nonzero sum games (finding conditions for Nash equilibria). We then apply these results to study robust optimal portfolio-consumption problems with penalty. We establish a connection between market viability under model uncertainty and equivalent martingale measures. In the case with entropic penalty, we prove a general reduction theorem, stating that a optimal portfolio-consumption problem under model uncertainty can be reduced to a classical portfolio-consumption problem under model certainty, with a change in the utility function, and we relate this to risk sensitive control. In particular, this result shows that model uncertainty increases the Arrow–Pratt risk aversion index.     

A maximum principle for Markov regime-switching forward–backward stochastic differential games and applications

In this paper, we present an optimal control problem for stochastic differential games under Markov regime-switching forward–backward stochastic differential equations with jumps. First, we prove a sufficient maximum principle for nonzero-sum stochastic differential games problems and obtain equilibrium point for such games. Second, we prove an equivalent maximum principle for nonzero-sum stochastic differential games. The zero-sum stochastic differential games equivalent maximum principle is then obtained as a corollary. We apply the obtained results to study a problem of robust utility maximization under a relative entropy penalty and to find optimal investment of an insurance firm under model uncertainty.     

Stochastic Material and Topology Design

In order to find a robust optimal topology or material design with respect to stochastic variations of the model parameters of a mechanical structure, the basic optimization problem under stochastic uncertainty must be replaced by an appropriate deterministic substitute problem. Starting from the equilibrium equation and the yield/strength conditions, the problem can be formulated as a stochastic (linear) program “with recourse”. Hence, by discretization the design space by finite elements, linearizing the yield conditions, in case of discrete probability distributions the resulting deterministic substitute problems are linear programs with a dual decomposition data structure.     

Optimal Open-Loop Feedback Control of Robots under uncertainty

The aim of this presentation is to construct an optimal open-loop feedback controller for robots, which takes into account stochastic uncertainties. This way, optimal regulators being insensitive with respect to random parameter variations can be obtained. Usually, a precomputed feedback control is based on exactly known or estimated model parameters. However, in practice, often exact informations about model parameters, e.g. the payload mass, are not given. Supposing now that the probability distribution of the random parameter variation is known, in the following, stochastic optimisation methods will be applied in order to obtain robust open-loop feedback control. Taking into account stochastic parameter variations, the method works with expected cost functions evaluating the primary control expenses and the tracking error. The expectation of the total costs has then to be minimized. Corresponding to Model Predictive Control (MPC), here a sliding horizon is considered. This means that, instead of minimizing an integral from a starting time point t₀ to the final time t_f, the future time range [t; t+T], with a small enough positive time unit T, will be taken into account. The resulting optimal regulator problem under stochastic uncertainty will be solved by using the Hamiltonian of the problem. After the computation of a H-minimal control, the related stochastic two-point boundary value problem is then solved in order to find a robust optimal open-loop feedback control. The performance of the method will be demonstrated by a numerical example, which will be the control of robot under random variations of the payload mass. (© 2010 Wiley-VCH Verlag GmbH & Co. KGaA, Weinheim)     

A penalty function-based random search algorithm for optimal control of switched systems with stochastic constraints and its application in automobile test-driving with gear shifts

Practical industrial process is usually a dynamic process including uncertainty. Stochastic constraints can be used for industrial process modeling, when system sate and/or control input constraints cannot be strictly satisfied. Thus, optimal control of switched systems with stochastic constraints can be available to address practical industrial process problems with different modes. In general, obtaining an analytical solution of the optimal control problem is usually very difficult due to the discrete nature of the switching law and the complexity of stochastic constraints. To obtain a numerical solution, this problem is formulated as a constrained nonlinear parameter selection problem (CNPSP) based on a relaxation transformation (RT) technique, an adaptive sample approximation (ASA) method, a smooth approximation (SA) technique, and a control parameterization (CP) method. Following that, a penalty function-based random search (PFRS) algorithm is designed for solving the CNPSP based on a novel search rule-based penalty function (NSRPF) method and a novel random search (NRS) algorithm. The convergence results show that the proposed method is globally convergent. Finally, an optimal control problem in automobile test-driving with gear shifts (ATGS) is further extended to illustrate the effectiveness of the proposed method by taking into account some stochastic constraints. Numerical results show that compared with other typical methods, the proposed method is less conservative and can obtain a stable and robust performance when considering the small perturbations in initial system state. In addition, to balance the computation amount and the numerical solution accuracy, a tolerance setting method is also provided by the numerical analysis technique.     

On dynamic programming for sequential decision problems under a general form of uncertainty

We study the applicability of the method of Dynamic Programming (DP) for the solution of a general class of sequential decision problems under uncertainty, that may more commonly be referred to as discrete-time control problems under uncertainty. The uncertainty is due to the fact that the evolution of the state of the controlled system is affected by disturbances that are only known to belong to random sets, whose distributions are given a-priori. This includes as special cases the well known stochastic control problem and the robust min-max problem.     

A new distributionally robust p-hub median problem with uncertain carbon emissions and its tractable approximation method

The p-hub median problem is to determine the optimal location for p hubs and assign the remaining nodes to hubs so as to minimize the total transportation costs. Under the carbon cap-and-trade policy, we study this problem by addressing the uncertain carbon emissions from the transportation, where the probability distributions of the uncertain carbon emissions are only partially available. A novel distributionally robust optimization model with the ambiguous chance constraint is developed for the uncapacitated single allocation p-hub median problem. The proposed distributionally robust optimization problem is a semi-infinite chance-constrained optimization model, which is computationally intractable for general ambiguity sets. To solve this hard optimization model, we discuss the safe approximation to the ambiguous chance constraint in the following two types of ambiguity sets. The first ambiguity set includes the probability distributions with the bounded perturbations with zero means. In this case, we can turn the ambiguous chance constraint into its computable form based on tractable approximation method. The second ambiguity set is the family of Gaussian perturbations with partial knowledge of expectations and variances. Under this situation, we obtain the deterministic equivalent form of the ambiguous chance constraint. Finally, we validate the proposed optimization model via a case study from Southeast Asia and CAB data set. The numerical experiments indicate that the optimal solutions depend heavily on the distribution information of carbon emissions. In addition, the comparison with the classical robust optimization method shows that the proposed distributionally robust optimization method can avoid over-conservative solutions by incorporating partial probability distribution information. Compared with the stochastic optimization method, the proposed method pays a small price to depict the uncertainty of probability distribution. Compared with the deterministic model, the proposed method generates the new robust optimal solution under uncertain carbon emissions.     

Resilient and robust finite-time H∞ control for uncertain discrete-time jump nonlinear systems

This paper studies the robust and resilient finite-time H_∞ control problem for uncertain discrete-time nonlinear systems with Markovian jump parameters. With the help of linear matrix inequalities and stochastic analysis techniques, the criteria concerning stochastic finite-time boundedness and stochastic H_∞ finite-time boundedness are initially established for the nonlinear stochastic model. We then turn to stochastic finite-time controller analysis and design to guarantee that the stochastic model is stochastically H_∞ finite-time bounded by employing matrix decomposition method. Applying resilient control schemes, the resilient and robust finite-time controllers are further designed to ensure stochastic H_∞ finite-time boundedness of the derived stochastic nonlinear systems. Moreover, the results concerning stochastic finite-time stability and stochastic finite-time boundedness are addressed. All derived criteria are expressed in terms of linear matrix inequalities, which can be solved by utilizing the available convex optimal method. Finally, the validity of obtained methods is illustrated by numerical examples.     

Robust H∞ control for a class of switched nonlinear cascade systems via multiple Lyapunov functions approach

This paper addresses the problem of robust H_∞ control for a class of switched nonlinear cascade systems with parameter uncertainty using the multiple Lyapunov functions (MLFs) approach. Each subsystem under consideration is composed of two cascade-connected parts. The uncertain parameters are assumed to be in a known compact set and are allowed to enter the system nonlinearly. Based on the explicit construction of Lyapunov functions, which avoids solving the Hamilton-Jacobi equations, sufficient conditions for the solvability of the robust H_∞ control problem are presented. As an application, the hybrid robust H_∞ control problem for a class of uncertain non-switched nonlinear cascade systems is solved when no single continuous controller is effective. Finally, a numerical example is provided to demonstrate the feasibility of the proposed method.     

New efficient numerical procedures for solving stochastic variational problems with a priori maximum pointwise error estimates

In a previous paper we gave a new formulation and derived the Euler equations and other necessary conditions to solve strong, pathwise, stochastic variational problems with trajectories driven by Brownian motion. Thus, unlike current methods which minimize the control over deterministic functionals (the expected value), we find the control which gives the critical point solution of random functionals of a Brownian path and then, if we choose, find the expected value.This increase in information is balanced by the fact that our methods are anticipative while current methods are not. However, our methods are more directly connected to the theory and meaningful examples of deterministic variational theory and provide better means of solution for free and constrained problems. In addition, examples indicate that there are methods to obtain nonanticipative solutions from our equations although the anticipative optimal cost function has smaller expected value.In this paper we give new, efficient numerical methods to find the solution of these problems in the quadratic case. Of interest is that our numerical solution has a maximal, a priori, pointwise error of O(h3/2) where h is the node size. We believe our results are unique for any theory of stochastic control and that our methods of proof involve new and sophisticated ideas for strong solutions which extend previous deterministic results by the first author where the error was O(h²).We note that, although our solutions are given in terms of stochastic differential equations, we are not using the now standard numerical methods for stochastic differential equations. Instead we find an approximation to the critical point solution of the variational problem using relations derived from setting to zero the directional derivative of the cost functional in the direction of simple test functions.Our results are even more significant than they first appear because we can reformulate stochastic control problems or constrained calculus of variations problems in the unconstrained, stochastic calculus of variations formulation of this paper. This will allow us to find efficient and accurate numerical solutions for general constrained, stochastic optimization problems. This is not yet being done, even in the deterministic case, except by the first author.     

On the approximability of adjustable robust convex optimization under uncertainty

In this paper, we consider adjustable robust versions of convex optimization problems with uncertain constraints and objectives and show that under fairly general assumptions, a static robust solution provides a good approximation for these adjustable robust problems. An adjustable robust optimization problem is usually intractable since it requires to compute a solution for all possible realizations of uncertain parameters, while an optimal static solution can be computed efficiently in most cases if the corresponding deterministic problem is tractable. The performance of the optimal static robust solution is related to a fundamental geometric property, namely, the symmetry of the uncertainty set. Our work allows for the constraint and objective function coefficients to be uncertain and for the constraints and objective functions to be convex, thereby providing significant extensions of the results in Bertsimas and Goyal (Math Oper Res 35:284–305, 2010) and Bertsimas et al. (Math Oper Res 36: 24–54, 2011b) where only linear objective and linear constraints were considered. The models in this paper encompass a wide variety of problems in revenue management, resource allocation under uncertainty, scheduling problems with uncertain processing times, semidefinite optimization among many others. To the best of our knowledge, these are the first approximation bounds for adjustable robust convex optimization problems in such generality.     

Optimal Guaranteed Cost Control of Stochastic Discrete-Time Systems with States and Input Dependent Noise Under Markovian Switching

A problem of robust guaranteed cost control of stochastic discrete-time systems with parametric uncertainties under Markovian switching is considered. The control is simultaneously applied to both the random and the deterministic components of the system. The noise (the random) term depends on both the states and the control input. The jump Markovian switching is modeled by a discrete-time Markov chain and the noise or stochastic environmental disturbance is modeled by a sequence of identically independently normally distributed random variables. Using linear matrix inequalities (LMIs) approach, the robust quadratic stochastic stability is obtained. The proposed control law for this quadratic stochastic stabilization result depended on the mode of the system. This control law is developed such that the closed-loop system with a cost function has an upper bound under all admissible parameter uncertainties. The upper bound for the cost function is obtained as a minimization problem. Two numerical examples are given to demonstrate the potential of the proposed techniques and obtained results.     

Averaging of acoustic equation for partially perforated viscoelastic material with channels filled by a liquid

Acoustic equations for combined media consisting of partially perforated viscoelastic material and viscous incompressible liquid filling pores are considered. An averaged model is constructed for the model under consideration, and boundary conditions connecting equations of the obtained averaged model on the boundary between solid viscoelastic material and porous viscoelastic material filled by a viscous incompressible liquid are found. The convergence of limit problems to the solution of corresponding averaged problem with respect to the norm of the space L ² is proved.     

Robust penalty function method for an uncertain multi-time control optimization problems

This paper gives some new results on multi-time first-order PDE constrained control optimization problem in the face of data uncertainty (MCOPU). We obtain the robust sufficient optimality conditions for (MCOPU). Further, we construct an unconstrained multi-time control optimization problem (MCOPU)_? corresponding to (MCOPU) via absolute value penalty function method. Then, we show that the robust optimal solution to the constrained problem and a robust minimizer to the unconstrained problem are equivalent under suitable hypotheses. Moreover, we give some non-trivial examples to validate the results established in this paper.     

基于鲁棒二阶随机占优的投资组合优化模型研究

本文主要考虑一类经典的含有二阶随机占优约束的投资组合优化问题,其目标为最大化期望收益,同时利用二阶随机占优约束度量风险,满足期望收益二阶随机占优预定的参考目标收益。与传统的二阶随机占优投资组合优化模型不同,本文考虑不确定的投资收益率,并未知其精确的概率分布,但属于某一不确定集合,建立鲁棒二阶随机占优投资组合优化模型,借助鲁棒优化理论,推导出对应的鲁棒等价问题。最后,采用S&P 500股票市场的实际数据,对模型进行不同训练样本规模和不确定集合下的最优投资组合的权重、样本内和样本外不确定参数对期望收益的影响的分析。结果表明,投资收益率在最新的历史数据规模下得出的投资策略,能够获得较高的样本外期望收益,对未来投资更具参考意义。在保证样本内解的最优性的同时,也能取得较高的样本外期望收益和随机占优约束被满足的可行性。     

On distributionally robust optimization problems with k-th order stochastic dominance constraints induced by full random quadratic recourse

In this paper, we consider the optimization problems with k-th order stochastic dominance constraint on the objective function of the two-stage stochastic programs with full random quadratic recourse. By establishing the Lipschitz continuity of the feasible set mapping under some pseudo-metric, we show the Lipschitz continuity of the optimal value function and the upper semicontinuity of the optimal solution mapping of the problem. Furthermore, by the Hölder continuity of parameterized ambiguity set under the pseudo-metric, we demonstrate the quantitative stability results of the feasible set mapping, the optimal value function and the optimal solution mapping of the corresponding distributionally robust problem.     

Cure Cycle Design for Thermosetting-Matrix Composites Fabrication under Uncertainty

Design of the optimal cure temperature cycle is imperative for low-cost of manufacturing thermosetting-matrix composites. Uncertainties exist in several material and process parameters, which lead to variability in the process performance and product quality. This paper addresses the problem of determining the optimal cure temperature cycles under uncertainty. A stochastic model is developed, in which the parameter uncertainties are represented as probability density functions, and deterministic numerical process simulations based on the governing process physics are used to determine the distributions quantifying the output parameter variability. A combined Nelder–Mead Simplex method and the simulated annealing algorithm is used in conjunction with the stochastic model to obtain time-optimal cure cycles, subject to constraints on parameters influencing the product quality. Results are presented to illustrate the effects of a degree of parameter uncertainty, constraint values, and material kinetics on the optimal cycles. The studies are used to identify a critical degree of uncertainty in practice above which a rigorous analysis and design under uncertainty is warranted; below this critical value, a deterministic optimal cure cycle may be used with reasonable confidence.     

Robust multiobjective optimization & applications in portfolio optimization

Motivated by Markowitz portfolio optimization problems under uncertainty in the problem data, we consider general convex parametric multiobjective optimization problems under data uncertainty. For the first time, this uncertainty is treated by a robust multiobjective formulation in the gist of Ben-Tal and Nemirovski. For this novel formulation, we investigate its relationship to the original multiobjective formulation as well as to its scalarizations. Further, we provide a characterization of the location of the robust Pareto frontier with respect to the corresponding original Pareto frontier and show that standard techniques from multiobjective optimization can be employed to characterize this robust efficient frontier. We illustrate our results based on a standard mean–variance problem.     

Robust optimal investment–reinsurance strategies for an insurer with multiple dependent risks

This paper considers a robust optimal investment and reinsurance problem with multiple dependent risks for an Ambiguity-Averse Insurer (AAI), who is uncertain about the model parameters. We assume that the surplus of the insurance company can be allocated to the financial market consisting of one risk-free asset and one risky asset whose price process satisfies square root factor process. Under the objective of maximizing the expected utility of the terminal surplus, by adopting the technique of stochastic control, closed-form expressions of the robust optimal strategy and the corresponding value function are derived. The verification theorem is also provided. Finally, by presenting some numerical examples, the impact of some parameters on the optimal strategy is illustrated and some economic explanations are also given. We find that the robust optimal reinsurance strategies under the generalized mean–variance premium are very different from that under the variance premium principle. In addition, ignoring model uncertainty risk will lead to significant utility loss for the AAI.