锥优化模型在Robust桁架拓扑设计实例中的应用

本文讨论Robust桁架拓扑设计(TTD)问题，即桁架结构设计问题，使其在固定重量的情况下，具有最佳的承载能力．本文陈述了几种应用锥优化解Robust TTD问题的方法，并简介了锥优化最新的领域．同时，本文给出了一个单负荷的线性模型和一个多负荷的半正定优化模型以及Robust TTD问题．文中所有的模型均有例证．例证显示通过应用对偶性这些模型的规模能被充分的减小．     

Distributionally robust scheduling on parallel machines under moment uncertainty

This paper investigates a distributionally robust scheduling problem on identical parallel machines, where job processing times are stochastic without any exact distributional form. Based on a distributional set specified by the support and estimated moments information, we present a min-max distributionally robust model, which minimizes the worst-case expected total flow time out of all probability distributions in this set. Our model doesn’t require exact probability distributions which are the basis for many stochastic programming models, and utilizes more information compared to the interval-based robust optimization models. Although this problem originates from the manufacturing environment, it can be applied to many other fields when the machines and jobs are endowed with different meanings. By optimizing the inner maximization subproblem, the min-max formulation is reduced to an integer second-order cone program. We propose an exact algorithm to solve this problem via exploring all the solutions that satisfy the necessary optimality conditions. Computational experiments demonstrate the high efficiency of this algorithm since problem instances with 100 jobs are optimized in a few seconds. In addition, simulation results convincingly show that the proposed distributionally robust model can hedge against the bias of estimated moments and enhance the robustness of production systems.     

Support vector machine classifiers with uncertain knowledge sets via robust optimization

In this article we study support vector machine (SVM) classifiers in the face of uncertain knowledge sets and show how data uncertainty in knowledge sets can be treated in SVM classification by employing robust optimization. We present knowledge-based SVM classifiers with uncertain knowledge sets using convex quadratic optimization duality. We show that the knowledge-based SVM, where prior knowledge is in the form of uncertain linear constraints, results in an uncertain convex optimization problem with a set containment constraint. Using a new extension of Farkas' lemma, we reformulate the robust counterpart of the uncertain convex optimization problem in the case of interval uncertainty as a convex quadratic optimization problem. We then reformulate the resulting convex optimization problems as a simple quadratic optimization problem with non-negativity constraints using the Lagrange duality. We obtain the solution of the converted problem by a fixed point iterative algorithm and establish the convergence of the algorithm. We finally present some preliminary results of our computational experiments of the method.     

一类分布鲁棒线性决策随机优化研究

随机优化广泛应用于经济、管理、工程和国防等领域,分布鲁棒优化作为解决分布信息模糊下的随机优化问题近年来成为学术界的研究热点.本文基于φ-散度不确定集和线性决策方式研究一类分布鲁棒随机优化的建模与计算,构建了易于计算实现的分布鲁棒随机优化的上界和下界问题.数值算例验证了模型分析的有效性.     

Quadratic optimization problems in robust beamforming

This paper presents a class of constrained optimization problems whereby a quadratic cost function is to be minimized with respect to a weight vector subject to an inequality quadratic constraint on the weight vector. This class of constrained optimization problems arises as a result of a motivation for designing robust antenna array processors in the field of adaptive array processing. The constrained optimization problem is first solved by using the primal-dual method. Numerical techniques are presented to reduce the computational complexity of determining the optimal Lagrange multiplier and hence the optimal weight vector. Subsequently, a set of linear constraints or at most linear plus norm constraints are developed for approximating the performance achievable with the quadratic constraint. The use of linear constraints is very attractive, since they reduce the computational burden required to determine the optimal weight vector.     

A note on issues of over-conservatism in robust optimization with cost uncertainty

We identify and discuss issues of hidden over-conservatism in robust linear optimization, when the uncertainty set is polyhedral with a budget of uncertainty constraint. The decision-maker selects the budget of uncertainty to reflect his degree of risk aversion, i.e. the maximum number of uncertain parameters that can take their worst-case value. In the first setting, the cost coefficients of the linear programming problem are uncertain, as is the case in portfolio management with random stock returns. We provide an example where, for moderate values of the budget, the optimal solution becomes independent of the nominal values of the parameters, i.e. is completely disconnected from its nominal counterpart, and discuss why this happens. The second setting focusses on linear optimization with uncertain upper bounds on the decision variables, which has applications in revenue management with uncertain demand and can be rewritten as a piecewise linear problem with cost uncertainty. We show in an example that it is possible to have more demand parameters equal their worst-case value than what is allowed by the budget of uncertainty, although the robust formulation is correct. We explain this apparent paradox.     

A distributionally robust optimization model for batch nonlinear switched time-delay system considering uncertain output measurements

In this paper, we consider a nonlinear switched time-delay (NSTD) system with unknown switching times and unknown system parameters, where the output measurement is uncertain. This system is the underling dynamical system for the batch process of glycerol bioconversion to 1,3-propanediol induced by Klebsiella pneumoniae. The uncertain output measurement is regarded as a stochastic vector (whose components are stochastic variables) and the only information about its distribution is the first-order moment. The objective of this paper is to identify the unknown quantities of the NSTD system. For this, a distributionally robust optimization problem (a bi-level optimization problem) governed by the NSTD system is proposed, where the relative error under the environment of uncertain output measurements is involved in the cost functional. The bi-level optimization problem is transformed into a single-level optimization problem with non-smooth term through the application of duality theory in probability space. By applying the smoothing technique, the non-smooth term is approximated by a smooth term and the convergence of the approximation is established. Then, the gradients of the cost functional with respect to switching times and system parameters are derived. A hybrid optimization algorithm is developed to solve the transformed problem. Finally, we verify the obtained switching times and system parameters, as well as the effectiveness of the proposed algorithm, by solving this distributionally robust optimization problem.     

多目标应急物流中心选址的鲁棒优化模型

针对重大突发事件的应急物资救援,研究了应急物流中心的选址及应急物资的调运问题。利用离散的情景集合描述受灾点应急物资需求的不确定性以及应急物资运输成本和运输时间的不确定性,同时考虑应急救援成本和应急救援时间两个目标,建立了多目标应急物流中心选址的确定型模型和鲁棒优化模型。为将多目标问题转化为单目标问题,利用成本单目标和时间单目标的最优结果将多目标转化为相对值再加权处理,该方法既可消除多个目标之间的单位及数量级差异,还可以根据问题的数据变化进行动态调整。以提供应急物资救援服务的设施作为编码,设计了一种通用的混合蛙跳算法。为检验模型和算法的有效性,设计了一个多情景的算例,结果表明两个模型和算法具备良好的可行性和有效性,且鲁棒优化模型能较好地保持对各种不确定性的抗干扰能力;最后,讨论分析了成本偏好权重和鲁棒约束系数的影响,结果表明可根据成本偏好权重的取值范围来区分各种应急救援阶段,体现不同救援阶段的救援要求及特征,并给出了成本偏好权重和鲁棒约束系数的取值建议。     

On robust optimization of two-stage systems

Robust-optimization models belong to a special class of stochastic programs, where the traditional expected cost minimization objective is replaced by one that explicitly addresses cost variability. This paper explores robust optimization in the context of two-stage planning systems. We show that, under arbitrary measures for variability, the robust optimization approach might lead to suboptimal solutions to the second-stage planning problem. As a result, the variability of the second-stage costs may be underestimated, thereby defeating the intended purpose of the model. We propose sufficient conditions on the variability measure to remedy this problem. Under the proposed conditions, a robust optimization model can be efficiently solved using a variant of the L-shaped decomposition algorithm for traditional stochastic linear programs. We apply the proposed framework to standard stochastic-programming test problems and to an application that arises in auctioning excess electric power. Mathematics Subject Classification (1991):90C15, 90C33, 90B50, 90A09, 90A43Supported in part by NSF Grants DMI-0099726 and DMI-0133943     

求解一类逆鲁棒优化问题的牛顿型扰动方法

逆优化问题是指通过调整目标函数和约束中的某些参数使得已知的一个解成为参数调整后的优化问题的最优解.本文考虑求解一类逆鲁棒优化问题.首先,我们将该问题转化为带有一个线性等式约束,一个二阶锥互补约束和一个线性互补约束的极小化问题;其次,通过一类扰动方法来对转化后的极小化问题进行求解,然后利用带Armijo线搜索的非精确牛顿法求解每一个扰动问题.最后,通过数值实验验证该方法行之有效.     

Optimization Approach to the Robustness of Linear Delay Systems

By using the Lyapunov equation approach and an improved Razumikhin-type theorem, this paper presents a new robust stability criterion for a linear system subject to delayed time-varying nonlinear perturbations. Then, by using a parameter optimization technique, an efficient algorithm is derived for determining a desirable matrix for the Lyapunov equation. As a consequence, less conservative robust stability bounds for the perturbed system are achieved. Numerical examples are included to demonstrate the effectiveness of the proposed approach.     

稳健矩阵回归模型和方法研究

随着大数据时代的到来,我们面临的数据越来越复杂,其中待估系数为矩阵的模型亟待构造和求解.无论在统计还是优化领域,许多专家学者都致力于矩阵模型的统计性质分析及寻找其最优解的算法设计.当随机误差期望为0且同方差时,采用基于最小二乘的模型可以很好地解决问题.当随机误差异方差,分布为重尾分布(如双指数分布,t-分布等)或数据含有异常值时,需要考虑稳健的方法来求解问题.常用的稳健方法有最小一乘,分位数,Huber等.目前稳健方法的研究大多集中于线性回归问题,对于矩阵回归问题的研究比较缺乏.本文从最小二乘模型讲起,对矩阵回归问题进行了总结和评述,同时列出了一些文献和简要介绍了我们的近期的部分工作.最后对于稳健矩阵回归,我们提出了一些展望和设想.     

Energy and reserve dispatch with distributionally robust joint chance constraints

We develop a two-stage stochastic program for energy and reserve dispatch of a joint power and gas system with a high penetration of renewables. Data-driven distributionally robust chance constraints ensure that there is no load shedding and renewable spillage with high probability. We solve this problem efficiently using conditional value-at-risk approximations and linear decision rules. Out-of-sample experiments show that this model dominates the corresponding stochastic program without chance constraints that models the effects of load shedding and renewable spillage explicitly.     

Wasserstein分布鲁棒期权定价

In this paper, the option pricing problem is formulated as a distributionally robust optimization problem, which seeks to minimize the worst case replication error for a given distributional uncertainty set(DUS) of the random underlying asset returns. The DUS is defined as a Wasserstein ball centred the empirical distribution of the underlying asset returns. It is proved that the proposed model can be reformulated as a computational tractable linear programming problem. Finally, the results of the empirical tests are presented to show the significance of the proposed approach.     

基于禁忌算法的中枢辐射航线网络鲁棒优化方法

文章针对航空公司构建中枢辐射航线网络问题展开研究,采用鲁棒优化的方法建立数学模型,针对鲁棒解的特点以及问题的复杂性,将禁忌算法和最短路算法相结合并加以改进,提出了一种适应于求解大型问题的启发式算法,并通过实例进行了仿真实现.     

Finding Robust Solutions Using Local Search

This paper investigates how a local search metaheuristic for continuous optimisation can be adapted so that it finds broad peaks, corresponding to robust solutions. This is relevant in problems in which uncertain or noisy data is present. When using a genetic or evolutionary algorithm, it is standard practice to perturb solutions once before evaluating them, using noise from a given distribution. This approach however, is not valid when using population-less techniques like local search and other heuristics that use local search. For those algorithms to find robust solutions, each solution needs to be perturbed and evaluated several times, and these evaluations need to be combined into a measure of robustness. In this paper, we examine how many of these evaluations are needed to reliably find a robust solution. We also examine the effect of the parameters of the noise distribution. Using a simple tabu search procedure, the proposed approach is tested on several functions found in the literature. This revised version was published online in August 2006 with corrections to the Cover Date.     

General Robust-Optimization Formulation for Nonlinear Programming

Most research in robust optimization has been focused so far on inequality-only, convex conic programming with simple linear models for the uncertain parameters. Many practical optimization problems, however, are nonlinear and nonconvex. Even in linear programming, the coefficients may still be nonlinear functions of the uncertain parameters. In this paper, we propose robust formulations that extend the robust-optimization approach to a general nonlinear programming setting with parameter uncertainty involving both equality and inequality constraints. The proposed robust formulations are valid in a neighborhood of a given nominal parameter value and are robust to the first-order, thus suitable for applications where reasonable parameter estimations are available and uncertain variations are moderate. This work was supported in part by NSF Grant DMS-0405831     

Robust discrete optimization and network flows

We propose an approach to address data uncertainty for discrete optimization and network flow problems that allows controlling the degree of conservatism of the solution, and is computationally tractable both practically and theoretically. In particular, when both the cost coefficients and the data in the constraints of an integer programming problem are subject to uncertainty, we propose a robust integer programming problem of moderately larger size that allows controlling the degree of conservatism of the solution in terms of probabilistic bounds on constraint violation. When only the cost coefficients are subject to uncertainty and the problem is a 0–1 discrete optimization problem on n variables, then we solve the robust counterpart by solving at most n+1 instances of the original problem. Thus, the robust counterpart of a polynomially solvable 0–1 discrete optimization problem remains polynomially solvable. In particular, robust matching, spanning tree, shortest path, matroid intersection, etc. are polynomially solvable. We also show that the robust counterpart of an NP-hard -approximable 0–1 discrete optimization problem, remains -approximable. Finally, we propose an algorithm for robust network flows that solves the robust counterpart by solving a polynomial number of nominal minimum cost flow problems in a modified network. The research of the author was partially supported by the Singapore-MIT alliance.The research of the author is supported by a graduate scholarship from the National University of Singapore.Mathematics Subject Classification (2000): 90C10, 90C15     

LMI Approximations for the Radius of the Intersection of Ellipsoids: Survey

This paper surveys various linear matrix inequality relaxation techniques for evaluating the maximum norm vector within the intersection of several ellipsoids. This difficult nonconvex optimization problem arises frequently in robust control synthesis. Two randomized algorithms and several ellipsoidal approximations are described. Guaranteed approximation bounds are derived in order to evaluate the quality of these relaxations.     

Strong duality in robust semi-definite linear programming under data uncertainty

This article develops the deterministic approach to duality for semi-definite linear programming problems in the face of data uncertainty. We establish strong duality between the robust counterpart of an uncertain semi-definite linear programming model problem and the optimistic counterpart of its uncertain dual. We prove that strong duality between the deterministic counterparts holds under a characteristic cone condition. We also show that the characteristic cone condition is also necessary for the validity of strong duality for every linear objective function of the original model problem. In addition, we derive that a robust Slater condition alone ensures strong duality for uncertain semi-definite linear programs under spectral norm uncertainty and show, in this case, that the optimistic counterpart is also computationally tractable.