Two-stage stochastic variational inequalities: an ERM-solution procedure

We propose a two-stage stochastic variational inequality model to deal with random variables in variational inequalities, and formulate this model as a two-stage stochastic programming with recourse by using an expected residual minimization solution procedure. The solvability, differentiability and convexity of the two-stage stochastic programming and the convergence of its sample average approximation are established. Examples of this model are given, including the optimality conditions for stochastic programs, a Walras equilibrium problem and Wardrop flow equilibrium. We also formulate stochastic traffic assignments on arcs flow as a two-stage stochastic variational inequality based on Wardrop flow equilibrium and present numerical results of the Douglas–Rachford splitting method for the corresponding two-stage stochastic programming with recourse.     

Progressive hedging for stochastic programs with cross-scenario inequality constraints

Computational Management Science - In this paper, we show how progressive hedging may be used to solve stochastic programming problems that involve cross-scenario inequality constraints. In...     

Variational Inequalities for Combined Control and Stopping Game

Abstract

We study a nonlinear elliptic variational inequality associated with the combined stochastic control problem. By using the dynamic programming principle and the method of penalization, we establish the existence of a unique viscosity solution of the variational inequality and describe it as the value function of the corresponding combined stochastic game problem.     

Some Solvable Stochastic Control Problems With Delay

We consider optimal harvesting of systems described by stochastic differential equations with delay. We focus on those situations where the value function of the harvesting problem depends on the initial path of the process in a simple way, namely through its value at 0 and through some weighted averages

A verification theorem of variational inequality type is proved. This is applied to solve explicitly some classes of optimal harvesting delay problems     

On Exponential Hedging and Related Quadratic Backward Stochastic Differential Equations

The dual optimization problem for the exponential hedging problem is addressed with a cone constraint. Without boundedness conditions on the terminal payoff and the drift of the Ito-type controlled process, the backward stochastic differential equation, which has a quadratic growth term in the drift, is derived as a necessary and sufficient condition for optimality via a variational method and dynamic programming. Further, solvable situations are given, in which the value and the optimizer are expressed in closed forms with the help of the Clark-Haussmann-Ocone formula.     

Solving Stochastic Programming Problems with Risk Measures by Progressive Hedging

The progressive hedging algorithm for stochastic programming problems in single or multiple stages is a decomposition method which, in each iteration, solves a separate subproblem with modified costs for each scenario. The decomposition exploits the separability of objective functions formulated in terms of expected costs, but nowadays expected costs are not the only objectives of interest. Minimization of risk measures for cost, such as conditional value-at-risk, can be important as well, but their lack of separability presents a hurdle. Here it is shown how the progressive hedging algorithm can nonetheless be applied to solve many such problems through the introduction of additional variables which, like the given decision variables, get updated through aggregation of the independent computations for the various scenarios.     

Applying a Power Penalty Method to Numerically Pricing American Bond Options

In this paper, we aim to develop a numerical scheme to price American options on a zero-coupon bond based on a power penalty approach. This pricing problem is formulated as a variational inequality problem (VI) or a complementarity problem (CP). We apply a fitted finite volume discretization in space along with an implicit scheme in time, to the variational inequality problem, and obtain a discretized linear complementarity problem (LCP). We then develop a power penalty approach to solve the LCP by solving a system of nonlinear equations. The unique solvability and convergence of the penalized problem are established. Finally, we carry out numerical experiments to examine the convergence of the power penalty method and to testify the efficiency and effectiveness of our numerical scheme.     

On the Convergence of Coderivative of SAA Solution Mapping for a Parametric Stochastic Variational Inequality

The aim of this paper is to investigate the convergence properties for Mordukhovich’s coderivative of the solution map of the sample average approximation (SAA) problem for a parametric stochastic variational inequality with equality and inequality constraints. The notion of integrated deviation is introduced to characterize the outer limit of a sequence of sets. It is demonstrated that, under suitable conditions, both the cosmic deviation and the integrated deviation between the coderivative of the solution mapping to SAA problem and that of the solution mapping to the parametric stochastic variational inequality converge almost surely to zero as the sample size tends to infinity. Moreover, the exponential convergence rate of coderivatives of the solution maps to the SAA parametric stochastic variational inequality is established. The results are used to develop sufficient conditions for the consistency of the Lipschitz-like property of the solution map of SAA problem and the consistency of stationary points of the SAA estimator for a stochastic bilevel program.     

On the implementation of a log-barrier progressive hedging method for multistage stochastic programs

A progressive hedging method incorporated with self-concordant barrier for solving multistage stochastic programs is proposed recently by Zhao [G. Zhao, A Lagrangian dual method with self-concordant barrier for multistage stochastic convex nonlinear programming, Math. Program. 102 (2005) 1-24]. The method relaxes the nonanticipativity constraints by the Lagrangian dual approach and smoothes the Lagrangian dual function by self-concordant barrier functions. The convergence and polynomial-time complexity of the method have been established. Although the analysis is done on stochastic convex programming, the method can be applied to the nonconvex situation. We discuss some details on the implementation of this method in this paper, including when to terminate the solution of unconstrained subproblems with special structure and how to perform a line search procedure for a new dual estimate effectively. In particular, the method is used to solve some multistage stochastic nonlinear test problems. The collection of test problems also contains two practical examples from the literature. We report the results of our preliminary numerical experiments. As a comparison, we also solve all test problems by the well-known progressive hedging method.     

The sample average approximation method for empty container repositioning with uncertainties

One of the challenges faced by liner operators today is to effectively operate empty containers in order to meet demand and to reduce inefficiency in an uncertain environment. To incorporate uncertainties in the operations model, we formulate a two-stage stochastic programming model with random demand, supply, ship weight capacity, and ship space capacity. The objective of this model is to minimize the expected operational cost for Empty Container Repositioning (ECR). To solve the stochastic programs with a prohibitively large number of scenarios, the Sample Average Approximation (SAA) method is applied to approximate the expected cost function. To solve the SAA problem, we consider applying the scenario aggregation by combining the approximate solution of the individual scenario problem. Two heuristic algorithms based on the progressive hedging strategy are applied to solve the SAA problem. Numerical experiments are provided to show the good performance of the scenario-based method for the ECR problem with uncertainties.     

Stochastic variational inequalities: single-stage to multistage

Variational inequality modeling, analysis and computations are important for many applications, but much of the subject has been developed in a deterministic setting with no uncertainty in a problem’s data. In recent years research has proceeded on a track to incorporate stochasticity in one way or another. However, the main focus has been on rather limited ideas of what a stochastic variational inequality might be. Because variational inequalities are especially tuned to capturing conditions for optimality and equilibrium, stochastic variational inequalities ought to provide such service for problems of optimization and equilibrium in a stochastic setting. Therefore they ought to be able to deal with multistage decision processes involving actions that respond to increasing levels of information. Critical for that, as discovered in stochastic programming, is introducing nonanticipativity as an explicit constraint on responses along with an associated “multiplier” element which captures the “price of information” and provides a means of decomposition as a tool in algorithmic developments. That idea is extended here to a framework which supports multistage optimization and equilibrium models while also clarifying the single-stage picture.     

A resource portfolio planning model using sampling-based stochastic programming and genetic algorithm

Resource portfolio planning optimization is crucial to high-tech manufacturing industries. One of the most important characteristics of such a problem is intensive investment and risk in demands. In this study, a nonlinear stochastic optimization model is developed to maximize the expected profit under demand uncertainty. For solution efficiency, a stochastic programming-based genetic algorithm (SPGA) is proposed to determine a profitable capacity planning and task allocation plan. The algorithm improves a conventional two-stage stochastic programming by integrating a genetic algorithm into a stochastic sampling procedure to solve this large-scale nonlinear stochastic optimization on a real-time basis. Finally, the tradeoff between profits and risks is evaluated under different settings of algorithmic and hedging parameters. Experimental results have shown that the proposed algorithm can solve the problem efficiently.     

随机交通均衡配流模型及其等价的变分不等式问题

本文讨论了交通网络系统的随机用户均衡原理的数学表述问题.在路段出行成本是流量的单调函数的较弱条件下,对具有固定需求和弹性需求的模式,首次证明了随机均衡配流模型可表示为一个变分不等式问题,同时也说明了该变分不等式问题与相应的互补问题以及一个凸规划问题之间的等价关系.     

On Stochastic Mirror-prox Algorithms for Stochastic Cartesian Variational Inequalities: Randomized Block Coordinate and Optimal Averaging Schemes

Motivated by multi-user optimization problems and non-cooperative Nash games in uncertain regimes, we consider stochastic Cartesian variational inequality problems where the set is given as the Cartesian product of a collection of component sets. First, we consider the case where the number of the component sets is large and develop a randomized block stochastic mirror-prox algorithm, where at each iteration only a randomly selected block coordinate of the solution vector is updated through implementing two consecutive projection steps. We show that when the mapping is strictly pseudo-monotone, the algorithm generates a sequence of iterates that converges to the solution of the problem almost surely. When the maps are strongly pseudo-monotone, we prove that the mean-squared error diminishes at the optimal rate. Second, we consider large-scale stochastic optimization problems with convex objectives and develop a new averaging scheme for the randomized block stochastic mirror-prox algorithm. We show that by using a different set of weights than those employed in the classical stochastic mirror-prox methods, the objective values of the averaged sequence converges to the optimal value in the mean sense at an optimal rate. Third, we consider stochastic Cartesian variational inequality problems and develop a stochastic mirror-prox algorithm that employs the new weighted averaging scheme. We show that the expected value of a suitably defined gap function converges to zero at an optimal rate.     

Expected Residual Minimization Formulation for a Class of Stochastic Vector Variational Inequalities

This paper considers a class of vector variational inequalities. First, we present an equivalent formulation, which is a scalar variational inequality, for the deterministic vector variational inequality. Then we concentrate on the stochastic circumstance. By noting that the stochastic vector variational inequality may not have a solution feasible for all realizations of the random variable in general, for tractability, we employ the expected residual minimization approach, which aims at minimizing the expected residual of the so-called regularized gap function. We investigate the properties of the expected residual minimization problem, and furthermore, we propose a sample average approximation method for solving the expected residual minimization problem. Comprehensive convergence analysis for the approximation approach is established as well.     

Stochastic variational inequalities with jumps

This work is devoted to the study of a stochastic variational inequality with a Wiener–Poisson driving term. Existence and uniqueness are proven for Lipschitz coefficients and under general conditions for the unbounded term. One of the main tools used in order to obtain the existence result is a penalization method involving Moreau–Yosida regularization.     

Stochastic variational inequalities of parabolic type

Existence and uniqueness of strong solutions of stochastic partial differential equations of parabolic type with reflection (e.g., the solutions are never allowed to be negative) is proved. The problem is formulated as a stochastic variational inequality and then compactness is used to derive the result, but the method requires the space dimension to be one.This research was supported by NSERC under Grant No. 8051.     

带补偿的随机二次规划的近似Lagrange-Newton方法

In this paper, two-stage stochastic quadratic programming problems with equality constraints are considered. By Monte Carlo simulation-based approximations of the objective function and its first (second)derivative,an inexact Lagrange-Newton type method is proposed.It is showed that this method is globally convergent with probability one. In particular, the convergence is local superlinear under an integral approximation error bound condition.Moreover, this method can be easily extended to solve stochastic quadratic programming problems with inequality constraints.     

二阶锥约束随机变分不等式问题的数值方法研究

本文研究二阶锥约束随机变分不等式(SOCCSVI)问题,运用样本均值近似(SAA)方法结合光滑Fischer-Burmeister互补函数来求解该问题.首先,将SOCCSVI问题的Karush-Kuhn-Tucker系统转化为与之等价的方程组,并证明了该方程组的雅可比矩阵的非奇异性.其次,构造了光滑牛顿算法求解该方程组.最后,文章给出了两个数值实验证明了算法的有效性.     

The Rain on Underground Porous Media Part I: Analysis of a Richards Model

The Richards equation models the water flow in a partially saturated underground porous medium under the surface. When it rains on the surface, boundary conditions of Signorini type must be considered on this part of the boundary. The authors first study this problem which results into a variational inequality and then propose a discretization by an implicit Euler’s scheme in time and finite elements in space. The convergence of this discretization leads to the well-posedness of the problem.