The generalized residual cutting method and its convergence characteristics

Iterative methods and especially Krylov subspace methods (KSM) are a very useful numerical tool in solving for large and sparse linear systems problems arising in science and engineering modeling. More recently, the nested loop KSM have been proposed that improve the convergence of the traditional KSM. In this article, we review the residual cutting (RC) and the generalized residual cutting (GRC) that are nested loop methods for large and sparse linear systems problems. We also show that GRC is a KSM that is equivalent to Orthomin with a variable preconditioning. We use the modified Gram–Schmidt method to derive a stable GRC algorithm. We show that GRC presents a general framework for constructing a class of “hybrid” (nested) KSM based on inner loop method selection. We conduct numerical experiments using nonsymmetric indefinite matrices from a widely used library of sparse matrices that validate the efficiency and the robustness of the proposed methods.     

Algebraic substructuring (AS) for eigenvalue and frequency response calculations

Eigenvalue and frequency response calculations are ubiquitous in scientific modeling and engineering analysis. Algebraic substructuring (AS) method is a powerful numerical technique for solving extremely large scale problems. We developed a unified framework and AS code that can solve both problems efficiently. Furthermore, we addressed some of the open problems in this field, including resolving arbitrary eigenmodes, performing high frequency response analysis, accuracy and performance. (© 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

A new regularized stochastic approximation framework for stochastic inverse problems

We study the nonlinear inverse problem of estimating stochastic parameters in the fourth-order partial differential equation with random data. The primary focus is on developing a novel stochastic approximation framework for inverse problems consisting of three key components. As a first step, we reformulate the inverse problem into a stochastic convex optimization problem. The second step includes developing a new regularized stochastic extragradient framework for a nonlinear variational inequality, which subsumes the optimality conditions for the optimization formulation of the inverse problem. The third step involves modeling random variables by a Karhunen–Loève type finite-dimensional noise representation, allowing the direct and the inverse problems to be conveniently discretized. We show that the regularized extragradient methods are strongly convergent in a Hilbert space setting, and we also provide several auxiliary results for the inverse problem, including Lipschitz continuity and a derivative characterization of the solution map. We provide the outcome of computational experiments to estimate stochastic and deterministic parameters. The numerical results demonstrate the feasibility and effectiveness of the developed framework and validate stochastic approximation as an effective method for stochastic inverse problems.     

Spatial Lanchester models

Lanchester equations have been widely used to model combat for many years, nevertheless, one of their most important limitations has been their failure to model the spatial dimension of the problems. Despite the fact that some efforts have been made in order to overcome this drawback, mainly through the use of Reaction–Diffusion equations, there is not yet a consistently clear theoretical framework linking Lanchester equations with these physical systems, apart from similarity. In this paper, a spatial modeling of Lanchester equations is conceptualized on the basis of explicit movement dynamics and balance of forces, ensuring stability and theoretical consistency with the original model. This formulation allows a better understanding and interpretation of the problem, thus improving the current treatment, modeling and comprehension of warfare applications. Finally, as a numerical illustration, a new spatial model of responsive movement is developed, confirming that location influences the results of modeling attrition conflict between two opposite forces.     

A class of random field memory models for mortality forecasting

This article proposes a parsimonious alternative approach for modeling the stochastic dynamics of mortality rates. Instead of the commonly used factor-based decomposition framework, we consider modeling mortality improvements using a random field specification with a given causal structure. Such a class of models introduces dependencies among adjacent cohorts aiming at capturing, among others, the cohort effects and cross generations correlations. It also describes the conditional heteroskedasticity of mortality. The proposed model is a generalization of the now widely used AR-ARCH models for random processes. For such a class of models, we propose an estimation procedure for the parameters. Formally, we use the quasi-maximum likelihood estimator (QMLE) and show its statistical consistency and the asymptotic normality of the estimated parameters. The framework being general, we investigate and illustrate a simple variant, called the three-level memory model, in order to fully understand and assess the effectiveness of the approach for modeling mortality dynamics.     

Modeling and solving profitable location and distribution problems

In this paper we present a general framework for tackling combined location and routing problems (LRPs), involving both costs and profits at the same time. Our framework is based on an extended model and a unified branch-and-cut-and-price method, using dynamic programming pricing routines, strengthening cuts, primal heuristics, stabilization and ad-hoc branching rules to exactly solve LRPs. First we describe our framework, discussing its algorithmic components. Then, we consider as a test case three problems from the literature, with increasing relative importance of the location decisions over the routing ones, and we analyze the performance of our framework for solving them. The first result of our investigation is to assess the tradeoff between modeling detail and computational effectiveness in tackling LRPs. At the same time, we also show that our integrated exact approach is effective for these problems.     

Multistage Markov Chain Modeling of the Genetic Algorithm and Convergence Results

The genetic algorithm (GA) has been widely used to solve combinatorial global optimization problems. Despite the successes that GA encounters in practical applications, there exist few precise results on its behavior. In this article, we formulate a fully rigorous mathematical modeling of GA as a multistage Markov chain and derive convergence results. Variations that include the simulated annealing algorithm and the GA with superindividual are considered.     

A new approach for modeling and solving set packing problems

In recent years the unconstrained quadratic binary program has emerged as a unified modeling and solution framework for a variety of combinatorial optimization problems. Experience reported in the literature with several problem classes has demonstrated that this unified approach works surprisingly well in terms of solution quality and computational times, often rivaling and sometimes surpassing special purpose methods. In this paper we report on the application of this unified framework to set packing problems with a variety of coefficient distributions. Computational experience is reported illustrating the attractiveness of the approach. In particular, our results highlight both the effectiveness and robustness of our approach across a wide array of test problems.     

Robust portfolio modeling with incomplete cost information and project interdependencies

Robust portfolio modeling (RPM) [Liesiö, J., Mild, P., Salo, A., 2007. Preference programming for robust portfolio modeling and project selection. European Journal of Operational Research 181, 1488–1505] supports project portfolio selection in the presence of multiple evaluation criteria and incomplete information. In this paper, we extend RPM to account for project interdependencies, incomplete cost information and variable budget levels. These extensions lead to a multi-objective zero-one linear programming problem with interval-valued objective function coefficients for which all non-dominated solutions are determined by a tailored algorithm. The extended RPM framework permits more comprehensive modeling of portfolio problems and provides support for advanced benefit–cost analyses. It retains the key features of RPM by providing robust project and portfolio recommendations and by identifying projects on which further attention should be focused. The extended framework is illustrated with an example on product release planning.     

Mono-implicit Runge–Kutta formulae for the numerical solution of second order nonlinear two-point boundary value problems

Mono-implicit Runge–Kutta (MIRK) formulae are widely used for the numerical solution of first order systems of nonlinear two-point boundary value problems. In order to avoid costly matrix multiplications, MIRK formulae are usually implemented in a deferred correction framework and this is the basis of the well known boundary value code TWPBVP. However, many two-point boundary value problems occur naturally as second (or higher) order equations or systems and for such problems there are significant savings in computational effort to be made if the MIRK methods are tailored for these higher order forms. In this paper, we describe MIRK algorithms for second order equations and report numerical results that illustrate the substantial savings that are possible particularly for second order systems of equations where the first derivative is absent.     

A new perspective to stress–strength models

The stress–strength models have been widely used for reliability design of systems. In these models the reliability is defined as the probability that the strength is larger than the stress. The analysis is then based on the binary reliability theory since there are two possible states for the system. In this paper, we study the stress–strength reliability in a different framework assigning more than two states to the system depending on the difference between strength and stress values. In other words, the stress–strength reliability is studied under multi-state system modeling. System state probabilities are evaluated and estimated under various assumptions on the system. The multicomponent form is also studied and some results are provided for large systems.     

On convex modified output least-squares for elliptic inverse problems: stability,regularization, applications,and numerics

Abstract

Inverse problems of identifying parameters in partial differential equations constitute an important class of problems with diverse real-world applications. These identification problems are commonly explored in an optimization framework and there are many optimization formulations having their own advantages and disadvantages. Although a non-convex output least-squares (OLS) objective is commonly used, a convex-modified output least-squares (MOLS) has shown encouraging results in recent years. In this work, we focus on various aspects of the MOLS approach. We devise a rigorous (quadratic and non-quadratic) regularization framework for the identification of smooth as well as discontinuous coefficients. This framework subsumes the total variation regularization that has attracted a great deal of attention in identifying sharply varying coefficients and also in image processing. We give new existence results for the regularized optimization problems for OLS and MOLS. Restricting to the Tikhonov (quadratic) regularization, we carry out a detailed study of various stability aspects of the inverse problem under data perturbation and give new stability estimates for general inverse problems using OLS and MOLS formulations. We give a discretization scheme for the continuous inverse problem and prove the convergence of the discrete inverse problem to the continuous one. We collect discrete formulas for OLS and MOLS and compute their gradients and Hessians. We present applications of our theoretical results. To show the feasibility of the MOLS framework, we also provide computational results for the inverse problem of identifying parameters in three different classes of partial differential equations .     

Regularization for a class of ill-posed evolution problems in Banach space

We study evolution equations in Banach space, and provide a general framework for regularizing a wide class of ill-posed Cauchy problems by proving continuous dependence on modeling for nonautonomous equations. We approximate the ill-posed problem by a well-posed one, and obtain H?lder-continuous dependence results that provide estimates of the error for a class of solutions under certain stabilizing conditions. For examples that include the linearized Korteweg-de Vries equation and the Schr?dinger equation in L ^p ,p??2, we obtain a family of regularizing operators for the ill-posed problem. This work extends to the nonautonomous case several recent results for ill-posed problems with constant coefficients.     

Institutional Logics from the Aggregation of Organizational Networks: Operational Procedures for the Analysis of Counted Data

We address some problems of network aggregation that are central to organizational studies. We show that concepts of network equivalence (including generalizations and special cases of structural equivalence) are relevant to the modeling of the aggregation of social categories in cross-classification tables portraying relations within an organizational field (analogous to one-mode networks). We extend our results to model the dual aggregation of social identities and organizational practices (an example of a two-mode network). We present an algorithm to accomplish such dual aggregation. Within the formal and quantitative framework that we present, we emphasize a unified treatment of (a) aggregation on the basis of structural equivalence (invariance of actors within equivalence sets), (b) the study of variation in relations between structurally equivalent sets, and (c) the close connections between aggregation within organizational networks and multi-dimensional modeling of organizational fields.     

Stochastic Particle Method for Nonlinear Hyperbolic Problems

In this paper, we present a new method based on stochastic particles, which allows us to compute solutions of a system of nonlinear transport equations arising in the modeling of immiscible displacement in porous pedia. In this approach, we use different particles for different phases and move them according to the stochastic rules for which the probability density function depends on the spatial distribution of the particles. Our motivation for such a method is a Lagrangian modeling framework in which one can describe certain physical phenomena more naturally than in an Eulerian framework. (© 2006 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim)     

Probabilistic decision graphs for optimization under uncertainty

This paper provides a survey on probabilistic decision graphs for modeling and solving decision problems under uncertainty. We give an introduction to influence diagrams, which is a popular framework for representing and solving sequential decision problems with a single decision maker. As the methods for solving influence diagrams can scale rather badly in the length of the decision sequence, we present a couple of approaches for calculating approximate solutions. The modeling scope of the influence diagram is limited to so-called symmetric decision problems. This limitation has motivated the development of alternative representation languages, which enlarge the class of decision problems that can be modeled efficiently. We present some of these alternative frameworks and demonstrate their expressibility using several examples. Finally, we provide a list of software systems that implement the frameworks described in the paper.     

Probabilistic decision graphs for optimization under uncertainty

This paper provides a survey on probabilistic decision graphs for modeling and solving decision problems under uncertainty. We give an introduction to influence diagrams, which is a popular framework for representing and solving sequential decision problems with a single decision maker. As the methods for solving influence diagrams can scale rather badly in the length of the decision sequence, we present a couple of approaches for calculating approximate solutions. The modeling scope of the influence diagram is limited to so-called symmetric decision problems. This limitation has motivated the development of alternative representation languages, which enlarge the class of decision problems that can be modeled efficiently. We present some of these alternative frameworks and demonstrate their expressibility using several examples. Finally, we provide a list of software systems that implement the frameworks described in the paper.     

Intelligent data analysis and model interpretation with spectral analysis fuzzy symbolic modeling

This paper proposes fuzzy symbolic modeling as a framework for intelligent data analysis and model interpretation in classification and regression problems. The fuzzy symbolic modeling approach is based on the eigenstructure analysis of the data similarity matrix to define the number of fuzzy rules in the model. Each fuzzy rule is associated with a symbol and is defined by a Gaussian membership function. The prototypes for the rules are computed by a clustering algorithm, and the model output parameters are computed as the solutions of a bounded quadratic optimization problem. In classification problems, the rules’ parameters are interpreted as the rules’ confidence. In regression problems, the rules’ parameters are used to derive rules’ confidences for classes that represent ranges of output variable values. The resulting model is evaluated based on a set of benchmark datasets for classification and regression problems. Nonparametric statistical tests were performed on the benchmark results, showing that the proposed approach produces compact fuzzy models with accuracy comparable to models produced by the standard modeling approaches. The resulting model is also exploited from the interpretability point of view, showing how the rule weights provide additional information to help in data and model understanding, such that it can be used as a decision support tool for the prediction of new data.     

Solving the maximum edge weight clique problem via unconstrained quadratic programming

The unconstrained quadratic binary program (UQP) is proving to be a successful modeling and solution framework for a variety of combinatorial optimization problems. Experience reported in the literature with several problem classes has demonstrated that this approach works surprisingly well in terms of solution quality and computational times, often rivaling and sometimes surpassing more traditional methods. In this paper we report on the application of UQP to the maximum edge-weighted clique problem. Computational experience is reported illustrating the attractiveness of the approach.     

Robust optimization approximation for joint chance constrained optimization problem

Chance constraint is widely used for modeling solution reliability in optimization problems with uncertainty. Due to the difficulties in checking the feasibility of the probabilistic constraint and the non-convexity of the feasible region, chance constrained problems are generally solved through approximations. Joint chance constrained problem enforces that several constraints are satisfied simultaneously and it is more complicated than individual chance constrained problem. This work investigates the tractable robust optimization approximation framework for solving the joint chance constrained problem. Various robust counterpart optimization formulations are derived based on different types of uncertainty set. To improve the quality of robust optimization approximation, a two-layer algorithm is proposed. The inner layer optimizes over the size of the uncertainty set, and the outer layer optimizes over the parameter t which is used for the indicator function upper bounding. Numerical studies demonstrate that the proposed method can lead to solutions close to the true solution of a joint chance constrained problem.