A modified reduced gradient method for a class of nondifferentiable problems

The class of nondifferentiable problems treated in this paper constitutes the dual of a class of convex differentiable problems. The primal problem involves faithfully convex functions of linear mappings of the independent variables in the objective function and in the constraints. The points of the dual problem where the objective function is nondifferentiable are known: the method presented here takes advantage of this fact to propose modifications necessary in the reduced gradient method to guarantee convergence.     

A modified Quasi-Newton method for vector optimization problem

In this paper, existence of critical point and weak efficient point of vector optimization problem is studied. A sequence of points in n-dimension is generated using positive definite matrices like Quasi-Newton method. It is proved that accumulation points of this sequence are critical points or weak efficient points under different conditions. An algorithm is provided in this context. This method is free from any kind of priori chosen weighting factors or any other form of a priori ranking or ordering information for objective functions. Also, this method does not depend upon initial point. The algorithm is verified in numerical examples.     

Accelerated conjugate gradient algorithm with finite difference Hessian/vector product approximation for unconstrained optimization

In this paper we propose a fundamentally different conjugate gradient method, in which the well-known parameter β_k is computed by an approximation of the Hessian/vector product through finite differences. For search direction computation, the method uses a forward difference approximation to the Hessian/vector product in combination with a careful choice of the finite difference interval. For the step length computation we suggest an acceleration scheme able to improve the efficiency of the algorithm. Under common assumptions, the method is proved to be globally convergent. It is shown that for uniformly convex functions the convergence of the accelerated algorithm is still linear, but the reduction in function values is significantly improved. Numerical comparisons with conjugate gradient algorithms including CONMIN by Shanno and Phua [D.F. Shanno, K.H. Phua, Algorithm 500, minimization of unconstrained multivariate functions, ACM Trans. Math. Softw. 2 (1976) 87–94], SCALCG by Andrei [N. Andrei, Scaled conjugate gradient algorithms for unconstrained optimization, Comput. Optim. Appl. 38 (2007) 401–416; N. Andrei, Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization, Optim. Methods Softw. 22 (2007) 561–571; N. Andrei, A scaled BFGS preconditioned conjugate gradient algorithm for unconstrained optimization, Appl. Math. Lett. 20 (2007) 645–650], and new conjugacy condition and related new conjugate gradient by Li, Tang and Wei [G. Li, C. Tang, Z. Wei, New conjugacy condition and related new conjugate gradient methods for unconstrained optimization, J. Comput. Appl. Math. 202 (2007) 523–539] or truncated Newton TN by Nash [S.G. Nash, Preconditioning of truncated-Newton methods, SIAM J. on Scientific and Statistical Computing 6 (1985) 599–616] using a set of 750 unconstrained optimization test problems show that the suggested algorithm outperforms these conjugate gradient algorithms as well as TN.     

Support vector machines for default prediction of SMEs based on technology credit

In Korea, many forms of credit guarantees have been issued to fund small and medium enterprises (SMEs) with a high degree of growth potential in technology. However, a high default rate among funded SMEs has been reported. In order to effectively manage such governmental funds, it is important to develop an accurate scoring model for selecting promising SMEs. This paper provides a support vector machines (SVM) model to predict the default of funded SMEs, considering various input variables such as financial ratios, economic indicators, and technology evaluation factors. The results show that the accuracy performance of the SVM model is better than that of back-propagation neural networks (BPNs) and logistic regression. It is expected that the proposed model can be applied to a wide range of technology evaluation and loan or investment decisions for technology-based SMEs.     

A stochastic conjugate gradient method for the approximation of functions

A stochastic conjugate gradient method for the approximation of a function is proposed. The proposed method avoids computing and storing the covariance matrix in the normal equations for the least squares solution. In addition, the method performs the conjugate gradient steps by using an inner product that is based on stochastic sampling. Theoretical analysis shows that the method is convergent in probability. The method has applications in such fields as predistortion for the linearization of power amplifiers.     

On the superlinear convergence of a trust region algorithm for nonsmooth optimization

It is proved that the second order correction trust region algorithm of Fletcher [5] ensures superlinear convergence if some mild conditions are satisfied.     

On optimal message vector length for block single parallel partition algorithm in a three-dimensional ADI solver

It has long been recognized that many direct parallel tridiagonal solvers are only efficient for solving a single tridiagonal equation of large sizes, and they become inefficient when naively used in a three-dimensional ADI solver. In order to improve the parallel efficiency of an ADI solver using a direct parallel solver, we implement the single parallel partition (SPP) algorithm in conjunction with message vectorization, which aggregates several communication messages into one to reduce the communication costs. The measured performances show that the longest allowable message vector length (MVL) is not necessarily the best choice. To understand this observation and optimize the performance, we propose an improved model that takes the cache effect into consideration. The optimal MVL for achieving the best performance is shown to depend on number of processors and grid sizes. Similar dependence of the optimal MVL is also found for the popular block pipelined method.     

An extension of gap functions for a system of vector equilibrium problems with applications to optimization problems

In this paper, the notion of gap functions is extended from scalar case to vector one. Then, gap functions and generalized functions for several kinds of vector equilibrium problems are shown. As an application, the dual problem of a class of optimization problems with a system of vector equilibrium constraints (in short, OP) is established, the concavity of the dual function, the weak duality of (OP) and the saddle point sufficient condition are derived by using generalized gap functions. This work was supported by the National Natural Science Foundation of China (10671135) and the Applied Research Project of Sichuan Province (05JY029-009-1).     

A new nonmonotone trust-region method of conic model for solving unconstrained optimization

In this paper, we present a new nonmonotone trust-region method of conic model for solving unconstrained optimization problems. Both the local and global convergence properties are analyzed under reasonable assumptions. Numerical experiments are conducted to compare this method with some existed ones which indicate that the new method is efficient.     

Upper-semi-continuity and cone-concavity of multi-valued vector functions in a duality theory for vector optimization

Following a few words on multifunctions in the mathematical literature, a very brief recall on dual spaces, some preliminary notations and definitions in the introduction, we give some results on those functions in the second paragraph. In the third paragraph, a duality theory in cone-optimization involving multifunctions is developed with the concept of the strong instead of the weak cone-optimality criterium. The results so obtained account for existing ones on univocal vector-function optimization and they hold in spaces of arbitrary dimension.The author is grateful to the refuree's helpful suggestions.     

The conjugate gradient method for computing all the extremal stationary probability vectors of a stochastic matrix

Summary The conjugate gradient method is developed for computing stationary probability vectors of a large sparse stochastic matrixP, which often arises in the analysis of queueing system. When unit vectors are chosen as the initial vectors, the iterative method generates all the extremal probability vectors of the convex set formed by all the stationary probability vectors ofP, which are expressed in terms of the Moore-Penrose inverse of the matrix (P−I). A numerical method is given also for classifying the states of the Markov chain defined byP. One particular advantage of this method is to handle a very large scale problem without resorting to any special form ofP. The Institute of Statistical Mathematics     

一类特殊优化问题的光滑梯度法

对一类在压缩感知、图像处理等相关领域有广泛应用的特殊非光滑优化问题进行了研究,给出了求解此类问题的光滑梯度法及算法的全局收敛性证明,相关的数值实验表明算法的有效性.     

Efficiency for a generalized form of vector optimization problems in complex space

A generalized form of vector optimization problems in complex space is considered, where both the real and the imaginary parts of the objective functions are taken into account. The efficient solutions are defined and characterized in terms of optimal solutions of related appropriate scalar optimization problems. These scalar problems are formulated by means of vectors in the dual of the domination cone. Under analyticity hypotheses about the functions, complex extensions to necessary and sufficient conditions for efficiency of Kuhn–Tucker type are established. Most of the corresponding results of previous studies (in both finite-dimensional complex and real spaces) can be recovered as particular cases.     

Gap functions for a system of generalized vector quasi-equilibrium problems with set-valued mappings

In this paper, some gap functions for three classes of a system of generalized vector quasi-equilibrium problems with set-valued mappings (for short, SGVQEP) are investigated by virtue of the nonlinear scalarization function of Chen, Yang and Yu. Three examples are then provided to demonstrate these gap functions. Also, some gap functions for three classes of generalized finite dimensional vector equilibrium problems (GFVEP) are derived without using the nonlinear scalarization function method. Furthermore, a set-valued function is obtained as a gap function for one of (GFVEP) under certain assumptions.      

An optimization model for the design of a capacitated multi-product reverse logistics network with uncertainty

In this work the design of a reverse distribution network is studied. Most of the proposed models on the subject are case based and, for that reason, they lack generality. In this paper we try to overcome this limitation and a generalized model is proposed. It contemplates the design of a generic reverse logistics network where capacity limits, multi-product management and uncertainty on product demands and returns are considered. A mixed integer formulation is developed which is solved using standard B&B techniques. The model is applied to an illustrative case.     

Convergence acceleration of preconditioned conjugate gradient solver based on error vector sampling for a sequence of linear systems

In this article, we focus on solving a sequence of linear systems that have identical (or similar) coefficient matrices. For this type of problem, we investigate subspace correction (SC) and deflation methods, which use an auxiliary matrix (subspace) to accelerate the convergence of the iterative method. In practical simulations, these acceleration methods typically work well when the range of the auxiliary matrix contains eigenspaces corresponding to small eigenvalues of the coefficient matrix. We develop a new algebraic auxiliary matrix construction method based on error vector sampling in which eigenvectors with small eigenvalues are efficiently identified in the solution process. We use the generated auxiliary matrix for convergence acceleration in the following solution step. Numerical tests confirm that both SC and deflation methods with the auxiliary matrix can accelerate the solution process of the iterative solver. Furthermore, we examine the applicability of our technique to the estimation of the condition number of the coefficient matrix. We also present the algorithm of the preconditioned conjugate gradient method with condition number estimation.     

An improved non-linear method for the computation of a structured low rank approximation of the Sylvester resultant matrix

This paper reports on improvements to recent work on the computation of a structured low rank approximation of the Sylvester resultant matrix S(f,g)$S(f,g)$ of two inexact polynomials f=f(y)$f=f\left(y\right)$ and g=g(y)$g=g\left(y\right)$. Specifically, it has been shown in previous work that these polynomials must be processed before a structured low rank approximation of S(f,g)$S(f,g)$ is computed. The existing algorithm may still, however, yield a structured low rank approximation of S(f,g)$S(f,g)$, but not a structured low rank approximation of S(g,f)$S(g,f)$, which is unsatisfactory. Moreover, a structured low rank approximation of S(f,g)$S(f,g)$ must be equal to, apart from permutations of its columns, a structured low rank approximation of S(g,f)$S(g,f)$, but the existing algorithm does not guarantee the satisfaction of this condition. This paper addresses these issues by modifying the existing algorithm, such that these deficiencies are overcome. Examples that illustrate these improvements are shown.     

A spreadsheet-based optimization model for the integrated problem of producing and distributing a major weekly newsmagazine

In this paper, we address the problem of producing and distributing the Brazilian newsmagazine Época, a major weekly publication with one of the 10 largest circulations in the world. This real-world problem had been puzzling magazine publishers in Brazil and remained unsolved for many years. We propose an innovative mixed-integer-linear programming model to determine the number and location of the industrial facilities that should produce the magazines, what destinations should be assigned to each selected facility; the production sequencing and the modes of transportation (air or truck). Our model aims to minimize the total cost while adhering to production capacity and time constraints. The model was implemented in an electronic spreadsheet environment and yielded a savings of 7.1% of the total costs. Given that despite their huge popularity, little has been written on the issues of implementing full-scale optimization models in spreadsheets; thus we also provide the details of the model’s implementation in Excel.     

Updating of a lumped model for an experimental web tension control system using a multivariable optimization method

The modelling and the control of web handling systems have been studied for a long time; correct modelling is necessary in order to design a better control system or to identify the plant parameters experimentally. On the web dynamics itself, lumped parameters expressions may be used to designate a web section between two adjacent drive rolls, and there is the necessity of incorporating the property of viscoelasticity to the web.     

Three-term conjugate gradient method for the convex optimization problem over the fixed point set of a nonexpansive mapping

Many constrained sets in problems such as signal processing and optimal control can be represented as a fixed point set of a certain nonexpansive mapping, and a number of iterative algorithms have been presented for solving a convex optimization problem over a fixed point set. This paper presents a novel gradient method with a three-term conjugate gradient direction that is used to accelerate conjugate gradient methods for solving unconstrained optimization problems. It is guaranteed that the algorithm strongly converges to the solution to the problem under the standard assumptions. Numerical comparisons with the existing gradient methods demonstrate the effectiveness and fast convergence of this algorithm.