等式约束优化非单调信赖域算法

设计了一个新的求解等式约束优化问题的非单调信赖域算法.该算法不需要罚函数也无需滤子.在每次迭代过程中只需求解满足下降条件的拟法向步及切向步.新算法产生的迭代步比滤子方法更易接受,计算量比单调算法小.在一般条件下,算法具有全局收敛性.     

Local convergence of filter methods for equality constrained non-linear programming

In Gonzaga et al. [A globally convergent filter method for nonlinear programming, SIAM J. Optimiz. 14 (2003), pp. 646–669] we discuss general conditions to ensure global convergence of inexact restoration filter algorithms for non-linear programming. In this article we show how to avoid the Maratos effect by means of a second-order correction. The algorithms are based on feasibility and optimality phases, which can be either independent or not. The optimality phase differs from the original one only when a full Newton step for the tangential minimization of the Lagrangian is efficient but not acceptable by the filter method. In this case a second-order corrector step tries to produce an acceptable point keeping the efficiency of the rejected step. The resulting point is tested by trust region criteria. Under the usual hypotheses, the algorithm inherits the quadratic convergence properties of the feasibility and optimality phases. This article includes a comparison between classical Sequential Quadratic Programming (SQP) and Inexact Restoration (IR) iterations, showing that both methods share the same asymptotic convergence properties.     

一种求解序列二次规划结合信赖域的多维滤子算法

求解非线性规划问题最有效的方法之一为序列二次规划。但是,由于序列二次规划结合信赖域时,会出现可能无解的情况(即不相容性)。而本文针对不相容性提出了一类序列二次规划结合信赖域的多维相容滤子算法。首先,本文根据一般文献中提及的方法对其约束条件引进参数变量,对其目标函数加以惩罚,即实行了可行化处理(也就是无需可行性恢复阶段),从而克服了不相容性。其次,本文提出了多维滤子条件来对迭代步进行选择性的接受,从而避免了传统二维滤子算法的严格条件,使得对迭代步的接受程度大大的放松。最后针对可能出现的maratos效应,我们通过二阶校正策略提出了一种修改后的多维滤子算法。同时,在一定的假设条件下算法具有全局收敛性。     

A secant algorithm with line search filter method for nonlinear optimization

Filter methods were initially designed for nonlinear programming problems by Fletcher and Leyffer. In this paper we propose a secant algorithm with line search filter method for nonlinear equality constrained optimization. The algorithm yields the global convergence under some reasonable conditions. By using the Lagrangian function value in the filter we establish that the proposed algorithm can overcome the Maratos effect without using second order correction step, so that fast local superlinear convergence to second order sufficient local solution is achieved. The primary numerical results are presented to confirm the robustness and efficiency of our approach.     

An ODE-Based Trust Region Filter Algorithm for Unconstrained Optimization

In this article, an ODE-based trust region filter algorithm for unconstrained optimization is proposed. It can be regarded as a combination of trust region and filter techniques with ODE-based methods. Unlike the existing trust-region-filter methods and ODE-based methods, a distinct feature of this method is that at each iteration, a reduced linear system is solved to obtain a trial step, thus avoiding solving a trust region subproblem. Under some standard assumptions, it is proven that the algorithm is globally convergent. Preliminary numerical results show that the new algorithm is efficient for large scale problems.     

Convergence of a Three-Dimensional Dwindling Filter Algorithm Without Feasibility Restoration Phase

In this article, we propose a three-dimensional dwindling filter algorithm for general nonlinear programming. The envelope of the three-dimensional dwindling filter becomes thinner and thinner as the step size approaches zero so that the new filter has more flexibility for the acceptance of the trial step size. Moreover, we show that the feasibility restoration phase, which is always used in traditional filter method, is not needed. The modified limited memory Broyden-Fletcher-Goldfarb-Shanno method is employed in the algorithm, and the update matrices are positive definite when the Lagrangian function is a general convex function. Under mild conditions, the global convergence of the new algorithm is analyzed. The primary numerical experiments are reported to show effectiveness of the proposed algorithm.     

A posteriori parameter choice strategies for some Newton type methods for the regularization of nonlinearill-posed problems

This paper treats a class of Newton type methods for the approximate solution of nonlinear ill-posed operator equations, that use so-called filter functions for regularizing the linearized equation in each Newton step. For noisy data we derive an aposteriori stopping rule that yields convergence of the iterates to asolution, as the noise level goes to zero, under certain smoothness conditions on the nonlinear operator. Appropriate closeness and smoothness assumptions on the starting value and the solution are shown to lead to optimal convergence rates. Moreover we present an application of the Newton type methods under consideration to a parameter identification problem, together with some numerical results. Received November 29, 1996 / Revised version received April 25, 1997     

Application of spectral filtering to discontinuous Galerkin methods on triangulations

We adapt the spectral viscosity (SV) formulation implemented as a modal filter to a discontinuous Galerkin (DG) method solving hyperbolic conservation laws on triangular grids. The connection between SV and spectral filtering, which is undertaken for the first time in the context of DG methods on unstructured grids, allows to specify conditions on the filter strength regarding time step choice and mesh refinement. A crucial advantage of this novel damping strategy is its low computational cost. We furthermore obtain new error bounds for filtered Dubiner expansions of smooth functions. While high order accuracy with respect to the polynomial degree N is proven for the filtering procedure in this case, an adaptive application is proposed to retain the high spatial approximation order. Although spectral filtering stabilizes the scheme, it leaves weaker oscillations. Therefore, as a postprocessing step, we apply the image processing technique of digital total variation (DTV) filtering in the new context of DG solutions and prove conservativity in the limit for this filtering procedure. Numerical experiments for scalar conservation laws confirm the designed order of accuracy of the DG scheme with adaptive modal filtering for polynomial degrees up to 8 and the viability of spectral and DTV filtering in case of shocks. © 2011 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 2011     

Sub-sample swapping for sequential Monte Carlo approximation of high-dimensional densities in the context of complex object tracking

In this paper, we address the problem of complex object tracking using the particle filter framework, which essentially amounts to estimate high-dimensional distributions by a sequential Monte Carlo algorithm. For this purpose, we first exploit Dynamic Bayesian Networks to determine conditionally independent subspaces of the object’s state space, which allows us to independently perform the particle filter’s propagations and corrections over small spaces. Second, we propose a swapping process to transform the weighted particle set provided by the update step of the particle filter into a “new particle set” better focusing on high peaks of the posterior distribution. This new methodology, called Swapping-Based Partitioned Sampling, is proved to be mathematically sound and is successfully tested and validated on synthetic video sequences for single or multiple articulated object tracking.     

双层规划问题的一种模式搜索Filter方法

双层规划在工程设计和经济管理中应用广泛,结合模式搜索方法和Filter方法提出了一种解决双层规划问题的算法—模式搜索Filter方法.算法以Filter法思想构造接受准则,以模式搜索提供迭代方向和步长,能够有效的解决一类双层规划问题.     

High‐order partial differential equation de‐noising method for vibration signal

A novel approach for 1D vibration signal de‐noising filter using partial differential equation (PDE) is presented. In particular, the numerical solution of higher‐order PDE is generated, and we show that it enables the amplitude‐frequency characteristic in filter to be estimated more accurately, which results in better de‐noising performance in comparison with the low‐order PDE. The de‐noising tests on different degree of artificial noise are conducted. Experimental tests have been rigorously compared with different de‐noising methods to verify the efficacy of the proposed high‐order PDE filter method. Copyright © 2014 John Wiley & Sons, Ltd.     

A filter method for nonlinear semidefinite programming with global convergence

In this study, a new filter algorithm is presented for solving the nonlinear semidefinite programming. This algorithm is inspired by the classical sequential quadratic programming method. Unlike the traditional filter methods, the sufficient descent is ensured by changing the step size instead of the trust region radius. Under some suitable conditions, the global convergence is obtained. In the end, some numerical experiments are given to show that the algorithm is effective.     

求解极小极大问题的非单调过滤算法

提出一种改进的求解极小极大问题的信赖域滤子方法,利用SQP子问题来求一个试探步,尾服用滤子来衡量是否接受试探步,避免了罚函数的使用;并且借用已有文献的思想, 使用了Lagrange函数作为效益函数和非单调技术,在适当的条件下,分析了算法的全局和局部收敛性,并进行了数值实验.     

An Affine Scaling Interior Trust-Region Algorithm Combining Backtracking Line Search with Filter Technique for Nonlinear Constrained Optimization

In this article, an affine scaling interior trust-region algorithm which employs backtracking line search with filter technique is presented for solving nonlinear equality constrained programming with nonnegative constraints on variables. At current iteration, the general full affine scaling trust-region subproblem is decomposed into a pair of trust-region subproblems in vertical and horizontal subspaces, respectively. The trial step is given by the solutions of the pair of trust-region subproblems. Then, the step size is decided by backtracking line search together with filter technique. This is different from traditional trust-region methods and has the advantage of decreasing the number of times that a trust-region subproblem must be resolved in order to determine a new iteration point. Meanwhile, using filter technique instead of merit function to determine a new iteration point can avoid the difficult decisions regarding the choice of penalty parameters. Under some reasonable assumptions, the new method possesses the property of global convergence to the first-order critical point. Preliminary numerical results show the effectiveness of the proposed algorithm.     

Iterative Algorithms to Approximate Canonical Gabor Windows: Computational Aspects

In this article we investigate the computational aspects of some recently proposed iterative methods for approximating the canonical tight and canonical dual window of a Gabor frame (g, a, b). The iterations start with the window g while the iteration steps comprise the window g, the k-th iterand γ_k, the frame operators S and S_k corresponding to (g, a, b) and (γ_k, a, b), respectively, and a number of scalars. The structure of the iteration step of the method is determined by the envisaged convergence order m of the method. We consider two strategies for scaling the terms in the iteration step: Norm scaling, where in each step the windows are normalized, and initial scaling where we only scale in the very beginning. Norm scaling leads to fast, but conditionally convergent methods, while initial scaling leads to unconditionally convergent methods, but with possibly suboptimal convergence constants. The iterations, initially formulated for time-continuous Gabor systems, are considered and tested in a discrete setting in which one passes to the appropriately sampled-and-periodized windows and frame operators. Furthermore, they are compared with respect to accuracy and efficiency with other methods to approximate canonical windows associated with Gabor frames.     

Optimized composite finite difference schemes for atmospheric flow modeling

In this paper, we use some finite difference methods in order to solve an atmospheric flow problem described by an advection–diffusion equation. This flow problem was solved by Clancy using forward‐time central space (FTCS) scheme and is challenging to simulate due to large errors in phase and amplitude which are generated especially over long propagation times. Clancy also derived stability limits for FTCS scheme. We use Von Neumann stability analysis and the approach of Hindmarsch et al. which is an improved technique over that of Clancy in order to obtain the region of stability of some methods such as FTCS, Lax–Wendroff (LW), Crank–Nicolson. We also construct a nonstandard finite difference (NSFD) scheme. Properties like stability and consistency are studied. To improve the results due to significant numerical dispersion or numerical dissipation, we derive a new composite scheme consisting of three applications of LW followed by one application of NSFD. The latter acts like a filter to remove the dispersive oscillations from LW. We further improve the composite scheme by computing the optimal temporal step size at a given spatial step size using two techniques namely; by minimizing the square of dispersion error and by minimizing the sum of squares of dispersion and dissipation errors.     

结合有效集和多维滤子技术的拟Newton信赖域算法(英文)

针对界约束优化问题,提出一个修正的多维滤子信赖域算法.将滤子技术引入到拟Newton信赖域方法,在每步迭代,Cauchy点用于预测有效集,此时试探步借助于求解一个较小规模的信赖域子问题获得.在一定条件下,本文所提出的修正算法对于凸约束优化问题全局收敛.数值试验验证了新算法的实际运行结果.     

Sequential penalty quadratic programming filter methods for nonlinear programming

Filter approaches, initially proposed by Fletcher and Leyffer in 2002, are recently attached importance to. If the objective function value or the constraint violation is reduced, this step is accepted by a filter, which is the basic idea of the filter. In this paper, the filter approach is employed in a sequential penalty quadratic programming (SlQP) algorithm which is similar to that of Yuan's. In every trial step, the step length is controlled by a trust region radius. In this work, our purpose is not to reduce the objective function and constraint violation. We reduce the degree of constraint violation and some function, and the function is closely related to the objective function. This algorithm requires neither Lagrangian multipliers nor the strong decrease condition. Meanwhile, in our SlQP filter there is no requirement of large penalty parameter. This method produces K-T points for the original problem.     

A modified SLP algorithm and its global convergence

This paper concerns a filter technique and its application to the trust region method for nonlinear programming (NLP) problems. We used our filter trust region algorithm to solve NLP problems with equality and inequality constraints, instead of solving NLP problems with just inequality constraints, as was introduced by Fletcher et al. [R. Fletcher, S. Leyffer, Ph.L. Toint, On the global converge of an SLP-filter algorithm, Report NA/183, Department of Mathematics, Dundee University, Dundee, Scotland, 1999]. We incorporate this filter technique into the traditional trust region method such that the new algorithm possesses nonmonotonicity. Unlike the tradition trust region method, our algorithm performs a nonmonotone filter technique to find a new iteration point if a trial step is not accepted. Under mild conditions, we prove that the algorithm is globally convergent.     

Sequential quadratic programming with a flexible step acceptance strategy

A new sequential quadratic programming (SQP) method for nonlinear inequality constrained optimization is proposed. The aim of this paper is to promote global convergence for SQP methods using a flexible step acceptance strategy which combines merit functions and filter techniques. Global convergence is proved under some reasonable assumptions and preliminary numerical results are reported.