Regularized numerical integration of multibody dynamics with the generalized method

This paper discusses the consistent regularization property of the generalized α method when applied as an integrator to an initial value high index and singular differential-algebraic equation model of a multibody system. The regularization comes from within the discretization itself and the discretization remains consistent over the range of values the regularization parameter may take. The regularization involves increase of the smallest singular values of the ill-conditioned Jacobian of the discretization and is different from Baumgarte and similar techniques which tend to be inconsistent for poor choice of regularization parameter. This regularization also helps where pre-conditioning the Jacobian by scaling is of limited effect, for example, when the scleronomic constraints contain multiple closed loops or singular configuration or when high index path constraints are present. The feed-forward control in Kane’s equation models is additionally considered in the numerical examples to illustrate the effect of regularization. The discretization presented in this work is adopted to the first order DAE system (unlike the original method which is intended for second order systems) for its A-stability and same order of accuracy for positions and velocities.     

Identification of a time-dependent source term for a time fractional diffusion problem

In this paper, we study an inverse problem of identifying a time-dependent term of an unknown source for a time fractional diffusion equation using nonlocal measurement data. Firstly, we establish the conditional stability for this inverse problem. Then two regularization methods are proposed to for reconstructing the time-dependent source term from noisy measurements. The first method is an integral equation method which formulates the inverse source problem into an integral equation of the second kind; and a prior convergence rate of regularized solutions is derived with a suitable choice strategy of regularization parameters. The second method is a standard Tikhonov regularization method and formulates the inverse source problem as a minimizing problem of the Tikhonov functional. Based on the superposition principle and the technique of finite-element interpolation, a numerical scheme is proposed to implement the second regularization method. One- and two-dimensional examples are carried out to verify efficiency and stability of the second regularization method.     

A method of holomorphic generalization of singularly perturbed problems

We consider a method of holomorphic regularization for a strongly nonlinear singularly perturbed equations of the second order.     

Regularization for semilinear elliptic optimal control problems with pointwise state and control constraints

In this paper a class of semilinear elliptic optimal control problem with pointwise state and control constraints is studied. We show that sufficient second order optimality conditions for regularized problems with small regularization parameter can be obtained from a second order sufficient condition assumed for the unregularized problem. Moreover, error estimates with respect to the regularization parameter are derived.     

A new method for numerical differentiation based on direct and inverse problems of partial differential equations

In this paper, we mainly study a numerical differentiation problem which aims to approximate the second order derivative of a single variable function from its noise data. By transforming the problem into a combination of direct and inverse problems of partial differential equations (heat conduction equations), a new method that we call the PDEs-based numerical differentiation method is proposed. By means of the finite element method and the Tikhonov regularization, implementations of the proposed PDEs-based method are presented with a posterior strategy for choosing regularization parameters. Numerical results show that the PDEs-based numerical differentiation method is highly feasible and stable with respect to data noise.     

Browder-Tikhonov regularization for a class of evolution second order hemivariational inequalities

In this paper, we consider a class of evolution second order hemivariational inequalities with non-coercive operators which are assumed to be known approximately. Using the so-called Browder-Tikhonov regularization method, we prove that the regularized evolution hemivariational inequality problem is solvable. We construct a sequence based on the solvability of the regularized evolution hemivariational inequality problem and show that every weak cluster of this sequence is a solution for the evolution second order hemivariational inequality.     

An inverse problem for space‐fractional backward diffusion problem

In this paper, an inverse problem for space‐fractional backward diffusion equation, which is highly ill‐posed, is considered. This problem is obtained from the classical diffusion equation by replacing the second‐order space derivative with a Riesz–Feller derivative of order α ∈ (0,2]. We show that such a problem is severely ill‐posed, and further present a simplified Tikhonov regularization method to deal with this problem. Convergence estimate is presented under a priori choice of regularization parameter. Numerical experiments are given to illustrate the accuracy and efficiency of the proposed method. Copyright © 2013 John Wiley & Sons, Ltd.     

第一类算子方程的一种新的迭代正则化方法

提出了一种新的解第一类算子方程的迭代正则化方法,与通常的迭代正则化方法相比,提高了j次迭代正则解的渐近阶估计.同时,给出了后验正则化参数的选择.     

Nonlinear regression modeling and detecting change points via the relevance vector machine

We consider the problem of constructing nonlinear regression models in the case that the structure of data has discontinuities at some unknown points. We propose two-stage procedure in which the change points are detected by relevance vector machine at the first stage, and the smooth curve are effectively estimated along with the technique of regularization method at the second. In order to select tuning parameters in the regularization method, we derive a model selection and evaluation criterion from information-theoretic viewpoints. Simulation results and real data analyses demonstrate that our methodology performs well in various situations.     

THE KACANOV METHOD FOR A NONLINEAR VARIATIONAL INEQUALITY OF THE SECOND KIND ARISING IN ELASTOPLASTICITY

The authors first prove a convergence result on the Ka(?)anov method for solving generalnonlinear variational inequalities of the second kind and then apply the Kacanov method tosolve a nonlinear variational inequality of the second kind arising in elastoplasticity. In additionto the convergence result, an a posteriori error estimate is shown for the Kacanov iterates. Ineach step of the Ka(?)anov iteration, one has a (linear) variational inequality of the secondkind, which can be solved by using a regularization technique. The Ka(?)anov iteration andthe regularization technique together provide approximations which can be readily computednumerically. An a posteriori error estimate is derived for the combined effect of the Ka(?)anoviteration and the regularization.     

Distributed learning with multi-penalty regularization

In this paper, we study distributed learning with multi-penalty regularization based on a divide-and-conquer approach. Using Neumann expansion and a second order decomposition on difference of operator inverses approach, we derive optimal learning rates for distributed multi-penalty regularization in expectation. As a byproduct, we also deduce optimal learning rates for multi-penalty regularization, which was not given in the literature. These results are applied to the distributed manifold regularization and optimal learning rates are given.     

Strong convergence of new iterative projection methods with regularization for solving monotone variational inequalities in Hilbert spaces

In this paper, we introduce two new numerical methods for solving a variational inequality problem involving a monotone and Lipschitz continuous operator in a Hilbert space. We describe how to incorporate a regularization term depending on a parameter in the projection method and then establish the strong convergence of the resulting iterative regularization projection methods. Unlike known hybrid methods, the strong convergence of the new methods comes from the regularization technique. The first method is designed to work in the case where the Lipschitz constant of cost operator is known, whereas the second one is more easily implemented without this requirement. The reason is because the second method has used a simple computable stepsize rule. The variable stepsizes are generated by the second method at each iteration and based on the previous iterates. These stepsizes are found with only one cheap computation without line-search procedure. Several numerical experiments are implemented to show the computational effectiveness of the new methods over existing methods.     

An algorithm based on the regularization and integral mean value methods for the Fredholm integral equations of the first kind

In this paper, an algorithm based on the regularization and integral mean value methods, to handle the ill-posed multi-dimensional Fredholm equations, is introduced. The application of this algorithm is based on the transforming the first kind equation to a second kind equation by the regularization method. Then, by converting the first kind to a second kind, the integral mean value method is employed to handle the resulting Fredholm integral equations of the second kind. The efficiency of the approach will be shown by applying the procedure on some examples.     

Lagrange multipliers, (exact) regularization and error bounds for monotone variational inequalities

We examine two central regularization strategies for monotone variational inequalities, the first a direct regularization of the operative monotone mapping, and the second via regularization of the associated dual gap function. A key link in the relationship between the solution sets to these various regularized problems is the idea of exact regularization, which, in turn, is fundamentally associated with the existence of Lagrange multipliers for the regularized variational inequality. A regularization is said to be exact if a solution to the regularized problem is a solution to the unregularized problem for all parameters beyond a certain value. The Lagrange multipliers corresponding to a particular regularization of a variational inequality, on the other hand, are defined via the dual gap function. Our analysis suggests various conceptual, iteratively regularized numerical schemes, for which we provide error bounds, and hence stopping criteria, under the additional assumption that the solution set to the unregularized problem is what we call weakly sharp of order greater than one.     

Regularization Using QR Factorization and the Estimation of the Optimal Parameter

In this paper we propose a direct regularization method using QR factorization for solving linear discrete ill-posed problems. The decomposition of the coefficient matrix requires less computational cost than the singular value decomposition which is usually used for Tikhonov regularization. This method requires a parameter which is similar to the regularization parameter of Tikhonov's method. In order to estimate the optimal parameter, we apply three well-known parameter choice methods for Tikhonov regularization.This revised version was published online in October 2005 with corrections to the Cover Date.     

基于几何非协调分解的Lagrange乘子区域分解方法

本文考虑将Lagrange乘子区域分解方法应用于几何非协调分解的情况来求解二阶椭圆问题.由于采用几何非协调区域分解,每个局部乘子空间关联到多个界面,我们按照一定的规则选取合适的乘子面来定义乘子空间.利用局部正则化技巧,可以消去内部变量,得到关于Lagrange乘子的界面方程.采用一种经济的预条件迭代方法求解界面方程,且相关的预条件子是可扩展的.     

基于奇异值分解建立的一种新的正则化方法

根据紧算子的奇异系统理论，引入一种正则化滤子函数，从而建立一种新的正则化方法来求解右端近似给定的第一类算子方程，并给出了正则解的误差分析。通过正则参数的先验选取，证明了正则解的误差具有渐进最优阶。      

Second-order orthant-based methods with enriched Hessian information for sparse $$\ell _1$$-optimization

We present a second order algorithm, based on orthantwise directions, for solving optimization problems involving the sparsity enhancing \(\ell _1\)-norm. The main idea of our method consists in modifying the descent orthantwise directions by using second order information both of the regular term and (in weak sense) of the \(\ell _1\)-norm. The weak second order information behind the \(\ell _1\)-term is incorporated via a partial Huber regularization. One of the main features of our algorithm consists in a faster identification of the active set. We also prove that a reduced version of our method is equivalent to a semismooth Newton algorithm applied to the optimality condition, under a specific choice of the algorithm parameters. We present several computational experiments to show the efficiency of our approach compared to other state-of-the-art algorithms.     

Regularization parameter selection and an efficient algorithm for total variation-regularized positron emission tomography

In positron emission tomography, image data corresponds to measurements of emitted photons from a radioactive tracer in the subject. Such count data is typically modeled using a Poisson random variable, leading to the use of the negative-log Poisson likelihood fit-to-data function. Regularization is needed, however, in order to guarantee reconstructions with minimal artifacts. Given that tracer densities are primarily smoothly varying, but also contain sharp jumps (or edges), total variation regularization is a natural choice. However, the resulting computational problem is quite challenging. In this paper, we present an efficient computational method for this problem. Convergence of the method has been shown for quadratic regularization functions and here convergence is shown for total variation regularization. We also present three regularization parameter choice methods for use on total variation-regularized negative-log Poisson likelihood problems. We test the computational and regularization parameter selection methods on two synthetic data sets.