Robust Solution to Fuzzy Identification Problem with Uncertain Data by Regularization

This study considers the robust identification of the parameters describing a Sugeno type fuzzy inference system with uncertain data. The objective is to minimize the worst-case residual error using a numerically efficient algorithm. The Sugeno type fuzzy systems are linear in consequent parameters but nonlinear in antecedent parameters. The robust consequent parameters identification problem can be formulated as second-order cone programming problem. The optimal solution of this second-order cone problem can be interpreted as solution of a Tikhonov regularization problem with a special choice of regularization parameter which is optimal for robustness (Ghaoui and Lebret (1997). SAIM Journal of Matrix Analysis and Applications 18, 1035–1064). The final regularized nonlinear optimization problem allowing simultaneous identification of antecedent and consequent parameters is solved iteratively using a generalized Gauss–Newton like method. To illustrate the approach, several simulation studies on numerical examples including the modelling of a spectral data function (one-dimensional benchmark example) is provided. The proposed robust fuzzy identification scheme has been applied to approximate the physical fitness of patients with a fuzzy expert system. The identified fuzzy expert system is shown to be capable of capturing the decisions (experiences) of a medical expert.     

正则参数求解的微分进化算法

研究了正则化方法中正则参数的求解问题,提出了利用微分进化算法获取正则参数.微分进化算法属于全局最优化算法,具有鲁棒性强、收敛速度快、计算精度高的优点.把正则参数的求解问题转化为非线性优化问题,通过保持在解空间不同区域中各个点的搜索,以最大的概率找到问题的全局最优解,同时还利用数值模拟将此方法与广义交叉原理、L-曲线准则、逆最优准则等进行了对比,数值模拟结果表明该方法具有一定的可行性和有效性.     

A solution method for the inverse scattering problem

We consider a numerical solution method for the inverse problem of quantum scattering theory based on Tikhonov's regularization method and Newton's method for solving a nonlinear operator equation of second kind.Translated from Vychislitel'naya Matematika i Matematicheskoe Obespechenie EVM, pp. 52–55, 1985.     

Optimal control for systems described by hyperbolic equations with strong nonlinearity

An optimization control problem for a hyperbolic equation is considered. The system is nonlinear with respect to the state derivative. The regularization technique for the state equation is applied. The necessary conditions of optimality for the regularized control problem are proved. It uses the extended differentiability of the control-state mapping for the regularized equation. The convergence of the regularization method is proved. Thus the optimal control for the regularized problem with a small enough regularization parameter can be chosen as an approximate solution of the initial optimization problem.     

General system of -maximal relaxed monotone variational inclusion problems based on generalized hybrid algorithms

In this paper, a new system of nonlinear (set-valued) variational inclusions involving (A,η)-maximal relaxed monotone and relative (A,η)-maximal monotone mappings in Hilbert spaces is introduced and its approximation solvability is examined. The notion of (A,η)-maximal relaxed monotonicity generalizes the notion of general η-maximal monotonicity, including (H,η)-maximal monotonicity (also referred to as (H,η)-monotonicity in literature). Using the general (A,η)-resolvent operator method, approximation solvability of this system based on a generalized hybrid iterative algorithm is investigated. Furthermore, for the nonlinear variational inclusion system on hand, corresponding nonlinear Yosida regularization inclusion system and nonlinear Yosida approximations are introduced, and as a result, it turns out that the solution set for the nonlinear variational inclusion system coincides with that of the corresponding Yosida regularization inclusion system. Approximation solvability of the Yosida regularization inclusion system is based on an existence theorem and related Yosida approximations. The obtained results are general in nature.     

Fuzzy control of thyristor-controlled series compensator in power system transients

Power system transient stability is one of the most challenging technical areas in electric power industry. Thyristor-controlled series compensation (TCSC) is expected to improve transient stability and damp power oscillations. TCSC control in power system transients is a nonlinear control problem. This paper presents a T–S-model-based fuzzy control scheme and a systematic design method for the TCSC fuzzy controller. The nonlinear power system containing TCSC is modelled as a fuzzy “blending” of a set of locally linearized models. A linear optimal control is designed for each local linear model. Different control requirements at different stages during power system transients can be considered in deriving the linear control rules. The resulting fuzzy controller is then a fuzzy “blending” of these linear controllers. Quadratic stability of the overall nonlinear controlled system can be checked and ensured using H^∞ control theory. Digital simulation with NETOMAC software has verified that the fuzzy control scheme can improve power system transient stability and damp power swings very quickly.     

TV‐like regularization for backward parabolic problems

This paper investigates an inverse problem for parabolic equations backward in time, which is solved by total‐variation‐like (TV‐like, in abbreviation) regularization method with cost function ∥u_x∥². The existence, uniqueness and stability estimate for the regularization problem are deduced in the linear case. For numerical illustration, the variational adjoint method, which presents a simple method to derive the gradient of the optimization functional, is introduced to reconstruct the unknown initial condition for both linear and nonlinear parabolic equations. The conjugate gradient method is used to iteratively search for the optimal approximation. Numerical results validate the feasibility and effectiveness of the proposed algorithm. Copyright © 2016 John Wiley & Sons, Ltd.     

Regularized collocation method for Fredholm integral equations of the first kind

In this paper we consider a collocation method for solving Fredholm integral equations of the first kind, which is known to be an ill-posed problem. An “unregularized” use of this method can give reliable results in the case when the rate at which smallest singular values of the collocation matrices decrease is known a priori. In this case the number of collocation points plays the role of a regularization parameter. If the a priori information mentioned above is not available, then a combination of collocation with Tikhonov regularization can be the method of choice. We analyze such regularized collocation in a rather general setting, when a solution smoothness is given as a source condition with an operator monotone index function. This setting covers all types of smoothness studied so far in the theory of Tikhonov regularization. One more issue discussed in this paper is an a posteriori choice of the regularization parameter, which allows us to reach an optimal order of accuracy for deterministic noise model without any knowledge of solution smoothness.     

A regularization method for solving the Cauchy problem for the Helmholtz equation

In this paper, we investigate a Cauchy problem associated with Helmholtz-type equation in an infinite “strip”. This problem is well known to be severely ill-posed. The optimal error bound for the problem with only nonhomogeneous Neumann data is deduced, which is independent of the selected regularization methods. A framework of a modified Tikhonov regularization in conjunction with the Morozov’s discrepancy principle is proposed, it may be useful to the other linear ill-posed problems and helpful for the other regularization methods. Some sharp error estimates between the exact solutions and their regularization approximation are given. Numerical tests are also provided to show that the modified Tikhonov method works well.     

Inverse problem of groundwater modeling by iteratively regularized Gauss-Newton method with a nonlinear regularization term

A nonlinear minimization problem ‖F(d)−u‖?min, ‖u−u_δ‖≤δ, is a typical mathematical model of various applied inverse problems. In order to solve this problem numerically in the lack of regularity, we introduce iteratively regularized Gauss-Newton procedure with a nonlinear regularization term (IRGN-NRT). The new algorithm combines two very powerful features: iterative regularization and the most general stabilizing term that can be updated at every step of the iterative process. The convergence analysis is carried out in the presence of noise in the data and in the modified source condition. Numerical simulations for a parameter identification ill-posed problem arising in groundwater modeling demonstrate the efficiency of the proposed method.     

Regularization methods for optimization problems with probabilistic constraints

We analyze nonlinear stochastic optimization problems with probabilistic constraints on nonlinear inequalities with random right hand sides. We develop two numerical methods with regularization for their numerical solution. The methods are based on first order optimality conditions and successive inner approximations of the feasible set by progressive generation of p-efficient points. The algorithms yield an optimal solution for problems involving α-concave probability distributions. For arbitrary distributions, the algorithms solve the convex hull problem and provide upper and lower bounds for the optimal value and nearly optimal solutions. The methods are compared numerically to two cutting plane methods.     

Newton-Kantorovich Iterative Regularization for Nonlinear Ill-Posed Equations Involving Accretive Operators

The Newton-Kantorovich iterative regularization for nonlinear ill-posed equations involving monotone operators in Hilbert spaces is developed for the case of accretive operators in Banach spaces. An estimate for the convergence rates of the method is established.__________Published in Ukrains’kyi Matematychnyi Zhurnal, Vol. 57, No. 2, pp. 271–276, February, 2005.     

Multiparameter regularization for Volterra kernel identification via multiscale collocation methods

Identification of the Volterra system is an ill-posed problem. We propose a regularization method for solving this ill-posed problem via a multiscale collocation method with multiple regularization parameters corresponding to the multiple scales. Many highly nonlinear problems such as flight data analysis demand identifying the system of a high order. This task requires huge computational costs due to processing a dense matrix of a large order. To overcome this difficulty a compression strategy is introduced to approximate the full matrix resulted in collocation of the Volterra kernel by an appropriate sparse matrix. A numerical quadrature strategy is designed to efficiently compute the entries of the compressed matrix. Finally, numerical results of three simulation experiments are presented to demonstrate the accuracy and efficiency of the proposed method.     

A discrepancy principle for equations with monotone continuous operators

A discrepancy principle for solving nonlinear equations with monotone operators given noisy data is formulated. The existence and uniqueness of the corresponding regularization parameter a(δ) are proved. Convergence of the solution obtained by the discrepancy principle is justified. The results are obtained under natural assumptions on the nonlinear operator.     

A globally convergent semi-smooth Newton method for control-state constrained DAE optimal control problems

We investigate a semi-smooth Newton method for the numerical solution of optimal control problems subject to differential-algebraic equations (DAEs) and mixed control-state constraints. The necessary conditions are stated in terms of a local minimum principle. By use of the Fischer-Burmeister function the local minimum principle is transformed into an equivalent nonlinear and semi-smooth equation in appropriate Banach spaces. This nonlinear and semi-smooth equation is solved by a semi-smooth Newton method. We extend known local and global convergence results for ODE optimal control problems to the DAE optimal control problems under consideration. Special emphasis is laid on the calculation of Newton steps which are given by a linear DAE boundary value problem. Regularity conditions which ensure the existence of solutions are provided. A regularization strategy for inconsistent boundary value problems is suggested. Numerical illustrations for the optimal control of a pendulum and for the optimal control of discretized Navier-Stokes equations conclude the article.     

Adaptive Choice of the Regularization Parameter in Numerical Differentiation

We investigate a novel adaptive choice rule of the Tikhonov regularization parameter in numerical differentiation which is a classic ill-posed problem. By assuming a general unknown Hölder type error estimate derived for numerical differentiation, we choose a regularization parameter in a geometric set providing a nearly optimal convergence rate with very limited a-priori information. Numerical simulation in image edge detection verifies reliability and efficiency of the new adaptive approach.     

Strong-Weak Nonlinear Bilevel Problems: Existence of Solutions in a Sequential Setting

The paper deals with a strong-weak nonlinear bilevel problem which generalizes the well-known weak and strong ones. In general, the study of the existence of solutions to such a problem is a difficult task. So that, for a strong-weak nonlinear bilevel problem, we first give a regularization based on the use of strict ??-solutions of the lower level problem. Then, via this regularization and under sufficient conditions, we show that the problem admits at least one solution. The obtained result is an extension and an improvement of some recent results appeared recently in the literature for both weak nonlinear bilevel programming problems and linear finite dimensional case.     

On an a posteriori parameter choice strategy for Tikhonov regularization of nonlinear ill-posed problems

Summary. In the study of the choice of the regularization parameter for Tikhonov regularization of nonlinear ill-posed problems, Scherzer, Engl and Kunisch proposed an a posteriori strategy in 1993. To prove the optimality of the strategy, they imposed many very restrictive conditions on the problem under consideration. Their results are difficult to apply to concrete problems since one can not make sure whether their assumptions are valid. In this paper we give a further study on this strategy, and show that Tikhonov regularization is order optimal for each with the regularization parameter chosen according to this strategy under some simple and easy-checking assumptions. This paper weakens the conditions needed in the existing results, and provides a theoretical guidance to numerical experiments. Received August 8, 1997 / Revised version received January 26, 1998     

An optimal stopping problem for a geometric Brownian motion with poissonian jumps

This paper examines an optimal stopping problem for a geometric Brownian motion with random jumps. It is assumed that jumps occur according to a time-homogeneous Poisson process and the proportions of these sizes are independent and identically distributed nonpositive random variables. The objective is to find an optimal stopping time of maximizing the expected discounted terminal reward which is defined as a nondecreasing power function of the stopped state. By applying the “smooth pasting technique” [1,2], we derive almost explicitly an optimal stopping rule of a threshold type and the optimal value function of the initial state. That is, we express the critical state of the optimal stopping region and the optimal value function by formulae which include only given problem parameters except an unknown to be uniquely determined by a nonlinear equation.     

Existence and some properties of weak solutions for a singular nonlinear parabolic equation

This paper deals with the initial and boundary value problem for a singular nonlinear parabolic equation. The existence of solutions is established by parabolic regularization. Some properties of solutions, for instance localization and large time behaviour are also discussed. Copyright © 2007 John Wiley & Sons, Ltd.