Iterative identification algorithm for Wiener nonlinear systems using the Newton method

The Wiener system is an important class of output nonlinear systems. This paper presents a Newton iterative parameter estimation algorithm for Wiener nonlinear systems. The simulation results show that the proposed algorithm is effective. The proposed algorithm can be combined with other iterative methods to identify other linear or nonlinear systems with colored noises.     

Iterative methods of order four and five for systems of nonlinear equations

The Adomian decomposition is used in order to obtain a family of methods to solve systems of nonlinear equations. The order of convergence of these methods is proved to be p≥2, under the same conditions as the classical Newton method. Also, numerical examples will confirm the theoretical results.     

Guaranteed nonlinear parameter estimation in knowledge-based models

Knowledge-based models are ubiquitous in pure and applied sciences. They often involve unknown parameters to be estimated from experimental data. This is usually much more difficult than for black-box models, only intended to mimic a given input–output behavior. The output of knowledge-based models is almost always nonlinear in their parameters, so that linear least squares cannot be used, and analytical solutions for the model equations are seldom available. Moreover, since the parameters have some physical meaning, it is not enough to find some numerical values of these quantities that are such that the model fits the data reasonably well. One would like, for instance, to make sure that the parameters to be estimated are identifiable. If this is not the case, all equivalent solutions should be provided. The uncertainty in the parameters resulting from the measurement noise and approximate nature of the model should also be characterized. This paper describes how guaranteed methods based on interval analysis may contribute to these tasks. Examples in linear and nonlinear compartmental modeling, widely used in biology, are provided.     

Gradient-based iterative identification for MISO Wiener nonlinear systems: Application to a glutamate fermentation process

This paper deals with modeling and parameter identification of multiple-input single-output Wiener nonlinear systems. The basic idea is to construct a multiple-input single-output Wiener nonlinear model and to derive the gradient-based iterative algorithm for the proposed model. The proposed method has been applied to identify the parameters of a glutamate fermentation process. The results of real data simulation show that this method is effective.     

Gradient based iterative parameter identification for Wiener nonlinear systems

This paper focuses on the identification problem of Wiener nonlinear output error systems. The application of the key-term decomposition technique provides a special form of the Wiener model with polynomials, where all the model parameters to be estimated are separated. To solve the identification problem of Wiener nonlinear output error systems with the unmeasurable variables in the information vector, an auxiliary model-based gradient iterative algorithm is presented by replacing the unmeasurable variables with their corresponding iterative estimates. The performances of the proposed algorithm are analyzed and compared by using numerical examples.     

On HSS-based iteration methods for weakly nonlinear systems

Based on separable property of the linear and the nonlinear terms and on the Hermitian and skew-Hermitian splitting of the coefficient matrix, we present the Picard-HSS and the nonlinear HSS-like iteration methods for solving a class of large scale systems of weakly nonlinear equations. The advantage of these methods over the Newton and the Newton-HSS iteration methods is that they do not require explicit construction and accurate computation of the Jacobian matrix, and only need to solve linear sub-systems of constant coefficient matrices. Hence, computational workloads and computer memory may be saved in actual implementations. Under suitable conditions, we establish local convergence theorems for both Picard-HSS and nonlinear HSS-like iteration methods. Numerical implementations show that both Picard-HSS and nonlinear HSS-like iteration methods are feasible, effective, and robust nonlinear solvers for this class of large scale systems of weakly nonlinear equations.     

Stochastic gradient with changing forgetting factor-based parameter identification for Wiener systems

The parameter estimation problem is considered for a class Wiener systems. First, the effect of the forgetting factor on the stochastic gradient algorithm is analyzed. Then, a Wiener system stochastic gradient with a changing forgetting factor algorithm is presented which makes full use of the forgetting factor. Finally, an example is provided to test and verify the effectiveness of the proposed algorithms.     

Nonlinear system identification employing automatic differentiation

An optimization based state and parameter estimation method is presented where the required Jacobian matrix of the cost function is computed via automatic differentiation. Automatic differentiation evaluates the programming code of the cost function and provides exact values of the derivatives. In contrast to numerical differentiation it is not suffering from approximation errors and compared to symbolic differentiation it is more convenient to use, because no closed analytic expressions are required. Furthermore, we demonstrate how to generalize the parameter estimation scheme to delay differential equations, where estimating the delay time requires attention.     

On the convergence of parallel chaotic nonlinear multisplitting Newton-type methods

A class of parallel chaotic nonlinear multisplitting Newton-type methods for solving the nonlinear system of equations F(x) = 0(F : D Rⁿ → Rⁿ) is established and its local convergence theory is presented.     

Procedure for asymptotic state and parameter estimation of nonlinear distributed parameter bioreactors

Due to measurement problem in biological variables, such as the biomass concentration and its specific growth rate, the on-line measurement of these variables is not ensured and this presents a great difficulty, especially when we consider the control problem. This paper presents and analyses an approach for estimating these biological variables through an example of a nonlinear distributed parameter bioreactor. An orthogonal collocation method is applied in the distributed system to obtain a system of ordinary differential equations. A simulation study shows the feasibility and the robustness of the estimator used for this nonlinear process.     

A parameter estimation scheme for a class of sequential hybrid systems

It may happen that the equations governing the response of dynamical systems have some parameters whose values may not be known a priori and have to be obtained using parameter estimation schemes. In this article, we present a parameter estimation scheme for a class of sequential hybrid systems. By hybrid systems, we refer to those systems whose response is described by different governing equations corresponding to various regimes/modes of operation along with some criteria to switch between the same. In a sequential hybrid system, the different modes are arranged in a specific sequence and the system can switch from a given mode to either the previous mode or the following mode in this sequence. Here, we consider those systems whose governing equations consist of ordinary differential equations and algebraic equations. The conditions for switching between the various modes (referred to as transition conditions) are in the form of linear inequalities involving the system output. We shall first consider the case where the transition conditions are known completely. We present a parameter update scheme along with sufficient conditions that will guarantee bounded parameter estimation errors. Then, we shall consider the case where the transition conditions are not known in the sense that some parameters in these conditions are not known. We present a parameter estimation scheme for this case. We illustrate the performance of the parameter estimation scheme in both cases with some examples.     

Sensitivity analysis and parameter identification for a nonlinear time-delay system in microbial fed-batch process

Developing suitable dynamic models of bioprocess is a difficult issue in bioscience. In this paper, considering the microbial metabolism mechanism, i.e., the production of new biomass is delayed by the amount of time it takes to metabolize the nutrients, in glycerol bioconversion to 1,3-propanediol, we propose a nonlinear time-delay system to formulate the fed-batch fermentation process. Some important properties are also discussed. Then, in view of the effect of time-delay and the high number of kinetic parameters in the system, the parametric sensitivity analysis is used to determine the key parameters. Finally, a parameter identification model is presented and a global optimization method is developed to seek the optimal key parameters. Numerical results show that the nonlinear time-delay system can describe the fed-batch fermentation process reasonably.     

Consistent parameter estimation for partially observed diffusions with small noise

In this paper we provide a consistency result for the MLE for partially observed diffusion processes with small noise intensities. We prove that if the underlying deterministic system enjoys an identifiability property, then any MLE is close to the true parameter if the noise intensities are small enough. The proof uses large deviations limits obtained by PDE vanishing viscosity methods. A deterministic method of parameter estimation is formulated. We also specialize our results to a binary detection problem, and compare deterministic and stochastic notions of identifiability.This research was supported: by Systems Research Center, University of Maryland through NSF Grant CDR-85-00108 and AFOSR-URI Grant 87-0073; by Lefschetz Center for Dynamical Systems, Division of Applied Mathematics, Brown University, under ARO/MIT Grant DAAL-03-86-K-0171; by INRIA Sophia Antipolis, under ERO/INRIA Grant DAJA45-90-C-0008, and by the CNRS-GRAutomatique.     

Recursive parameter identification for fermentation processes with the multiple model technique

This paper considers parameter identification problems for a fermentation process. Since the fermentation process is nonlinear, it is difficult to use a single-model for describing such a process and thus we use the multiple model technique to study the identification methods. The basic idea is to establish the model of the fermentation process at each operation point by means of the least squares principle, to obtain multiple models with different points, and then use the weighting functions or interpolation methods to compute the total model or the global model. Finally, a numerical example is provided to test the effectiveness of the proposed algorithm.     

Efficient high-order methods based on golden ratio for nonlinear systems

We derive new iterative methods with order of convergence four or higher, for solving nonlinear systems, by composing iteratively golden ratio methods with a modified Newton’s method. We use different efficiency indices in order to compare the new methods with other ones and present several numerical tests which confirm the theoretical results.     

A parameter uniform difference scheme for parabolic partial differential equation with a retarded argument

The paper deals with the analysis of a non-stationary parabolic partial differential equation with a time delay. The highest order derivative term is affected by the small parameter. This is precisely the case when the magnitude of the convective term becomes much larger compare to that of diffusion term. The solution of problem exhibits steep gradients in the narrow intervals of space and short interval of times. In these cases a dissipative loss turned out to be more complex. Even for the one spatial dimension and one temporal variable, not all difference scheme can capture these steep variation. Although the analysis is restricted to the model in one space dimension, the technique and comparison principles developed should prove useful in assessing the merits of numerical solution of other nonlinear model equations too.     

Parallel Newton methods for the nonlinear complementarity problem

In this paper, we discuss how the basic Newton method for solving the nonlinear complementarity problem can be implemented in a parallel computation environment. We propose some synchronized and asynchronous Newton methods and establish their convergence.This work was based on research supported by the National Science Foundation under grant ECS-8407240 and by a University Research and Development grant from Cray Research Inc. The research was initiated when the authors were with the University of Texas at Dallas.     

A new fault isolation and identification method for nonlinear dynamic systems: Application to a fermentation process

In this paper, a new method of fault isolation and identification based on parameter intervals for nonlinear dynamic systems is proposed. The practical domain of the value of each system parameter is divided into a certain number of intervals. After verifying all the intervals whether or not one of them contains the faulty parameter value of the system, the faulty parameter value is found, the fault is therefore isolated. The method provides the estimation of the faulty parameter value and its bounds when the fault is isolated. It fits many kinds of nonlinear dynamic systems with ideal isolation and identification speed. The performances of the proposed method are illustrated by the simulation results of a fermentation process.     

Recursive computational formulas of the least squares criterion functions for scalar system identification

The paper discusses recursive computation problems of the criterion functions of several least squares type parameter estimation methods for linear regression models, including the well-known recursive least squares (RLS) algorithm, the weighted RLS algorithm, the forgetting factor RLS algorithm and the finite-data-window RLS algorithm without or with a forgetting factor. The recursive computation formulas of the criterion functions are derived by using the recursive parameter estimation equations. The proposed recursive computation formulas can be extended to the estimation algorithms of the pseudo-linear regression models for equation error systems and output error systems. Finally, the simulation example is provided.     

An observer for a class of disturbance driven nonlinear systems

An observer design for a class of nonlinear systems driven by disturbances or uncertainties is presented. The design is based on a high gain strategy, and the gain of the proposed observer is explicitly given.