基于GA-Chebyshev神经网络的分数阶Bagley-Torvik方程数值解法

本文基于现有的切比雪夫神经网络,提出了一种利用遗传算法优化切比雪夫神经网络求解分数阶Bagley-Torvik方程数值解的新方法,结合多点处的泰勒公式原理,给出数值解的一般形式,将原问题转化为求解无约束最小化问题.与现有数值方法的数值结果进行比较表明了本文方法的可行性和有效性,为分数阶微分方程中类似问题的求解提供了新的思路.     

Evaluation of fuzzy regression models by fuzzy neural network

In this paper, a novel hybrid method based on fuzzy neural network for approximate fuzzy coefficients (parameters) of fuzzy linear and nonlinear regression models with fuzzy output and crisp inputs, is presented. Here a neural network is considered as a part of a large field called neural computing or soft computing. Moreover, in order to find the approximate parameters, a simple algorithm from the cost function of the fuzzy neural network is proposed. Finally, we illustrate our approach by some numerical examples.     

Neural network metamodeling for cycle time-throughput profiles in manufacturing

This paper proposed a neural network (NN) metamodeling method to generate the cycle time (CT)–throughput (TH) profiles for single/multi-product manufacturing environments. Such CT–TH profiles illustrate the trade-off relationship between CT and TH, the two critical performance measures, and hence provide a comprehensive performance evaluation of a manufacturing system. The proposed methods distinct from the existing NN metamodeling work in three major aspects: First, instead of treating an NN as a black box, the geometry of NN is examined and utilized; second, a progressive model-fitting strategy is developed to obtain the simplest-structured NN that is adequate to capture the CT–TH relationship; third, an experiment design method, particularly suitable to NN modeling, is developed to sequentially collect simulation data for the efficient estimation of the NN models.     

Globally flexible functional forms: The neural distance function

The output distance function is a key concept in economics. However, its empirical estimation often violates properties dictated by neoclassical production theory. In this paper, we introduce the neural distance function (NDF) which constitutes a global approximation to any arbitrary production technology with multiple outputs given by a neural network (NN) specification. The NDF imposes all theoretical properties such as monotonicity, curvature and homogeneity, for all economically admissible values of outputs and inputs. Fitted to a large data set for all US commercial banks (1989–2000), the NDF explains a very high proportion of the variance of output while keeping the number of parameters to a minimum and satisfying the relevant theoretical properties. All measures such as total factor productivity (TFP) and technical efficiency (TE) are computed routinely. Next, the NDF is compared with the Translog popular specification and is found to provide very satisfactory results as it possesses the properties thought as desirable in neoclassical production theory in a way not matched by its competing specification.     

Ensemble of a subset of <Emphasis Type="Italic">k</Emphasis>NN classifiers

Combining multiple classifiers, known as ensemble methods, can give substantial improvement in prediction performance of learning algorithms especially in the presence of non-informative features in the data sets. We propose an ensemble of subset of kNN classifiers, ESkNN, for classification task in two steps. Firstly, we choose classifiers based upon their individual performance using the out-of-sample accuracy. The selected classifiers are then combined sequentially starting from the best model and assessed for collective performance on a validation data set. We use bench mark data sets with their original and some added non-informative features for the evaluation of our method. The results are compared with usual kNN, bagged kNN, random kNN, multiple feature subset method, random forest and support vector machines. Our experimental comparisons on benchmark classification problems and simulated data sets reveal that the proposed ensemble gives better classification performance than the usual kNN and its ensembles, and performs comparable to random forest and support vector machines.     

Convergence for a family of neural network operators in Orlicz spaces

In this paper, we develop the theory for a family of neural network (NN) operators of the Kantorovich type, in the general setting of Orlicz spaces. In particular, a modular convergence theorem is established. In this way, we study the above family of operators in many instances of useful spaces by a unique general approach. The above NN operators provide a constructive approximation process, in which the coefficients, the weights, and the thresholds of the networks needed in order to approximate a given function f , are known. At the end of the paper, several examples of Orlicz spaces, and of sigmoidal activation functions for which the present theory can be applied, are studied in details.     

On the combination of kernel principal component analysis and neural networks for process indirect control

ABSTRACT

A new adaptive kernel principal component analysis (KPCA) for non-linear discrete system control is proposed. The proposed approach can be treated as a new proposition for data pre-processing techniques. Indeed, the input vector of neural network controller is pre-processed by the KPCA method. Then, the obtained reduced neural network controller is applied in the indirect adaptive control. The influence of the input data pre-processing on the accuracy of neural network controller results is discussed by using numerical examples of the cases of time-varying parameters of single-input single-output non-linear discrete system and multi-input multi-output system. It is concluded that, using the KPCA method, a significant reduction in the control error and the identification error is obtained. The lowest mean squared error and mean absolute error are shown that the KPCA neural network with the sigmoid kernel function is the best.     

Simulation and evaluation of dual fully fuzzy linear systems by fuzzy neural network

In this paper, a novel hybrid method based on fuzzy neural network for approximate solution of fuzzy linear systems of the form Ax = Bx + d, where A and B are two square matrices of fuzzy coefficients, x and d are two fuzzy number vectors, is presented. Here a neural network is considered as a part of a large field called neural computing or soft computing. Moreover, in order to find the approximate solution, a simple and fast algorithm from the cost function of the fuzzy neural network is proposed. Finally, we illustrate our approach by some numerical examples.     

A novel neural network based on NCP function for solving constrained nonconvex optimization problems

This article presents a novel neural network (NN) based on NCP function for solving nonconvex nonlinear optimization (NCNO) problem subject to nonlinear inequality constraints. We first apply the p‐power convexification of the Lagrangian function in the NCNO problem. The proposed NN is a gradient model which is constructed by an NCP function and an unconstrained minimization problem. The main feature of this NN is that its equilibrium point coincides with the optimal solution of the original problem. Under a proper assumption and utilizing a suitable Lyapunov function, it is shown that the proposed NN is Lyapunov stable and convergent to an exact optimal solution of the original problem. Finally, simulation results on two numerical examples and two practical examples are given to show the effectiveness and applicability of the proposed NN. © 2015 Wiley Periodicals, Inc. Complexity 21: 130–141, 2016     

The recovery of even polynomial potentials

We consider the problem of reconstructing an even polynomial potential from one set of spectral data of a Sturm-Liouville problem. We show that we can recover an even polynomial of degree 2m from m+1 given Taylor coefficients of the characteristic function whose zeros are the eigenvalues of one spectrum. The idea here is to represent the solution as a power series and identify the unknown coefficients from the characteristic function. We then compute these coefficients by solving a nonlinear algebraic system, and provide numerical examples at the end. Because of its algebraic nature, the method applies also to non self-adjoint problems.     

Unidirectional synchronization for Hindmarsh–Rose neurons via robust adaptive sliding mode control

This paper presents an adaptive neural network (NN) based sliding mode control for unidirectional synchronization of Hindmarsh–Rose (HR) neurons in a master–slave configuration. We first give the dynamics of single HR neuron which may exhibit spike-burst chaotic behaviors. Then we formulate the problem of unidirectional synchronization control of two HR neurons and propose a NN based sliding mode controller. The controller consists of two simple radial basis function (RBF) NNs which are used to approximate the desired sliding mode controller and the uncertain nonlinear part of the error dynamical system, respectively. The control scheme is robust to the uncertainties such as approximate errors, ionic channel noise and external disturbances. The simulation results demonstrate the validity of the proposed control method.     

A numerical approach for solving initial-boundary value problem describing the process of cooling of a semi-infinite body by radiation

In this article, we have introduced a Taylor collocation method, which is based on collocation method for solving initial-boundary value problem describing the process of cooling of a semi-infinite body by radiation. This method is based on first taking the truncated Taylor expansions of the solution function in the fractional differential equation and then substituting their matrix forms into the equation. Using collocation points, we have the system of nonlinear algebraic equation. Then, we solve the system of nonlinear algebraic equation using Maple 13 and we have the coefficients of Taylor expansion. In addition, numerical results are presented to demonstrate the effectiveness of the proposed method.     

Financial credit-risk evaluation with neural and neurofuzzy systems

Credit-risk evaluation decisions are important for the financial institutions involved due to the high level of risk associated with wrong decisions. The process of making credit-risk evaluation decision is complex and unstructured. Neural networks are known to perform reasonably well compared to alternate methods for this problem. However, a drawback of using neural networks for credit-risk evaluation decision is that once a decision is made, it is extremely difficult to explain the rationale behind that decision. Researchers have developed methods using neural network to extract rules, which are then used to explain the reasoning behind a given neural network output. These rules do not capture the learned knowledge well enough. Neurofuzzy systems have been recently developed utilizing the desirable properties of both fuzzy systems as well as neural networks. These neurofuzzy systems can be used to develop fuzzy rules naturally. In this study, we analyze the beneficial aspects of using both neurofuzzy systems as well as neural networks for credit-risk evaluation decisions.     

基于支持向量机的武器系统参数费用模型

在武器系统分析中,建立武器参数费用模型时,首先要挑选特征参数,这里采用R ough理论中的知识约简方法选择武器的特征参数;利用支持向量机建立了参数费用模型;给出了实例和解决此问题的支持向量机源程序.通过实例与线性回归法和神经网络法的结果进行了比较,结果表明支持向量机比较精确和简单.     

Evaluation of fully fuzzy matrix equations by fuzzy neural network

In this paper, a new hybrid method based on fuzzy neural network for approximate solution of fully fuzzy matrix equations of the form AX=D$\mathit{AX}=D$, where A and D are two fuzzy number matrices and the unknown matrix X is a fuzzy number matrix, is presented. Then, we propose some definitions which are fuzzy zero number, fuzzy one number and fuzzy identity matrix. Based on these definitions, direct computation of fuzzy inverse matrix is done using fuzzy matrix equations and fuzzy neural network. It is noted that the uniqueness of the calculated fuzzy inverse matrix is not guaranteed. Here a neural network is considered as a part of a large field called neural computing or soft computing. Moreover, in order to find the approximate solution of fuzzy matrix equations that supposedly has a unique fuzzy solution, a simple algorithm from the cost function of the fuzzy neural network is proposed. To illustrate the easy application of the proposed method, numerical examples are given and the obtained results are discussed.     

A Taylor matrix method for the solution of a two-dimensional linear hyperbolic equation

A Taylor matrix method is proposed for the numerical solution of the two-space-dimensional linear hyperbolic equation. This method transforms the equation into a matrix equation and the unknown of this equation is a Taylor coefficients matrix. Solutions are easily acquired by using this matrix equation, which corresponds to a system of linear algebraic equations. As a result, the finite Taylor series approach with three variables is obtained. The accuracy of the proposed method is demonstrated with one example.     

可调激活函数递进提升输出维的选参方法

针对一类变参数 Sigmoid可调激活函数构成三层前向神经网络 ,分析其可调激活函数中参数所表示意义 ;给出了递进提升输出向量空间维数的可调变参数激活函数中参数选取的方法 ,解决了隐含神经元采用相同激活函数限制了神经网络逼近能力这一问题 .其目的给人们在采用变参数可调激活函数神经网络解决问题时 ,如何选取激活函数中的参数提供了一种数学依据和方法 .     

Intelligent control of chaos using linear feedback controller and neural network identifier

A method for controlling chaos when the mathematical model of the system is unknown is presented in this paper. The controller is designed by the pole placement algorithm which provides a linear feedback control method. For calculating the feedback gain, a neural network is used for identification of the system from which the Jacobian of the system in its fixed point can be approximated. The weights of the neural network are adjusted online by the gradient descent algorithm in which the difference between the system output and the network output is considered as the error to be decreased. The method is applied on both discrete-time and continuous-time systems. For continuous-time systems, equivalent discrete-time systems are constructed by using the Poincare map concept. Two discrete-time systems and one continuous-time system are tested as examples for simulation and the results show good functionality of the proposed method. It can be concluded that the chaos in systems with unknown dynamics may be eliminated by the presented intelligent control system based on pole placement and neural network.     

Extended and Unscented Kalman filtering based feedforward neural networks for time series prediction

With the ability to deal with high non-linearity, artificial neural networks (ANNs) and support vector machines (SVMs) have been widely studied and successfully applied to time series prediction. However, good fitting results of ANNs and SVMs to nonlinear models do not guarantee an equally good prediction performance. One main reason is that their dynamics and properties are changing with time, and another key problem is the inherent noise of the fitting data. Nonlinear filtering methods have some advantages such as handling additive noises and following the movement of a system when the underlying model is evolving through time. The present paper investigates time series prediction algorithms by using a combination of nonlinear filtering approaches and the feedforward neural network (FNN). The nonlinear filtering model is established by using the FNN’s weights to present state equation and the FNN’s output to present the observation equation, and the input vector to the FNN is composed of the predicted signal with given length, then the extended Kalman filtering (EKF) and Unscented Kalman filtering (UKF) are used to online train the FNN. Time series prediction results are presented by the predicted observation value of nonlinear filtering approaches. To evaluate the proposed methods, the developed techniques are applied to the predictions of one simulated Mackey-Glass chaotic time series and one real monthly mean water levels time series. Generally, the prediction accuracy of the UKF-based FNN is better than the EKF-based FNN when the model is highly nonlinear. However, comparing from prediction accuracy and computational effort based on the prediction model proposed in our study, we draw the conclusion that the EKF-based FNN is superior to the UKF-based FNN for the theoretical Mackey-Glass time series prediction and the real monthly mean water levels time series prediction.     

A new Taylor collocation method for nonlinear Fredholm‐Volterra integro‐differential equations

The aim of this article is to present an efficient numerical procedure for solving nonlinear integro‐differential equations. Our method depends mainly on a Taylor expansion approach. This method transforms the integro‐differential equation and the given conditions into the matrix equation which corresponds to a system of nonlinear algebraic equations with unkown Taylor coefficients. The reliability and efficiency of the proposed scheme are demonstrated by some numerical experiments and performed on the computer program written in Maple10. © 2009 Wiley Periodicals, Inc. Numer Methods Partial Differential Eq 2010