基于模糊Adaboost算法的支持向量回归机

针对单一支持向量回归机预测精度不十分良好的问题,结合Adaboost算法以及引入隶属函数,提出了一个基于模糊Aaboost算法的支持向量回归机模型。将该模型应用于金融时间序列预测问题的实验表明,预测精度有一定的提高,从而说明了该模型的有效性和可行性。     

线性支持向量顺序回归机的原始问题的解集分析

本文主要对线性支持向量顺序回归机进行理论研究.对其相应原始问题解的存在性唯一性问题进行细致的分析,指明其解集的确切结构,并给出由对偶问题的解求出原始问题的解集的具体步骤.从而为建立理论上完备的线性支持向量顺序回归机提供了依据.     

Application of machine learning techniques for supply chain demand forecasting

Full collaboration in supply chains is an ideal that the participant firms should try to achieve. However, a number of factors hamper real progress in this direction. Therefore, there is a need for forecasting demand by the participants in the absence of full information about other participants’ demand. In this paper we investigate the applicability of advanced machine learning techniques, including neural networks, recurrent neural networks, and support vector machines, to forecasting distorted demand at the end of a supply chain (bullwhip effect). We compare these methods with other, more traditional ones, including naïve forecasting, trend, moving average, and linear regression. We use two data sets for our experiments: one obtained from the simulated supply chain, and another one from actual Canadian Foundries orders. Our findings suggest that while recurrent neural networks and support vector machines show the best performance, their forecasting accuracy was not statistically significantly better than that of the regression model.     

Support vector machines regression with unbounded sampling

Uniform boundedness of output variables is a standard assumption in most theoretical analysis of regression algorithms. This standard assumption has recently been weaken to a moment hypothesis in least square regression (LSR) setting. Although there has been a large literature on error analysis for LSR under the moment hypothesis, very little is known about the statistical properties of support vector machines regression with unbounded sampling. In this paper, we fill the gap in the literature. Without any restriction on the boundedness of the output sampling, we establish an ad hoc convergence analysis for support vector machines regression under very mild conditions.     

Parallel decomposition methods for linearly constrained problems subject to simple bound with application to the SVMs training

We consider the convex quadratic linearly constrained problem with bounded variables and with huge and dense Hessian matrix that arises in many applications such as the training problem of bias support vector machines. We propose a decomposition algorithmic scheme suitable to parallel implementations and we prove global convergence under suitable conditions. Focusing on support vector machines training, we outline how these assumptions can be satisfied in practice and we suggest various specific implementations. Extensions of the theoretical results to general linearly constrained problem are provided. We included numerical results on support vector machines with the aim of showing the viability and the effectiveness of the proposed scheme.     

天然气消费量的偏最小二乘支持向量机预测

结合偏最小二乘法和支持向量机的优缺点,提出基于偏最小二乘支持向量机的天然气消费量预测模型。首先,利用偏最小二乘法确定影响天然气消费量的新综合变量,建立以新综合变量为输入,天然气消费量为输出的支持向量机模型,对天然气消费量进行了预测;然后,与多元回归、偏最小二乘回归、普通支持向量机做误差检验比较,验证该方法的可行性与正确性。结果表明,此天然气消费量预测模型具有较高的精确度和应用价值。     

基于支持向量机的混沌时间序列模型在房产价格指数预测中的应用

针对房产价格指数的预测问题,建立了混沌时间序列的支持向量机的非线性预测模型.首先运用Cao氏法进行相空间重构,并利用改进型小数据量法计算最大的Lyapunov指数,分析上海房产价格指数时间序列的混沌特性.然后以最小嵌入维数作为支持向量机的输入节点,建立房地价格指数的预测模型.实例表明,该方法能较好地处理复杂的房地产数据,具有较高的泛化能力和很好的预测精度.     

Fixed-size Least Squares Support Vector Machines: A Large Scale Application in Electrical Load Forecasting

Based on the Nyström approximation and the primal-dual formulation of the least squares support vector machines, it becomes possible to apply a nonlinear model to a large scale regression problem. This is done by using a sparse approximation of the nonlinear mapping induced by the kernel matrix, with an active selection of support vectors based on quadratic Renyi entropy criteria. The methodology is applied to the case of load forecasting as an example of a real-life large scale problem in industry. The forecasting performance, over ten different load series, shows satisfactory results when the sparse representation is built with less than 3% of the available sample.     

基于灰色关联分析的支持向量机的铁路货运量预测研究

采用基于灰色关联分析的支持向量机对铁路货运量进行预测.首先利用灰色关联分析法对影响铁路货运量的因素进行分析处理,然后利用基于高斯核函数的支持向量回归机建立了铁路货运量预测模型.通过分析预测结果可以发现,经过灰色关联分析后的支持向量机模型对复杂的铁路货运量数据有较好地处理能力,且预测相对误差较小.特别地,由于支持向量机的适应性,该模型具有较高的泛化能力,对影响因素较为复杂,样本数量小的预测问题可以提供一定参考.     

Two smooth support vector machines for $$\varepsilon $$-insensitive regression

In this paper, we propose two new smooth support vector machines for \(\varepsilon \)-insensitive regression. According to these two smooth support vector machines, we construct two systems of smooth equations based on two novel families of smoothing functions, from which we seek the solution to \(\varepsilon \)-support vector regression (\(\varepsilon \)-SVR). More specifically, using the proposed smoothing functions, we employ the smoothing Newton method to solve the systems of smooth equations. The algorithm is shown to be globally and quadratically convergent without any additional conditions. Numerical comparisons among different values of parameter are also reported.     

基于支持向量回归机的黄金价格短期预测

针对黄金价格时间序列的特点,首先结合马尔可夫决策思想对数据集进行相空间重构处理,然后利用支持向量机技术建立黄金价格走势的短期预测模型,最后对上海黄金交易所AU9999的预测结果表明所建模型可以有效地进行黄金价格的短期预测.     

基于CSO-SVR的气膜钢筋混凝土储仓主体结构施工成本预测研究

为了较准确的预测气膜钢筋混凝土储仓主体结构施工成本,提出一种鸡群算法(CSO)和支持向量回归机(SVR)结合模型,即CSO-SVR,利用CSO算法对SVR进行寻优得到全局最优解,从而得到具有最佳参数的支持向量回归机模型,通过气膜钢筋混凝土储仓主体结构施工成本数据预测仿真,结果显示:CSO-SVR模型预测精度高于PSO-SVR,GA-SVR,SVR,BPNN等方法,是预测气膜钢筋混凝土储仓主体结构施工成本的有效工具.     

Linear feature-weighted support vector machine

The existing support vector machines (SVMs) are all assumed that all the features of training samples have equal contributions to construct the optimal separating hyperplane. However, for a certain real-world data set, some features of it may possess more relevances to the classification information, while others may have less relevances. In this paper, the linear feature-weighted support vector machine (LFWSVM) is proposed to deal with the problem. Two phases are employed to construct the proposed model. First, the mutual information (MI) based approach is used to assign appropriate weights for each feature of the whole given data set. Second, the proposed model is trained by the samples with their features weighted by the obtained feature weight vector. Meanwhile, the feature weights are embedded in the quadratic programming through detailed theoretical deduction to obtain the dual solution to the original optimization problem. Although the calculation of feature weights may add an extra computational cost, the proposed model generally exhibits better generalization performance over the traditional support vector machine (SVM) with linear kernel function. Experimental results upon one synthetic data set and several benchmark data sets confirm the benefits in using the proposed method. Moreover, it is also shown in experiments that the proposed MI based approach to determining feature weights is superior to the other two mostly used methods.     

Support vector machines and neural networks used to evaluate paper manufactured using Eucalyptus globulus

Using advanced machine learning techniques as an alternative to conventional double-entry volume equations, a regression model of the inside-bark volume (dependent variable) for standing Eucalyptus globulus trunks (or main stems) has been built as a function of the following three independent variables: age, height and outside-bark diameter at breast height (DBH). The experimental observed data (age, height, outside-bark DBH and inside-bark volume) for 142 trees (E. globulus) were measured and a nonlinear model was built using a data-mining methodology based on support vector machines (SVM) and multilayer perceptron networks (MLP) for regression problems. Coefficients of determination and Furnival’s indices indicate the superiority of the SVM with a radial kernel over the allometric regression models and the MLP.     

Benchmarking state-of-the-art classification algorithms for credit scoring

In this paper, we study the performance of various state-of-the-art classification algorithms applied to eight real-life credit scoring data sets. Some of the data sets originate from major Benelux and UK financial institutions. Different types of classifiers are evaluated and compared. Besides the well-known classification algorithms (eg logistic regression, discriminant analysis, k-nearest neighbour, neural networks and decision trees), this study also investigates the suitability and performance of some recently proposed, advanced kernel-based classification algorithms such as support vector machines and least-squares support vector machines (LS-SVMs). The performance is assessed using the classification accuracy and the area under the receiver operating characteristic curve. Statistically significant performance differences are identified using the appropriate test statistics. It is found that both the LS-SVM and neural network classifiers yield a very good performance, but also simple classifiers such as logistic regression and linear discriminant analysis perform very well for credit scoring.     

Support vector machines for default prediction of SMEs based on technology credit

In Korea, many forms of credit guarantees have been issued to fund small and medium enterprises (SMEs) with a high degree of growth potential in technology. However, a high default rate among funded SMEs has been reported. In order to effectively manage such governmental funds, it is important to develop an accurate scoring model for selecting promising SMEs. This paper provides a support vector machines (SVM) model to predict the default of funded SMEs, considering various input variables such as financial ratios, economic indicators, and technology evaluation factors. The results show that the accuracy performance of the SVM model is better than that of back-propagation neural networks (BPNs) and logistic regression. It is expected that the proposed model can be applied to a wide range of technology evaluation and loan or investment decisions for technology-based SMEs.     

主成分分析与支持向量机相结合的区域降水预测应用

将主成分分析和支持向量机回归相结合,以广西5、6月区域平均日降水量作为预报对象,进行区域日降水量预测研究.首先,整理分析大量的T213数值预报产品信息数据进行主成分分析,得到主成分数据序列;其次,根据主成分数据序列建立训练集训练支持向量机,并利用遗传算法优化参数;最后,输入支持向量机所需数据,得到主成分预测结果,建立广西日降水预报模型.实例计算结果表明,支持向量机回归模型比逐步回归模型有更好的预测能力.     

路面质量影响因素分析——支持向量机模型

支持向量机(Support Vector Machines)是近年来热门的一种有监督学习的方法,它广泛的应用于统计分类以及回归分析中.通过SVM模型,考察分析一系列影响因素对高速公路路面质量指标的影响,并对提高高速公路路面质量提出建议.     

空气中PM2.5的动态扩散及宏观预测

以PM2.5扩散、衰减模式为研究对象,分析探究了PM2.5的扩散规律、危机治理及其后5年的治理问题.首先通过主成分分析法,建立了PM2.5与其它污染物之间的多元非线性对数模型.同时引入相对湿度的影响因素对模型进行再度优化,提高了模型的拟合优度.运用统计学原理,得出采集点之间的PM2.5具有较高的协同性.另外分析了静态下PM2.5污染物颗粒的受力和漂移模式和从点源、面源两方面分析了PM2.5动态扩散模式,建立了PM2.5的扩散偏微分方程模型.根据建立的扩散模型,对突变的污染物浓度确定安全区域的范围.最后建立综合费用和专项费用的多目标优化模型,利用贝叶斯支持向量机方法对PM2.5进行宏观预测,并运用系统动力学理论对目标值进一步优化,并对不同治理模式进行对比分析.     

一种新的光滑支持向量机的构造及其应用

光滑支持向量机模型是一个无约束、可微的最优化模型,人们可应用快速的最优化方法求解,从而降低计算复杂性.在前人工作的基础上研究基于样条函数的光滑支持向量机,采用广义三弯矩方法构造出六次样条光滑函数,分析了其性能及与正号函数的逼近精度,实现了求解六次样条光滑支持向量机的算法,与其它光滑支持向量机进行了比较,取得了较好的结果.最后将其应用于心脏病模型诊断,实验结果显示具有较高的精确度.