非平衡数据集的支持向量域分类预测模型研究

基于非平衡数据集的支持向量域分类模型,提出了一种银行客户个人信用预测方法.首先分析了信用预测的主要方法及其不足,然后研究了支持向量域分类模型及其参数的非负二次规划乘性更新算法,进而提出基于支持向量域分类模型的银行客户个人信用预测方法,最后使用人工数据和实际数据对提出方法与支持向量机预测方法进行对比实验.实验结果表明对于银行客户个人信用预测的非平衡数据分析问题,基于支持向量域模型的分类预测方法更有效.     

基于LS-SVM的管道腐蚀速率灰色组合预测模型

为提高管道腐蚀速率预测精度,建立了一种基于最小二乘支持向量机的灰色组合预测模型.以各种灰色模型对管道腐蚀速率的预测结果作为支持向量机的输入,以管道腐蚀速率的实测值作为支持向量机的输出,采用最小二乘支持向量机回归算法和高斯核函数对支持向量机进行训练,利用训练好的支持向量机进行组合预测.预测模型兼具灰色模型所需原始数据少、建模简单、运算方便的优势和最小二乘支持向量机具有泛化能力强、非线性拟合性好、小样本等特性,弥补了单一预测模型的不足,避免了神经网络组合预测易于陷入局部最优的弱点.模型结构简单、实用,仿真结果验证了其有效性.     

果蝇优化最小二乘支持向量机混合预测模型—以我国物流需求量预测为例

为解决最小二乘支持向量机参数设置的盲目性,利用果蝇优化算法对其参数进行优化选择,进而构建了果蝇优化最小二乘支持向量机混合预测模型.以我国物流需求量预测为例,验证了该模型的可行性和有效性.实例验证结果表明:与单一最小二乘支持向量机和模拟退火算法优化最小二乘支持向量机预测模型相比,该模型不仅能够有效选择参数值,而且预测精度更高.     

基于最小二乘加权支持向量机的个人信用预测模型研究

针对不同类别样本数差异和不同误分代价的分类问题，提出了一种基于最小二乘加权支持向量机的分类预测方法。在最小二乘加权支持向量机的基础上，考虑不同类别样本数差异和不同误分代价，提出了新的最小二乘加权支持向量机分类模型，构造了新的最优分类函数。将该模型应用于个人信用预测实验，与已有方法的对比实验结果表明，提出的模型在解决不同类别样本数差异和不同误分代价的个人信用预测问题时，有效地降低了总误分代价，提高了个人信用预测精确度。     

基于遗传算法和熵的缩减记忆式LS-SVM财务困境预测模型研究

为了提高财务困境预测的正确率,减少模型的训练样本数和训练时间,在传统支持向量机(SVM)预测模型的基础上,将遗传算法、信息熵和缩减记忆算法应用于最小二乘支持向量机(LS-SVM),提出了一种基于遗传算法和信息熵的缩减记忆式最小二乘支持向量机预测模型。并独立推导出了适合财务困境预测这一离散序列的熵以及支持向量机核函数的表达式,同时,给出了这一改进模型的实现步骤。实验结果表明,该模型无论是预测正确率,还是训练样本的数量和训练时间,都显著优于最小二乘支持向量机以及传统支持向量机模型。     

基于混沌最小二乘支持向量机的时间序列预测研究

为了对这种具有非线性特性的时间序列进行预测,提出一种基于混沌最小二乘支持向量机.算法将时间序列在相空间重构得到嵌入维数和时间延滞作为数据样本的选择依据,结合最小二乘法原理和支持向量机构建了基于混沌最小二乘支持向量机的预测模型.利用此预测模型对栾城站土壤含水量时间序列进行了预测.结果表明,经过相空间重构优化了数据样本的选取,通过模型的评价指标,混沌最小二乘支持向量机的预测模型能精确地预测具有非线性特性的时间序列,具有很好的理论和应用价值.     

基于凸绝对值不等式的半监督最小二乘支持向量机

针对半监督分类问题,提出了基于凸绝对值不等式的半监督最小二乘支持向量机.传统的半监督支持向量机鲁棒性不强、效率不高,针对这些不足,利用凸绝对值不等式将平面分为两个有重叠的半平面,通过极小化重叠部分以及采用最小二乘支持向量机的思想处理无标签点,提高分类准确率,结果具有一定的鲁棒性.在8个数据集上进行了数值实验,说明了所提出的半监督分类算法的有效性.     

应用模糊支持向量机进行英文情感分类

针对英文情感分类问题,对不同样本采用不同权重,通过引入模糊隶属度函数,通过计算样本模糊隶属度确定样本隶属某一类程度的模糊支持向量机分类算法,通过对比选取不同核函数和不同惩罚系数的结果.仿真实验结果表明应用模糊支持向量机进行英文情感分类具有较好的分类能力和较高的识别能力.     

基于支持向量机的中国工业增加值预测研究

工业增加值是衡量一个国家工业发展水平的重要指标。由于其受多种因素影响，对其预测相对困难。本文提出运用时间序列预测方法对其预测，并利用支持向量机和微分进化算法（differential evolution，DE）相结合的方法对中国工业增加值数据进行预测。数据仿真显示该模型比核主成分分析的最小二乘支持向量机（KPCA-LS-SVM）以及岭回归（ridge regression，RR）具有更高的预测精度。     

基于独立分量分析——最小二乘支持向量机的公路建设项目投资估算新模型

为快速、准确地进行公路建设项目投资估算,提出了一种新型的公路建设项目投资估算模型.该模型首先基于独立分量分析技术,根据最小互信息原理,有效分离出公路建设项目投资估算的独立影响因素源.然后,将这些独立影响因素源用于最小二乘支持向量机的训练,从而建立了基于独立分量分析技术—最小二乘支持向量机的公路建设项目投资估算模型.该模型将独立分量分析技术的盲信号分离能力与最小二乘支持向量机处理有限样本条件下非线性回归问题的优势有机结合,提高了模型预测的准确性.     

Credit risk evaluation using multi-criteria optimization classifier with kernel,fuzzification and penalty factors

With the fast development of financial products and services, bank’s credit departments collected large amounts of data, which risk analysts use to build appropriate credit scoring models to evaluate an applicant’s credit risk accurately. One of these models is the Multi-Criteria Optimization Classifier (MCOC). By finding a trade-off between overlapping of different classes and total distance from input points to the decision boundary, MCOC can derive a decision function from distinct classes of training data and subsequently use this function to predict the class label of an unseen sample. In many real world applications, however, owing to noise, outliers, class imbalance, nonlinearly separable problems and other uncertainties in data, classification quality degenerates rapidly when using MCOC. In this paper, we propose a novel multi-criteria optimization classifier based on kernel, fuzzification, and penalty factors (KFP-MCOC): Firstly a kernel function is used to map input points into a high-dimensional feature space, then an appropriate fuzzy membership function is introduced to MCOC and associated with each data point in the feature space, and the unequal penalty factors are added to the input points of imbalanced classes. Thus, the effects of the aforementioned problems are reduced. Our experimental results of credit risk evaluation and their comparison with MCOC, support vector machines (SVM) and fuzzy SVM show that KFP-MCOC can enhance the separation of different applicants, the efficiency of credit risk scoring, and the generalization of predicting the credit rank of a new credit applicant.     

基于PCA和改进的PSO-SVM的机器人移动方向分类

随着人们创新水平的不断提高,为了更加准确的实现机器人的导航任务,提出了一种基于改进的粒子群优化支持向量机中的参数的方法.首先利用主成分分析法对数据进行降维,然后利用改进的粒子群优化算法,对SVM中的惩罚参数c和核函数的参数g进行优化,最后代入到SVM中,以此来达到运用SVM对机器人的导航任务进行分类识别.相对于其他算法,容易发现改进的粒子群优化算法优化后的支持向量机可以达到很好的效果.这种识别分类可以帮助人们很好的对机器人进行导航,对今后机器人的研究具有很大的应用价值.     

基于KMOD核函数的SVM方法在信用评分中的应用

本文介绍了支持向量分类机,并引入具有更好识别能力的KMOD核函数建立了SVM信用卡分类模型.利用澳大利亚和德国的信用卡数据进行了数值实验,结果表明该模型在分类准确率、支持向量方面优于基于RBF的SVM模型.     

基于核主元提取的支持向量机辨识

将一种基于特征提取的ε-不灵敏支持向量机方法用于非线性系统辨识.对输入输出数据首先进行核主元特征提取,将特征提取后的数据作为支持向量机的训练数据.将该方法与基于主元特征提取的方法和直接应用ε-不灵敏支持向量机的方法进行含噪和不含噪情况下的仿真比较,结果表明,方法的拟合性能和抗干扰能力优于其他两种方法.     

A nonlinear multi-classification knowledge-based kernel machine

This paper presents a knowledge-based nonlinear kernel classification model for multi-category discrimination of sets or objects with prior knowledge. A kernel function is employed to find a nonlinear classifier capable of discriminating future points into an appropriate class. The prior knowledge is in the form of multiple polyhedral sets belonging to one or more categories or classes, and it is introduced as additional constraints into the formulation of the regularized nonlinear kernel least squares multi-class support vector machine model. The resulting formulation leads to a linear system of equations that can be solved using matrix methods or iterative methods. This work extends previous work (Oladunni et al. in ICCS 2006, Lecture notes in Computer Science, Part I, LNCS, vol 3991. Springer, Berlin, pp 188–195, 2006) that incorporated similar prior knowledge into a regularized linear least squares multi-class model. To evaluate the model, data and prior knowledge from the two-phase flow regimes in pipes were used to train and test the proposed formulation.     

Least squares regression principal component analysis: A supervised dimensionality reduction method

Dimensionality reduction is an important technique in surrogate modeling and machine learning. In this article, we propose a supervised dimensionality reduction method, “least squares regression principal component analysis” (LSR-PCA), applicable to both classification and regression problems. To show the efficacy of this method, we present different examples in visualization, classification, and regression problems, comparing it with several state-of-the-art dimensionality reduction methods. Finally, we present a kernel version of LSR-PCA for problems where the inputs are correlated nonlinearly. The examples demonstrate that LSR-PCA can be a competitive dimensionality reduction method.     

A bi‐level neural‐based fuzzy classification approach for credit scoring problems

The credit scoring is a risk evaluation task considered as a critical decision for financial institutions in order to avoid wrong decision that may result in huge amount of losses. Classification models are one of the most widely used groups of data mining approaches that greatly help decision makers and managers to reduce their credit risk of granting credits to customers instead of intuitive experience or portfolio management. Accuracy is one of the most important criteria in order to choose a credit‐scoring model; and hence, the researches directed at improving upon the effectiveness of credit scoring models have never been stopped. In this article, a hybrid binary classification model, namely FMLP, is proposed for credit scoring, based on the basic concepts of fuzzy logic and artificial neural networks (ANNs). In the proposed model, instead of crisp weights and biases, used in traditional multilayer perceptrons (MLPs), fuzzy numbers are used in order to better model of the uncertainties and complexities in financial data sets. Empirical results of three well‐known benchmark credit data sets indicate that hybrid proposed model outperforms its component and also other those classification models such as support vector machines (SVMs), K‐nearest neighbor (KNN), quadratic discriminant analysis (QDA), and linear discriminant analysis (LDA). Therefore, it can be concluded that the proposed model can be an appropriate alternative tool for financial binary classification problems, especially in high uncertainty conditions. © 2013 Wiley Periodicals, Inc. Complexity 18: 46–57, 2013     

基于支持向量机的神经元形态分类

针对神经元的空间几何形态特征分类问题以及神经元的生长预测问题进行了探讨.结合神经元的形态数据,分别建立了基于支持向量机的神经元形态分类模型、基于主成分分析和支持向量机的神经元分类模型以及基于遗传算法和RBF网络的神经元生长预测模型,在较合理的假设下,对各个模型进行求解,得到了较理想的结果.     

An intelligent-agent-based fuzzy group decision making model for financial multicriteria decision support: The case of credit scoring

Credit risk analysis is an active research area in financial risk management and credit scoring is one of the key analytical techniques in credit risk evaluation. In this study, a novel intelligent-agent-based fuzzy group decision making (GDM) model is proposed as an effective multicriteria decision analysis (MCDA) tool for credit risk evaluation. In this proposed model, some artificial intelligent techniques, which are used as intelligent agents, are first used to analyze and evaluate the risk levels of credit applicants over a set of pre-defined criteria. Then these evaluation results, generated by different intelligent agents, are fuzzified into some fuzzy opinions on credit risk level of applicants. Finally, these fuzzification opinions are aggregated into a group consensus and meantime the fuzzy aggregated consensus is defuzzified into a crisp aggregated value to support final decision for decision-makers of credit-granting institutions. For illustration and verification purposes, a simple numerical example and three real-world credit application approval datasets are presented.     

Unsupervised quadratic surface support vector machine with application to credit risk assessment

Unsupervised classification is a highly important task of machine learning methods. Although achieving great success in supervised classification, support vector machine (SVM) is much less utilized to classify unlabeled data points, which also induces many drawbacks including sensitive to nonlinear kernels and random initializations, high computational cost, unsuitable for imbalanced datasets. In this paper, to utilize the advantages of SVM and overcome the drawbacks of SVM-based clustering methods, we propose a completely new two-stage unsupervised classification method with no initialization: a new unsupervised kernel-free quadratic surface SVM (QSSVM) model is proposed to avoid selecting kernels and related kernel parameters, then a golden-section algorithm is designed to generate the appropriate classifier for balanced and imbalanced data. By studying certain properties of proposed model, a convergent decomposition algorithm is developed to implement this non-covex QSSVM model effectively and efficiently (in terms of computational cost). Numerical tests on artificial and public benchmark data indicate that the proposed unsupervised QSSVM method outperforms well-known clustering methods (including SVM-based and other state-of-the-art methods), particularly in terms of classification accuracy. Moreover, we extend and apply the proposed method to credit risk assessment by incorporating the T-test based feature weights. The promising numerical results on benchmark personal credit data and real-world corporate credit data strongly demonstrate the effectiveness, efficiency and interpretability of proposed method, as well as indicate its significant potential in certain real-world applications.