基于组合模型的上市公司高送转预测

本文基于中国市场3465家上市公司7年的数据,首先利用随机森林算法提取出43个因子,再利用Lasso方法进行特征选取,最后选出11个重要因子,然后分别采用logistic回归和决策树方法构建两种预测模型,最后基于损失函数确定权重将两种预测模型按权重进行线性组合建立组合模型.实证结果表明,基于组合模型的预测准确率相比单一模型提高了1.39%.     

拟自适应分类随机森林算法

本文给出了集成学习模型可以收敛的集成学习算法,拟自适应分类随机森林算法。拟自适应分类随机森林算法综合了Adaboost算法和随机森林算法的优势,实验数据分析表明,训练集较大时,拟自适应随机森林算法的效果会好于随机森林算法。另外,拟自适应分类随机森林算法的收敛性确保它的推广误差可以通过训练集估计,所以,对于实际数据,拟自适应分类随机森林算法不需要把数据划分为训练集和测试集,从而,可以有效的利用数据信息。     

集成随机森林和支持向量机的商业银行财务困境预测研究

提出了一种基于随机森林和支持向量机的集成模型来预测商业银行财务困境.结果表明,一方面,与多层感知神经网络相比,支持向量机可以更有效地作为集成学习模型的基分类器,虽然多层感知器神经网络在以往的研究中更多地被用于基分类器.另一方面,与现有的bagging、dagging、multiboost、adaboosting、random subspace等集成学习算法相比,该模型的预测性能明显提高.另一个关键发现是,利用银行业、宏观经济状况和国际金融风险变量补充银行层面的脆弱性,可以显著提高模型在商业银行财务困境预测中的表现.     

基于Stacking算法集成的我国信用债违约预测

通过对2014～2019年我国信用债违约案例的原因分析及相关文献综述，从债券资质、债务主体、财务数据、宏观因素四个维度构建债券违约的指标体系，利用随机森林算法优化，研究发现当影响因素选择18项与37项时，样本内外预测结果达到均衡。基于不同角度的七种算法对比分析，择优选取三种作为底层算法：随机森林算法、梯度提升决策树算法与贝叶斯算法，并结合逻辑回归算法为次级训练算法融合构建基于Stacking算法集成的债券违约预测模型。实证结果表明，第一，Stacking算法的双重集成作用相对底层的单次集成总体精确度提升了1%到8%;第二，对不同指标数量的Stacking算法集成模型的评估表明所构建的指标体系提高了预测水平；第三，基于样本内外预测均衡的底层算法选择方法有效可取，分别纳入相对劣势的底层算法时，会逐渐影响模型稳定性。研究成果可以为我国债券市场风险管理提供技术支持与参考。     

基于CEEMDAN-MR-PE-NLE多频优化组合模型的碳金融市场价格预测

鉴于碳金融市场价格预测的复杂性,遵循"分解"、"重构"、"预测"、"集成"的总体建模架构,构建了CEEMDAN-MR-PE-NLE多频优化组合预测模型.先基于CEEMDAN算法对原始碳价序列进行分解,然后采用CCI贡献度指数和E-C进化聚类算法以及Lempel-Ziv复杂度指数对分量进行重构,进而得到高频分量、低频分量和趋势分量,利用PSO-ELM粒子群优化的极限学习机预测模型对三个重构分量分别进行预测,最后采用非线性集成算法将重构分量的预测结果进行集成,得到最终的碳价预测结果.五种模型预测效果评价指标和MCS检验均表明:与基准模型相比,构建的预测模型性能最优,DM稳健性检验结果也进一步证实了构建的预测模型的稳健性.     

基于深度置信网络的影响广西热带气旋年频数预测方法研究

以气候系统监测指数集、NCEP/NCAR高度场和海温场逐月再分析资料为基础,将影响广西的热带气旋年频数作为预报量,先利用随机森林方法通过计算袋外数据误差判断特征变量重要性的能力,进行随机森林算法(Random Forest,RF)的热带气旋年频数预报因子重要度的分析,再进一步采用由多层无监督学习的受限玻尔兹曼机和一层有监督学习的BP网络构成的深度置信网络(Deep Belief Networks,DBN),建立了基于非线性深度学习的热带气旋年频数预测模型.在预报因子、预报建模样本及独立预报样本相同的情况下,分别采用这种深度学习预测建模方法和逐步回归方法对影响广西的热带气旋年频数进行了预报试验.结果表明,采用这种基于随机森林算法的深度置信网络预测建模分析方法,对10年(2009年-2018年)独立预报样本的预报结果比逐步回归预测模型具有更高的预测精度,其预测平均绝对误差为1.30个,而逐步回归方法的预报平均绝对误差为2.05个;在预测评分上,新模型的预测评分为83.33分,高于逐步回归方法的预测评分73.68分.进一步地,应用新模型对2019-2020年热带气旋年频数进行实际业务预测也获...     

基于组合预测的变压器故障诊断模型

为了快速准确地预测出变压器的故障类型,及时做好维修工作,本文提出了一种基于非线性规划的组合预测模型.首先,利用改进的鲸鱼算法优化BP神经网络建立IWOA-BP预测模型;然后,在IWOA-BP预测模型和梯度提升树的基础上,利用非线性规划与遗传算法相结合的方法确定各算法的权系数,再将各算法的结果加权得出组合模型的最终预测结果.通过实例验证,IWOA-BP预测模型的变压器故障预测效果强于BP神经网络、随机森林等多种预测模型,并且利用IWOA-BP预测模型和梯度提升树建立的组合模型,其预测准确率高于组合中任意一种算法.     

基于EWT-PSO-SVM误差校正组合模型的中国股市预测研究

鉴于股市预测的复杂性.遵循"先分解后集成"的总体建模思路.文章基于EWT分解算法和SVM支持向量机模型.同时结合PSO粒子群优化算法和误差校正组合预测方法,构建了一种中国股票市场建模及预测的EWT-PSO-SVM误差校正组合预测模型.先基于EWT算法将原始价格序列分解成若干分量,再根据频率将其重组成高、中、低频3个分量,对它们分别建立PSO-SVM误差校正组合模型.最后集成各个分量的预测结果.与其他预测模型相比较,文章所构建预测模型的MSE、MAE、MAPE、RMSE、Theil不等系数、确定性系数DC和方向性指标DS 7个指标均优于其他基准预测模型,MCS检验结果同样表明本文构建模型的预测性能最优.稳健性检验结果进一步证实了文章构建的模型预测性能所具备的稳健性.     

基于VMD-ELM的农产品期货价格分解集成预测模型

为了捕捉农产品市场期货价格波动的复杂特征,进一步提高其预测精度,基于分解集成的思想,构建包含变分模态分解(VMD)和极限学习机(ELM)的分解集成预测模型。首先,利用VMD分解的自适应性和非递归性,选择VMD将复杂时间序列分解成多个模态分量(IMF)。其次,针对VMD分解关键参数模态数K的选取难题,提出基于最小模糊熵准则寻找最优K值的方法,有效避免模态混淆和端点效应问题,从而提升VMD的分解能力。最后,利用ELM强大的学习能力和泛化能力,对VMD分解得到的不同尺度子序列进行预测,集成得到最终预测结果。以CBOT交易所稻谷、小麦、豆粕期货价格作为研究对象,实证结果表明,该分解集成预测模型在预测精度和方向性指标上,显著优于单预测模型和其它分解集成预测模型,为农产品期货价格预测提供了一种新途径。     

农业发展的集成预测

利用R/S分析研究了农业发展的总趋势.农业发展的长期变化过程既带有趋势变化成分,又带有周期变化成分,还带有随机变化成分,因而根据趋势变化分析、周期变化分析和随机变化分析集成的方法来预测农业发展是可行的,提出的集成预测模型的拟合误差比单一模型的拟合误差小,预测效果比较好,是农业发展预测的一条比较有效的途径.     

A sequential predictor retraining algorithm and its application to market prediction

In many applications, there are a large number of predictors, designed manually or trained automatically, to predict the same outcome. Much research has been devoted to the design of algorithms that can effectively select/combine these predictors to generate a more accurate ensemble predictor. The collaborative training algorithms from attribute distributed learning provide batch-processing solutions for scenarios in which the individual predictors are heterogeneous, taking different inputs and employing different models. However, in some applications, for example financial market prediction, it is desirable to use an online approach. In this paper, an innovative online algorithm is proposed, stemming from the collaborative training algorithms developed for attribute distributed learning. It sequentially takes new observations, simultaneously adjusting the way that the individual predictors are combined, and provides feedback to the individual predictors for them to be retrained in order to achieve a better ensemble predictor in real time. The efficacy of this new algorithm is demonstrated by extensive simulations on both artificial and real data, and particularly for financial market data. A trading strategy constructed from the ensemble predictor shows strong performance when applied to financial market prediction.     

一种基于随机森林的备件预测模型研究

对舰船零部件发生故障问题进行故障诊断,并对故障诊断结果进行分析,建立舰船零部件备件需求模型,给出零部件之间的发生故障概率的关系与备件需求特征;将随机森林回归原理应用到了舰船零部件的备件需求预测领域,构建了基于随机森林的预测模型,以及预测结果准确率的评价。用诊断结果数据对算法进行验证,结果表明,将随机森林算法运用到舰船的备件预测领域可以为舰船装备在一次海上任务期内备件配置问题提供参考价值。     

Ensemble of a subset of <Emphasis Type="Italic">k</Emphasis>NN classifiers

Combining multiple classifiers, known as ensemble methods, can give substantial improvement in prediction performance of learning algorithms especially in the presence of non-informative features in the data sets. We propose an ensemble of subset of kNN classifiers, ESkNN, for classification task in two steps. Firstly, we choose classifiers based upon their individual performance using the out-of-sample accuracy. The selected classifiers are then combined sequentially starting from the best model and assessed for collective performance on a validation data set. We use bench mark data sets with their original and some added non-informative features for the evaluation of our method. The results are compared with usual kNN, bagged kNN, random kNN, multiple feature subset method, random forest and support vector machines. Our experimental comparisons on benchmark classification problems and simulated data sets reveal that the proposed ensemble gives better classification performance than the usual kNN and its ensembles, and performs comparable to random forest and support vector machines.     

基于IGRA-ISVD约减和RBF的森林火灾消防直升机需求预测模型

针对森林火灾消防直升机需求预测问题,提出了一种基于改进灰色关联分析(IGRA)和改进奇异值分解(ISVD)约简的径向基函数(RBF)神经网络预测模型.首先,基于既有研究梳理了森林火灾消防直升机需求预测指标体系;然后,在改进灰色关联分析和奇异值分解方法的基础上,分别对消防直升机需求预测数据信息进行属性约简和维度约简;最后,利用约简预测数据信息对RBF神经网络进行训练,进而构建消防直升机数量预测模型.案例分析和对比分析表明了本文所提方法的可行性和合理性.     

An efficient random forests algorithm for high dimensional data classification

In this paper, we propose a new random forest (RF) algorithm to deal with high dimensional data for classification using subspace feature sampling method and feature value searching. The new subspace sampling method maintains the diversity and randomness of the forest and enables one to generate trees with a lower prediction error. A greedy technique is used to handle cardinal categorical features for efficient node splitting when building decision trees in the forest. This allows trees to handle very high cardinality meanwhile reducing computational time in building the RF model. Extensive experiments on high dimensional real data sets including standard machine learning data sets and image data sets have been conducted. The results demonstrated that the proposed approach for learning RFs significantly reduced prediction errors and outperformed most existing RFs when dealing with high-dimensional data.     

Improved customer choice predictions using ensemble methods

In this paper various ensemble learning methods from machine learning and statistics are considered and applied to the customer choice modeling problem. The application of ensemble learning usually improves the prediction quality of flexible models like decision trees and thus leads to improved predictions. We give experimental results for two real-life marketing datasets using decision trees, ensemble versions of decision trees and the logistic regression model, which is a standard approach for this problem. The ensemble models are found to improve upon individual decision trees and outperform logistic regression.     

基于空间填充准则的交叉验证方法及其应用

在统计学与机器学习中,交叉验证被广泛应用于评估模型的好坏.但交叉验证法的表现一般不稳定,因此评估时通常需要进行多次交叉验证并通过求均值以提高交叉验证算法的稳定性.文章提出了一种基于空间填充准则改进的k折交叉验证方法,它的思想是每一次划分的训练集和测试集均具有较好的均匀性.模拟结果表明,文章所提方法在五种分类模型(k近邻,决策树,随机森林,支持向量机和Adaboost)上对预测精度的估计均比普通k折交叉验证的高.将所提方法应用于骨质疏松实际数据分析中,根据对预测精度的估计选择了最优的模型进行骨质疏松患者的分类预测.     

Time series forecasting with neural network ensembles: an application for exchange rate prediction

This paper investigates the use of neural network combining methods to improve time series forecasting performance of the traditional single keep-the-best (KTB) model. The ensemble methods are applied to the difficult problem of exchange rate forecasting. Two general approaches to combining neural networks are proposed and examined in predicting the exchange rate between the British pound and US dollar. Specifically, we propose to use systematic and serial partitioning methods to build neural network ensembles for time series forecasting. It is found that the basic ensemble approach created with non-varying network architectures trained using different initial random weights is not effective in improving the accuracy of prediction while ensemble models consisting of different neural network structures can consistently outperform predictions of the single ‘best’ network. Results also show that neural ensembles based on different partitions of the data are more effective than those developed with the full training data in out-of-sample forecasting. Moreover, reducing correlation among forecasts made by the ensemble members by utilizing data partitioning techniques is the key to success for the neural ensemble models. Although our ensemble methods show considerable advantages over the traditional KTB approach, they do not have significant improvement compared to the widely used random walk model in exchange rate forecasting.