一类小样本的统计方法建模及其可视化

针对一类高维小样本数据,利用统计方法的非参数检验与偏最小二乘回归(PLS)构造小样本预测模型,实现基于Wilcoxon秩和检验的变量选择与基于PLS的变量压缩降维.并通过DNA序列分类问题实现基于统计方法的小样本数据建模与可视化,计算结果表明方法对小样本具有可行性、有效性.     

偏最小二乘回归的应用效果分析

本文介绍了偏最小二乘回归 (PLS)的建模方法 ,比较了PLS与普通最小二乘回归 (OLS)及主成分回归的应用效果 ,并总结了PLS回归的基本特点 .     

PLS1回归对多变量信息的综合与筛选作用分析

王惠文，ＰＬＳ１回归对多变量信息的综合与筛选作用分析，数理统计与管理，１９９８，１７（４），４６～４９。本文讨论了ＰＬＳ１回归对多变量系统中的信息进行综合与筛选的工作策略。通过例证分析指出，ＰＬＳ１回归方法可以有效地提取对系统解释性最强的综合变量，排除重叠信息或无解释意义的信息干扰，从而较好地克服变量多重相关性在系统建模中的不良作用     

偏最小二乘回归分析在均匀设计试验建模分析中的应用

本文分析了目前应用一般的最小二乘法建立均匀试验数据的二次多项式回归模型时存在的局限性,提出了应用偏最小二乘法(Partial least-square,PLS)建立二次多项式回归模型的技术,并且进一步介绍了偏最小二乘回归(PLS回归)在均匀设计中的应用。作者认为,PLS回归分析建模技术将为均匀设计的更广泛应用提供有力的技术支持。     

基于ELM算法的羊肉水分含量的快速无损检测

在近红外光谱900-1700nm的波长范围内采集南疆羊肉的光谱数据,来研究水分含量的快速无损检测.为减弱非目标因素对光谱的影响,采用SNV和去趋势法对光谱数据进行预处理.为降低建模的复杂度,去除共线性的影响,采用连续投影算法和相关系数法相结合选取8个特征波长变量,最后使用PLS和ELM算法分别进行建模.实验表明,与采用全光谱波段建模相比,采用特征波长变量建模,PLS和ELM算法的运行时间都大大缩短,并且在运行时间和预测精度上,ELM算法均优于PLS算法.ELM算法采用8个特征波段变量建模,预测精度达到0.9768,均方误差为4.4291e-04,相关系数为0.7603,运行时间可控制在1e-04s之下,这可为研发羊肉水分含量的便携式检测装置提供理论参考.     

多元成分数据的对数衬度偏最小二乘通径分析模型

本文研究多元成分数据的路径关联关系的建模问题,提出多元成分数据的对数衬度PLS通径分析模型.将中心化对数比变换与PLS通径分析方法相结合建立模型,其主要优势在于:①PLS通径分析模型对数据没有严格的分布假设要求,特别适于成分数据这类分布复杂的数据建模;②成分数据中心化对数比变换后的变量完全多重相关,PLS方法能够有效解决这一问题;③PLS通径分析模型特别适于多元成分数据这类具有层次关系的数据结构的建模,通过结构模型揭示多元成分数据之间的整体性路径关联关系,通过测量模型揭示成分数据与其成分分量之间的构成关系.更重要的是,本文的方法研究遵循成分数据所特有的代数基本理论,推导出模型的成分数据对数衬度隐变量的表达形式,从理论上证明了该建模方法的科学合理性.最后,将本方法用于北京市三次产业的投资结构、GDP结构、就业结构的路径关联关系的分析中,通过实证研究验证模型的可行性和应用价值.     

处理多元线性回归中自变量共线性的几种方法：—SAS／STAT软件（6．12）中RE

本文通过例子介绍多元线性回归中自变量共线性的诊断以及使用SAS／SATA（6．12）软件中的REG等过程的增强功能处理回归变量共线性的一些方法,包括筛变量法,岭回归分析法,主成分回归法和稔蕞小二乘回归法。     

两个多重相关变量组的统计分析(3)(偏最小二乘回归与PLS过程)

本文用PLS过程建立多因变量的偏最小二乘回归模型 ,并用具体例子对最小二乘回归(MLR)、主成分回归 (PCK)和偏最小二乘回归 (PLS)进行比较     

基于PLS模型的我国服务贸易出口影响因素分析

当前全球经济竞争的重点正从货物贸易转向服务贸易，服务贸易已经成为衡量一国国际竞争力强弱的一项重要标准。而现阶段我国服务贸易虽然发展迅速，但是总体水平较低，且长期处于逆差状态。因此，科学分析影响我国服务贸易出口的相关因素，从而逐步提升我国服务贸易出口的竞争优势显得十分紧迫和必要。本文引入基于高维投影思想的非参数方法——偏最小二乘（Partia／Least Square，简称PLS）方法，以1990—2005年我国服务贸易年度统计数据为样本，建立了回归模型。拟合结果表明，PLS回归模型能有效克服样本点少且变量间多重共线性严重等问题，有助于客观准确度量和识别影响我国服务贸易出口的主要因素。本文实证结果对制定提升我国服务贸易出口竞争优势的政策具有一定意义。     

广义偏最小二乘(PLS)估计类

本文研究了一类含有偏最小二乘（partialleastsquaresPLS）估计的估计类．给出了PLS估计的一般代数形式；讨论了含有PLS估计的广义PPLS估计类的统计性质；给出了该估计类优于最小二乘估计的条件．     

系统的PLS方法在满意度实证研究中的应用

满意度模型实证研究包括系统性方法和非系统性方法.系统性方法更有效地反映因果关系的有机联系,它包括PLS和SEM两种方法.本文在用方程系统表达满意度模型的基础上,说明PLS方法的基本原理,然后对一个具体的满意度模型在SEM方法失效的情况下,运用系统的PLS方法进行实证研究.结果表明,在SEM方法无法得到实证结果的情况下,PLS给出了很有价值的结论.     

On the convergence of the partial least squares path modeling algorithm

This paper adds to an important aspect of Partial Least Squares (PLS) path modeling, namely the convergence of the iterative PLS path modeling algorithm. Whilst conventional wisdom says that PLS always converges in practice, there is no formal proof for path models with more than two blocks of manifest variables. This paper presents six cases of non-convergence of the PLS path modeling algorithm. These cases were estimated using Mode A combined with the factorial scheme or the path weighting scheme, which are two popular options of the algorithm. As a conclusion, efforts to come to a proof of convergence under these schemes can be abandoned, and users of PLS should triangulate their estimation results.     

An overview on the shrinkage properties of partial least squares regression

The aim of this paper is twofold. In the first part, we recapitulate the main results regarding the shrinkage properties of partial least squares (PLS) regression. In particular, we give an alternative proof of the shape of the PLS shrinkage factors. It is well known that some of the factors are >1. We discuss in detail the effect of shrinkage factors for the mean squared error of linear estimators and argue that we cannot extend the results to PLS directly, as it is nonlinear. In the second part, we investigate the effect of shrinkage factors empirically. In particular, we point out that experiments on simulated and real world data show that bounding the absolute value of the PLS shrinkage factors by 1 seems to leads to a lower mean squared error.     

PLS classification of functional data

Partial least squares (PLS) approach is proposed for linear discriminant analysis (LDA) when predictors are data of functional type (curves). Based on the equivalence between LDA and the multiple linear regression (binary response) and LDA and the canonical correlation analysis (more than two groups), the PLS regression on functional data is used to estimate the discriminant coefficient functions. A simulation study as well as an application to kneading data compare the PLS model results with those given by other methods.     

PLS and dimension reduction for classification

Barker and Rayens (J Chemometrics 17:166–173, 2003) offered convincing arguments that partial least squares (PLS) is to be preferred over principal components analysis (PCA) when discrimination is the goal and dimension reduction is required, since at least with PLS as the dimension reduction tool, information involving group separation is directly involved in the structure extraction. In this paper the basic results in Barker and Rayens (J Chemometrics 17:166–173, 2003) are reviewed and some of their ideas and comparisons are illustrated on a real data set, something which Barker and Rayens did not do. More importantly, new results are introduced, including a formal proof for the superiority of PLS over PCA in the two-group case, as well as new connections between PLS for discrimination and an extended class of PLS-like techniques known as “oriented PLS” (OrPLS). In the latter case, a particularly simple subclass of OrPLS procedures, when used to achieve the dimension reduction, is shown to always produce a lower misclassification rate than when “ordinary” PLS is used for the same purpose.     

非线性半参数模型的虚拟观测法

本文首先介绍非线性半参数回归中常用的补偿最小二乘法,然后基于先验信息将其转化成对此问题的虚拟观测,用虚拟观测与原观测联合,按常规的最小二乘方法求解.最后运用的实例计算结果表明,虚拟观测方法计算的结果一般优于常规的补偿最小二乘结果,基本上可达到理论上的最优解.     

Optimisation of unweighted/weighted maximum independent sets and minimum vertex covers

This paper extends the recently introduced Phased Local Search (PLS) maximum clique algorithm to unweighted/weighted maximum independent set and minimum vertex cover problems. PLS is a stochastic reactive dynamic local search algorithm that interleaves sub-algorithms which alternate between sequences of iterative improvement, during which suitable vertices are added to the current sub-graph, and plateau search, during which vertices of the current sub-graph are swapped with vertices not contained in the current sub-graph. These sub-algorithms differ in their vertex selection techniques and also in the perturbation mechanism used to overcome search stagnation. PLS has no problem instance dependent parameters and achieves state-of-the-art performance over a large range of the commonly used DIMACS and other benchmark instances.     

Improving Penalized Least Squares through Adaptive Selection of Penalty and Shrinkage

Estimation of the mean function in nonparametric regression is usefully separated into estimating the means at the observed factor levels—a one-way layout problem—and interpolation between the estimated means at adjacent factor levels. Candidate penalized least squares (PLS) estimators for the mean vector of a one-way layout are expressed as shrinkage estimators relative to an orthogonal regression basis determined by the penalty matrix. The shrinkage representation of PLS suggests a larger class of candidate monotone shrinkage (MS) estimators. Adaptive PLS and MS estimators choose the shrinkage vector and penalty matrix to minimize estimated risk. The actual risks of shrinkage-adaptive estimators depend strongly upon the economy of the penalty basis in representing the unknown mean vector. Local annihilators of polynomials, among them difference operators, generate penalty bases that are economical in a range of examples. Diagnostic techniques for adaptive PLS or MS estimators include basis-economy plots and estimates of loss or risk.