PLS分析与RBF神经网络耦合环境模型

鉴于城市大气环境质量受到诸多复杂因素影响,且各因素间存在多重相关性,本文将偏最小二乘(PLS)分析与人工神经网络径向基网络(RBF)耦合,建立偏最小二乘径向基神经网络模型(PLSRBF),应用于贵阳大气环境质量的检验和预测。实例表明:PLSRBF模型可对原多自变量模型进行降维简化,并可有效提取解释变量信息,防止信息丢失,且具有较强的拟合能力。     

加权总体最小二乘问题的分析

总体最小二乘问题由Golub和Van Loan首先进行数学的分析,随后人们对于总体最小二乘问题的算法、解的各种形式、总体最小二乘解和最小二乘解的关系、总体最小二乘解的扰动理论以及数值试验作了大量的研究工作。近来,[10]中给出了总体最小二乘问题(TLS)较一般地讨论。另一方面,Golub和Van Loan研究了总体最小二乘问题的特殊均加权形式。本文试图在[10,11]的基础上讨论最一般的总体最小二     

天然气消费量的偏最小二乘支持向量机预测

结合偏最小二乘法和支持向量机的优缺点,提出基于偏最小二乘支持向量机的天然气消费量预测模型。首先,利用偏最小二乘法确定影响天然气消费量的新综合变量,建立以新综合变量为输入,天然气消费量为输出的支持向量机模型,对天然气消费量进行了预测;然后,与多元回归、偏最小二乘回归、普通支持向量机做误差检验比较,验证该方法的可行性与正确性。结果表明,此天然气消费量预测模型具有较高的精确度和应用价值。     

偏最小二乘回归法在武器装备研制费用估算中的应用

参数估算法作为 LCC的一种估算方法主要应用于武器装备研制费用的估算 .由于样本数据较少 ,且变量之间的线性相关程度高 ,如果使用传统的普通最小二乘法 (OLS)估算 ,则会严重降低估计结果的有效性 .而偏最小二乘回归法 (PLS)可以克服样本点少和高线性相关性的问题 ,使估算结果更趋于真值 .以某型无人侦察机的研制费用估算和美国军用飞机发动机研制费用估算为例 ,主要研究偏最小二乘回归法 (PLS)在武器装备研制费用估算中的应用     

泛最小二乘法的改进及其容许性

考虑线性回归模型,当设计阵呈病态或秩亏时,我们用泛最小二乘法给出参数的估计,并证明其容许性;然后针对泛最小二乘估计对最小二乘估计过度压缩的缺点加以改进,使之更合理,有效.     

复变量移动最小二乘近似在Sobolev空间中的误差估计

复变量移动最小二乘近似是形成无网格法形函数的重要方法,为了研究相应的无网格方法的误差估计,需要先分析复变量移动最小二乘近似的逼近误差.首先介绍了复变量移动最小二乘近似,接着在权函数满足一定假设的条件下,详细讨论了复变量移动最小二乘近似逼近函数在Sobolev空间中的误差估计,给出了逼近函数在Hk范数下的误差界,分析结果表明逼近函数的误差随着节点间距的减小而降低.最后给出了一个数值算例来验证理论分析的正确性.     

偏最小二乘建模在R软件中的实现及实证分析

通过介绍偏最小二乘（PLS）的建模和显著性检验原理,解决了小样本多变量且变量间存在多重共线性的回归问题,建立了多变量对多变量的回归模型,并使用R软件（版本为Ri3862．15．1）实现了PLS建模;最后基于葡萄和葡萄酒理化指标数据进行了实证分析．     

最小一乘估计快速算法

最小二乘估计容易受奇异点的影响, 最小一乘估计是稳健估计, 可以很好地克服这个缺陷, 但计算困难. 基于非退化模型假设下的稳定极点理论, 本文找到了快速准确求解最小一乘估计的迭代算法,并给出算法的计算过程及与线性规划求解的比较, 较好地解决了最小一乘估计计算难的问题, 使其成为有效的参数估计方法.     

基于比例移动最小二乘近似的误差分析

相较于移动最小二乘近似方法,比例移动最小二乘近似法有效地克服了前者带来的矩阵病态这一问题,展示出了更好的数值稳定性和更高的计算精度.给出了比例移动最小二乘近似对函数及其任意阶导数的误差估计,并给出了数值算例来验证之前的理论分析结果,通过与移动最小二乘近似的比较,表明比例移动最小二乘近似能得到更快的收敛性和更稳定的计算性.     

最小二乘问题及其研究

本文从理论上讨论了线性方程中最小二乘解的存在性及最小范数最小二乘解的唯一性，并给出求最小二乘解及最小范数最小二乘解的公式方法。     

Semiparametric Estimation and Selection for Nonstationary Spatial Covariance Functions

We propose a method for estimating nonstationary spatial covariance functions by representing a spatial process as a linear combination of some local basis functions with uncorrelated random coefficients and some stationary processes, based on spatial data sampled in space with repeated measurements. By incorporating a large collection of local basis functions with various scales at various locations and stationary processes with various degrees of smoothness, the model is flexible enough to represent a wide variety of nonstationary spatial features. The covariance estimation and model selection are formulated as a regression problem with the sample covariances as the response and the covariances corresponding to the local basis functions and the stationary processes as the predictors. A constrained least squares approach is applied to select appropriate basis functions and stationary processes as well as estimate parameters simultaneously. In addition, a constrained generalized least squares approach is proposed to further account for the dependencies among the response variables. A simulation experiment shows that our method performs well in both covariance function estimation and spatial prediction. The methodology is applied to a U.S. precipitation dataset for illustration. Supplemental materials relating to the application are available online.     

基于最小截平方和估计的监测数据分析方法

水工程安全监测数据中不可避免地存在离群点,而应用最为广泛的最小二乘法(least square,LS)不具备剔除离群点的能力,反而更易吸收离群点,使回归曲线严重偏离实际。针对LS在此方面的缺陷,本文在最小化残差平方和理论的基础上,提出采用最小截平方和估计(least trimmed squares,LTS)方法来构建水工程安全监控模型。根据实际工程的监测资料并对监测资料分析处理,剔除离群点得到最优数据群。通过求解最优数据群的回归系数,进而得到最接近实际数据的拟合曲线。相比于LS估计,LTS估计所得结果更具有合理性、稳健性,且能够显著提高数据的预测精度。因此,LTS估计在水工程安全监测等数据分析中具有良好的应用前景。     

半变系数模型研究美国爱荷华州埃姆斯市的房价问题

近年来房地产业发展迅猛,房价快速走高,对经济发展和社会稳定产生了重大影响,因此房价研究具有重要的社会价值和经济意义.文章通过散点图及其拟合曲线展示不同协变量和响应变量之间的相关关系,提出半变系数模型建模美国埃姆斯市的房价问题.文章采用剖面最小二乘法研究7个协变量:地面以上的居住面积、地面以上的房间总数(不包括卫生间)、卫生间总数、房屋整体建材质量和品质、地下室面积、车库面积、建造年份与埃姆斯市房价之间的回归关系,为房价预测研究作准备.研究结果表明半变系数模型在探索美国爱荷华州埃姆斯市房价方面表现较好.因此,文章提供了一种利用半变系数模型同时学习高维数据线性和交互关系的有效方法.     

Parameter Estimation of Multivariate Regression Model with Fuzzy Random Errors

In many real-world problems, observations are usually described by approximate values due to fuzzy uncertainty, unlikeprobabilistic uncertainty that has nothing to do with experimentation. The combination of statistical model and fuzzy set theory is helpful to improve the identification and analysis of complex systems. As an extension ofstatistical techniques, this study is an investigation of the relationship between fuzzy multiple explanatory variables and fuzzy response with numeric coefficients and the fuzzy random error term. In this work we describe a parameter estimation procedure carrying out the least-squares method in a complete metric space of fuzzy numbers to determine the coefficients based on the extension principle. We demonstrate how the fuzzy least squares estimators present large sample statistical properties, including asymptotic normality, strong consistency and confidence region. The estimators are also examined via asymptotic relative efficiency concerning traditional least squares estimators. Different from the construction of error term in Kim et al.\cite{21}, it is more reasonable in the proposed model since the problems of inconsistency in referring to fuzzy variable and producing the negative spreads may be avoided. The experimental study verifies that the proposed fuzzy least squares estimators achieve the meaning consistent with the theory identification for large sample data set and better generalization regarding one single variable model.     

应用SAS解非线性回归问题

.应用SAS/STAT估计非线性回归模型中的参数.首先,通过变量代换,把可以线性化的非线性回归模型化为线性回归模型,并用普通最小二乘法、主成分分析法和偏最小二乘法求模型中的参数和回归模型.其次,通过改良的高斯—牛顿迭代法来估计Logistic模型和Compertz模型中的参数.     

Perturbation analysis for mixed least squares–total least squares problems

In many linear parameter estimation problems, one can use the mixed least squares–total least squares (MTLS) approach to solve them. This paper is devoted to the perturbation analysis of the MTLS problem. Firstly, we present the normwise, mixed, and componentwise condition numbers of the MTLS problem, and find that the normwise, mixed, and componentwise condition numbers of the TLS problem and the LS problem are unified in the ones of the MTLS problem. In the analysis of the first‐order perturbation, we first provide an upper bound based on the normwise condition number. In order to overcome the problems encountered in calculating the normwise condition number, we give an upper bound for computing more effectively for the MTLS problem. As two estimation techniques for solving the linear parameter estimation problems, interesting connections between their solutions, their residuals for the MTLS problem, and the LS problem are compared. Finally, some numerical experiments are performed to illustrate our results.     

An algorithm for least squares analysis of spectroscopic data

This paper describes a variant of the Gauss-Newton-Hartley algorithm for nonlinear least squares, in which aQR implementation is used to solve the linear least squares problem. We follow Grey's idea of updating variables at intermediate stages of the orthogonalization. This technique, applied in partitions identified with known or suspected spectral lines, appears to be especially suited to the analysis of spectroscopic data. We suggest that this algorithm is an attractive candidate for the optimization role in Ekenberg's interactive computer graphics curve fitting program.     

对部分线性模型用惩罚最小二乘估计时最优光滑化的注记

部分线性模型也就是响应变量关于一个或者多个协变量是线性的, 但对于其他的协变量是非线性的关系\bd 对于部分线性模型中的参数和非参数部分的估计方法, 惩罚最小二乘估计是重要的估计方法之一\bd 对于这种估计方法, 广义交叉验证法提供了一种确定光滑参数的方法\bd 但是, 在部分线性模型中, 用广义交叉验证法确定光滑参数的最优性还没有被证明\bd 本文证明了利用惩罚最小二乘估计对于部分线性模型估计时, 用广义交叉验证法选择光滑参数的最优性\bd 通过模拟验证了本文中所提出的用广义交叉验证法选择光滑参数具有很好的效果, 同时, 本文在模拟部分比较了广义交叉验证和最小二乘交叉验证的优劣.