Abnormal behavior of the least squares estimate of multiple regression

An example is given to reveal the abnormal behavior of the least squares estimate of multiple regression. It is shown that the least squares estimate of the multiple linear regression may be “improved” in the sense of weak consistency when nuisance parameters are introduced into the model. A discussion on the implications of this finding is given.     

Bipartite graphs with the maximum sum of squares of degrees

In this paper we determine all the bipartite graphs with the maximum sum of squares of degrees among the ones with a given number of vertices and edges.     

两个多重相关变量组的统计分析(2)

本文介绍用最小二乘准则建立多对多线性回归模型 (MLR) ,以及建立主成分回归 (PCR) ,并通过例子比较之。     

The convergence rates of empirical Bayes estimation in a multiple linear regression model

Empirical Bayes (EB) estimation of the parameter vector =(,²) in a multiple linear regression modelY=X+ is considered, where is the vector of regression coefficient, N(0,² I) and ² is unknown. In this paper, we have constructed the EB estimators of by using the kernel estimation of multivariate density function and its partial derivatives. Under suitable conditions it is shown that the convergence rates of the EB estimators areO(n ^{-(k-1)(k-2)/k(2k+p+1)}), where the natural numberk3, 1/3<<1, andp is the dimension of vector .The project is supported by the National Natural Science Foundation of China.     

A Berry-Esseen bound for least squares error variance estimators of regression parameters

We construct a precise Berry-Esseen bound for the least squares error variance estimators of regression parameters. Our bound depends explicitly on the sequence of design variables and is of the order O(N ^−1/2) if this sequence is “regular” enough. Supported by the Lithuanian State Science and Studies Foundation. Vilnius University, Naugarduko 24; Institute of Mathematics and Informatics, Akademijos 4, 2600 Vilnius, Lithuania. Published in Lietuvos Matematikos Rinkinys, Vol. 39, No. 1, pp. 1–8, January–March, 1999.     

生产函数中参数估计方法的改进

在原有生产函数参数估计方法的基础上,提出一种新的估计方法。计算实例表明:该估计方法具有最小的残差平方和,是一种比较理想的估计方法     

处理多元线性回归中自变量共线性的几种方法--SAS/STAT软件(6.12)中REG等过程增强功能的使用

本文通过例子介绍多元线性回归中自变量共线性的诊断以及使用 SAS/SATA( 6.12 )软件中的 REG等过程的增强功能处理回归变量共线性的一些方法。包括筛选变量法 ,岭回归分析法 ,主成分回归法和偏最小二乘回归法     

Local linear regression for data with AR errors

In many statistical applications, data are collected over time, and they are likely correlated. In this paper, we investigate how to incorporate the correlation information into the local linear regression. Under the assumption that the error process is an auto-regressive process, a new estimation procedure is proposed for the nonparametric regression by using local linear regression method and the profile least squares techniques. We further propose the SCAD penalized profile least squares method to determine the order of auto-regressive process. Extensive Monte Carlo simulation studies are conducted to examine the finite sample performance of the proposed procedure, and to compare the performance of the proposed procedures with the existing one. From our empirical studies, the newly proposed procedures can dramatically improve the accuracy of naive local linear regression with working-independent error structure. We illustrate the proposed methodology by an analysis of real data set.     

The least squares g-inverses for sum of matrices

In this article, we exhibit under suitable conditions a neat relationship between the least squares g-inverse for a sum of two matrices and the least squares g-inverses of the individual terms. We give a necessary and sufficient condition for the set equations (A?+?B){1,?3}?=?A{1,?3}?+?B{1,?3} and (A?+?B){1,?4}?=?A{1,?4}?+?B{1,?4}.     

Multiple criteria linear regression

The unknown parameters in multiple linear regression models may be estimated using any one of a number of criteria such as the minimization of the sum of squared errors MSSE, the minimization of the sum of absolute errors MSAE, and the minimization of the maximum absolute error MMAE. At present, the MSSE or the least squares criterion continues to be the most popular. However, at times the choice of a criterion is not clear from statistical, practical or other considerations. Under such circumstances, it may be more appropriate to use multiple criteria rather than a single criterion to estimate the unknown parameters in a multiple linear regression model. We motivate the use of multiple criteria estimation in linear regression models with an example, propose a few models, and outline a solution procedure.     

Empirical Bayes estimation in a multiple linear regression model

Summary Estimation of the vector β of the regression coefficients in a multiple linear regressionY=Xβ+ε is considered when β has a completely unknown and unspecified distribution and the error-vector ε has a multivariate standard normal distribution. The optimal estimator for β, which minimizes the overall mean squared error, cannot be constructed for use in practice. UsingX, Y and the information contained in the observation-vectors obtained fromn independent past experiences of the problem, (empirical Bayes) estimators for β are exhibited. These estimators are compared with the optimal estimator and are shown to be asymptotically optimal. Estimators asymptotically optimal with rates nearO(n ⁻¹) are constructed. Supported in part by a Natural Sciences and Engineering Research Council of Canada grant.     

On stable least squares solution to the system of linear inequalities

The system of inequalities is transformed to the least squares problem on the positive ortant. This problem is solved using orthogonal transformations which are memorized as products. Author’s previous paper presented a method where at each step all the coefficients of the system were transformed. This paper describes a method applicable also to large matrices. Like in revised simplex method, in this method an auxiliary matrix is used for the computations. The algorithm is suitable for unstable and degenerate problems primarily.      

A short proof for the sum formula and its generalization

For positive integers with a _r  = 2, the multiple zeta value or r-fold Euler sum is defined as [2]

Adaptive local linear quantile regression

In this paper we propose a new method of local linear adaptive smoothing for nonparametric conditional quantile regression. Some theoretical properties of the procedure are investigated. Then we demonstrate the performance of the method on a simulated example and compare it with other methods. The simulation results demonstrate a reasonable performance of our method proposed especially in situations when the underlying image is piecewise linear or can be approximated by such images. Generally speaking, our method outperforms most other existing methods in the sense of the mean square estimation (MSE) and mean absolute estimation (MAE) criteria. The procedure is very stable with respect to increasing noise level and the algorithm can be easily applied to higher dimensional situations.     

Asymptotic theory of least squares estimator in a nonregular nonlinear regression model

The asymptotic properties of the least squares estimator are derived for a nonregular nonlinear model via the study of weak convergence of the least squares process. This approach was adapted earlier by the author in the smooth case. The model discussed here is not amenable to analysis via the normal equations and Taylor expansions used by earlier authors.     

Average behavior of Fourier coefficients of cusp forms over sum of two squares

Let ${\lambda }_f(n)$ denote the nth normalized Fourier coefficient of the classical holomorphic cusp form of even integral weight $k\ge 2$ for the full modular group $\mathit{SL}(2,\mathbb{Z})$. In this paper, we investigate the average behavior of the power sum$\sum _{a^2+b^2\le x}{\lambda }_f{(a^2+b^2)}^{?}$ for $x\ge 1$, $2\le ?\le 8$ and $a,b,?\in \mathbb{Z}$.     

Online signal extraction by robust linear regression

Summary  In intensive care, time series of vital parameters have to be analysed online, i.e. without any time delay, since there may be serious consequences for the patient otherwise. Such time series show trends, slope changes and sudden level shifts, and they are overlaid by strong noise and many measurement artefacts. The development of update algorithms and the resulting increase in computational speed allows to apply robust regression techniques to moving time windows for online signal extraction. By simulations and applications we compare the performance of least median of squares, least trimmed squares, repeated median and deepest regression for online signal extraction.     

Central limit theorem of linear regression model under right censorship

In this paper,the estimation of joint dlstribution F(y,z)of(Y,Z)and the estimation in thelinear regression model Y=b'Z+εfor complete data are extended to that of the right censored data.Theregression parameter estimates of b and the variance of ε are weighted least square estimates with randomweights. The central limit theorems of the estimators are obtained under very weak conditions and the derivedasymptotic variance has a very simple form.