Generalized Levinson-Durbin sequences, binomial coefficients and autoregressive estimation

For a discrete time second-order stationary process, the Levinson-Durbin recursion is used to determine the coefficients of the best linear predictor of the observation at time k+1, given k previous observations, best in the sense of minimizing the mean square error. The coefficients determined by the recursion define a Levinson-Durbin sequence. We also define a generalized Levinson-Durbin sequence and note that binomial coefficients form a special case of a generalized Levinson-Durbin sequence. All generalized Levinson-Durbin sequences are shown to obey summation formulas which generalize formulas satisfied by binomial coefficients. Levinson-Durbin sequences arise in the construction of several autoregressive model coefficient estimators. The least squares autoregressive estimator does not give rise to a Levinson-Durbin sequence, but least squares fixed point processes, which yield least squares estimates of the coefficients unbiased to order 1/T, where T is the sample length, can be combined to construct a Levinson-Durbin sequence. By contrast, analogous fixed point processes arising from the Yule-Walker estimator do not combine to construct a Levinson-Durbin sequence, although the Yule-Walker estimator itself does determine a Levinson-Durbin sequence. The least squares and Yule-Walker fixed point processes are further studied when the mean of the process is a polynomial time trend that is estimated by least squares.     

Generalized least squares and maximum likelihood estimations of multivariate polychoric correlations

This paper investigates the generalized least squares estimation and the maximum likelihood estimation of the parameters in a multivariate polychoric correlations model, based on data from a multidimensional contingency table. Asymptotic properties of the estimators are discussed. An iterative procedure based on the Gauss-Newton algorithm is implemented to produce the generalized least squares estimates and the standard errors estimates. It is shown that via an iteratively reweighted method, the algorithm produces the maximum likelihood estimates as well. Numerical results on the finite sample behaviors of the methods are reported.     

Asymptotic results in segmented multiple regression

This paper studies the asymptotic behavior of the least squares estimators in segmented multiple regression. For a model with more than one partitioning variable, each of which has one or more change-points, we study the asymptotic properties of the estimated change-points and regression coefficients. Using techniques in empirical process theory, we prove the consistency of the least squares estimators and also establish the asymptotic normality of the estimated regression coefficients. For the estimated change-points, we obtain their consistency at the rates of or 1/n, with or without continuity constraints, respectively. The change-points estimated under the continuity constraints are also shown to asymptotically have a multivariate normal distribution. For the case where the regression mean functions are not assumed to be continuous at the change-points, the asymptotic distribution of the estimated change-points involves a step function process, whose distribution does not follow a well-known distribution.     

Functional relationships having many independent variables and errors with multivariate normal distribution

This paper deals with maximum likelihood estimation of linear or nonlinear functional relationships assuming that replicated observations have been made on p variables at n points. The joint distribution of the pn errors is assumed to be multivariate normal. Existing results are extended in two ways: first, from known to unknown error covariance matrix; second, from the two variate to the multivariate case.For the linear relationship it is shown that the maximum likelihood point estimates are those obtained by the method of generalized least squares. The present method, however, has the advantage of supplying estimates of the asymptotic covariances of the structural parameter estimates.     

Asymptotic properties of least squares estimators for discrete compound distributions

Let (X, Λ) be a pair of random variables, where Λ is an Ω (a compact subset of the real line) valued random variable with the density functiong(Θ: α) andX is a real-valued random variable whose conditional probability function given Λ=Θ is P {X=x|Θ} withx=x ₀, x₁, …. Based onn independent observations ofX, x ⁽ⁿ⁾, we are to estimate the true (unknown) parameter vectorα=(α ₁, α₂, ...,α_m) of the probability function ofX, P_α(X=∫_ΩP{X=x|Θ}g(Θ:α)dΘ. A least squares estimator of α is any vector \(\hat \alpha \left( {X^{\left( n \right)} } \right)\) which minimizes $$n^{ - 1} \sum\limits_{i = 1}^n {\left( {P_\alpha \left( {x_i } \right) - fn\left( {x_i } \right)} \right)^2 } $$ wherex ⁽ⁿ⁾=(x₁, x₂,…,x _n) is a random sample ofX andf _n(x_i)=[number ofx _i inx ⁽ⁿ⁾]/n. It is shown that the least squares estimators exist as a unique solution of the normal equations for all sufficiently large sample size (n) and the Gauss-Newton iteration method of obtaining the estimator is numerically stable. The least squares estimators converge to the true values at the rate of \(O\left( {\sqrt {2\log \left( {{{\log n} \mathord{\left/ {\vphantom {{\log n} n}} \right. \kern-0em} n}} \right)} } \right)\) with probability one, and has the asymptotically normal distribution.     

Parameter estimation of varying coefficients structural EV model with time series

In this paper, the parameters of a p-dimensional linear structural EV (error-in-variable) model are estimated when the coefficients vary with a real variable and the model error is time series. The adjust weighted least squares (AWLS) method is used to estimate the parameters. It is shown that the estimators are weakly consistent and asymptotically normal, and the optimal convergence rate is also obtained. Simulations study are undertaken to illustrate our AWLSEs have good performance.     

When is the inverse regression estimator MSE-superior to the standard regression estimator in multivariate controlled calibration situations?

We assume as model a standard multivariate regression of y on x, fitted to a controlled calibration sample and used to estimate unknown x′s from observed y-values. The standard weighted least squares estimator (‘classical’, regress y on x and ‘solve’ for x) and the biased inverse regression estimator (regress x on y) are compared with respect to mean squared error. The regions are derived where the inverse regression estimator yields the smaller MSE. For any particular component of x this region is likely to contain ‘most’ future values in usual practice. For simultaneous estimation this needs not be true, however.     

Generalized ridge regression,least squares with stochastic prior information,and Bayesian estimators

The ridge estimator of the usual linear model is generalized by the introduction of an a priori vector r and an associated positive semidefinite matrix S. It is then shown that the generalized ridge estimator can be justified in two ways: (a) by the minimization of the residual sum of squares subject to a constraint on the length, in the metric S, of the vector of differences between r and the estimated linear model coefficients, (b) by incorporating prior knowledge, r playing the role of the vector of means and S proportional to the precision matrix. Both a Bayesian and an Aitken generalized least squares frameworks are used for the latter. The properties of the new estimator are derived and compared to the ordinary least squares estimator. The new method is illustrated with different assumptions on the form of the S matrix.     

Estimation in integer‐valued moving average models

The paper presents new characterizations of the integer‐valued moving average model. For four model variants, we give moments and probability generating functions. Yule–Walker and conditional least‐squares estimators are obtained and studied by Monte Carlo simulation. A new generalized method of moment estimator based on probability generating functions is presented and shown to be consistent and asymptotically normal. The small sample performance is in some instances better than those of alternative estimators. Copyright © 2001 John Wiley & Sons, Ltd.     

Coefficients of determination for least absolute deviation analysis

The least-absolute deviation or l₁ analysis of a linear model is an important alternative to the classical least squares analysis from the point of view of efficiency for longer-tailed error distributions and robustness to the presence of outliers. In this paper two coefficients of determination are proposed for the least-absolute deviation analysis. It is shown that they have desirable properties as measures of multiple association. Both fixed and random predictor variable cases are considered. In the case of random predictor variables, the sample coefficients of determination are shown to be consistent estimators of appropriate population parameters.     

JUMP DETECTION BY WAVELET IN NONLINEAR AUTOREGRESSIVE MODELS

1991MRSubjectClassification62G05,62G201IntroductionDtttectiollofthe.iulnppointshasrecentlyfoundinCleasillginterests.Sincejllliippoillts(\andftstfriheson-iesuddenchallgephenorxlenonena,theyal'every11seflllillrllodellillgpracticalprobl(!lusarisinginfieldssuchaseconomics,signalanalysis,illlageprocessingandphonetici'lentification.TheeallyworkondetectiollofthejumpsisShi..[1]andSpeckman[2].Yin[']consideredthe1llodely(t)=s(t) e(f),05t51,(1.1)wheree(t)isaGaussianwhitenoisewithe(0)=0ands(f)isadeter…     

Double k-Class Estimators in Regression Models with Non-spherical Disturbances

In this paper, we consider a family of feasible generalised double k-class estimators in a linear regression model with non-spherical disturbances. We derive the large sample asymptotic distribution of the proposed family of estimators and compare its performance with the feasible generalized least squares and Stein-rule estimators using the mean squared error matrix and risk under quadratic loss criteria. A Monte-Carlo experiment investigates the finite sample behaviour of the proposed family of estimators.     

Least squares estimators of the regression function with twice censored data

We propose least squares estimators of E(Y/X=x) for Y censored on the right by R and min(Y,R) left censored. We establish their convergence in the L₂-norm. This work extends a known result in the context of right censoring.     

广义偏最小二乘(PLS)估计类

本文研究了一类含有偏最小二乘（partialleastsquaresPLS）估计的估计类．给出了PLS估计的一般代数形式；讨论了含有PLS估计的广义PPLS估计类的统计性质；给出了该估计类优于最小二乘估计的条件．     

Estimating a mean matrix: boosting efficiency by multiple affine shrinkage

The unknown matrix M is the mean of the observed response matrix in a multivariate linear model with independent random errors. This paper constructs regularized estimators of M that dominate, in asymptotic risk, least squares fits to the model and to specified nested submodels. In the first construction, the response matrix is expressed as the sum of orthogonal components determined by the submodels; each component is replaced by an adaptive total least squares fit of possibly lower rank; and these fits are then summed. The second, lower risk, construction differs only in the second step: each orthogonal component is replaced by a modified Efron-Morris fit before summation. Singular value decompositions yield computable formulae for the estimators and their asymptotic and estimated risks. In the asymptotics, the row dimension of M tends to infinity while the column dimension remains fixed. Convergences are uniform when signal-to-noise ratio is bounded. This research was supported in part by National Science Foundation Grant DMS 0404547.     

Admissibilities of linear estimator in a class of linear models with a multivariate t error variable

This paper discusses admissibilities of estimators in a class of linear models,which include the following common models:the univariate and multivariate linear models,the growth curve model,the extended growth curve model,the seemingly unrelated regression equations,the variance components model,and so on.It is proved that admissible estimators of functions of the regression coefficient β in the class of linear models with multivariate t error terms,called as Model II,are also ones in the case that error terms have multivariate normal distribution under a strictly convex loss function or a matrix loss function.It is also proved under Model II that the usual estimators of β are admissible for p 2 with a quadratic loss function,and are admissible for any p with a matrix loss function,where p is the dimension of β.     

On the conic section fitting problem

Adjusted least squares (ALS) estimators for the conic section problem are considered. Consistency of the translation invariant version of ALS estimator is proved. The similarity invariance of the ALS estimator with estimated noise variance is shown. The conditions for consistency of the ALS estimator are relaxed compared with the ones of the paper Kukush et al. [Consistent estimation in an implicit quadratic measurement error model, Comput. Statist. Data Anal. 47(1) (2004) 123-147].     

Wavelet-based estimator for the hurst parameters of fractional brownian sheet

It is proposed a class of statistical estimators H =(H_1,…,H_d) for the Hurst parameters H =(H_1,…,H_d) of fractional Brownian field via multi-dimensional wavelet analysis and least squares,which are asymptotically normal.These estimators can be used to detect self-similarity and long-range dependence in multi-dimensional signals,which is important in texture classification and improvement of diffusion tensor imaging(DTI) of nuclear magnetic resonance(NMR).Some fractional Brownian sheets will be simulated and the simulated data are used to validate these estimators.We find that when H_i ≥ 1/2,the estimators are accurate,and when H_i 1/2,there are some bias.     

˫�������ɷֵĿռ����ģ�͵IJ�������

??In this paper, we construct a generalized spatial panel data model with two-way error components where the spatial correlation also exist in the individual effects. Based on the methods of the generalized moment estimate and the two-step least square estimate, we look for the best instrumental variable, fit generalized moments and the weighted matrix to discuss the estimator of the parameters, and prove the consistent of the estimators. Monte Carlo experiments show that the weighted generalized moment estimators are better than the unweighted generalized moment estimators, and the estimate effect of feasible generalized two stages least squares estimators is good.     

Influence asymptotique de la correction par la moyenne sur l'estimation d'un modèle AR(1) périodique

This Note studies asymptotic influence of mean-correction on the parameter least squares estimation for a periodic AR(1) model. Unlike the stationary ARMA case, we show that fitting a periodic ARMA model with intercepts to the observed series can provide substantial gains in terms of asymptotic accuracy for the parameter least squares estimators compared with fitting a periodic ARMA model without intercepts to the mean-corrected series. To cite this article: A. Gautier, C. R. Acad. Sci. Paris, Ser. I 340 (2005).