Asymptotically optimal estimation in a linear-fractional regression problem with random errors in coefficients

Considering the linear-fractional regression problem with errors in independent variables, we construct and study asymptotically optimal estimators for unknown parameters in the case of violation of the classical regression assumptions (the variances of the observations are different and depend on the unknown parameters).     

Consistent estimation in a linear regression problem with random errors in coefficients

We consider the linear regression model in the case when the independent variables are measured with errors, while the variances of the main observations depend on an unknown parameter. In the case of normally distributed replicated regressors we propose and study new classes of two-step estimates for the main unknown parameter. We find consistency and asymptotic normality conditions for first-step estimates and an asymptotic normality condition for second-step estimates. We discuss conditions under which these estimates have the minimal asymptotic variance.     

Asymptotically normal estimation in the linear-fractional regression problem with random errors in coefficients

We consider the problem of estimating the unknown parameter of the one-dimensional analog of the Michaelis-Menten equation when the independent variables are measured with random errors. We study the behavior of the explicit estimates that we have found earlier in the case of known independent variables and establish almost necessary conditions under which the presence of the random errors does not affect the asymptotic normality of these explicit estimates.     

Improvement of estimators in a linear regression problem with random errors in coefficients

Under consideration is the problem of estimating the linear regression parameter in the case when the variances of observations depend on the unknown parameter of the model, while the coefficients (independent variables) are measured with random errors. We propose a new two-step procedure for constructing estimators which guarantees their consistency, find general necessary and sufficient conditions for the asymptotic normality of these estimators, and discuss the case in which these estimators have the minimal asymptotic variance.     

Asymptotically optimal estimation in the linear regression problem in the case of violation of some classical assumptions

We consider the problem of estimating the unknown parameters of linear regression in the case when the variances of observations depend on the unknown parameters of the model. A two-step method is suggested for constructing asymptotically linear estimators. Some general sufficient conditions for the asymptotic normality of the estimators are found, and an explicit form is established of the best asymptotically linear estimators. The behavior of the estimators is studied in detail in the case when the parameter of the regression model is one-dimensional.     

误差为线性过程时回归模型的估计问题

对一类非线性回归模型及线性模型，在误差是一个弱平稳线性过程及适当的条件下，获得了估计量的r-阶平均相合性、完全相合性和渐近正态性。     

Difference based estimation for partially linear regression models with measurement errors

This paper is concerned with the estimating problem of the partially linear regression models where the linear covariates are measured with additive errors. A difference based estimation is proposed to estimate the parametric component. We show that the resulting estimator is asymptotically unbiased and achieves the semiparametric efficiency bound if the order of the difference tends to infinity. The asymptotic normality of the resulting estimator is established as well. Compared with the corrected profile least squares estimation, the proposed procedure avoids the bandwidth selection. In addition, the difference based estimation of the error variance is also considered. For the nonparametric component, the local polynomial technique is implemented. The finite sample properties of the developed methodology is investigated through simulation studies. An example of application is also illustrated.     

On the estimation of prediction errors in linear regression models

Estimating the prediction error is a common practice in the statistical literature. Under a linear regression model, lete be the conditional prediction error andê be its estimate. We use (ê, e), the correlation coefficient betweene andê, to measure the performance of a particular estimation method. Reasons are given why correlation is chosen over the more popular mean squared error loss. The main results of this paper conclude that it is generally not possible to obtain good estimates of the prediction error. In particular, we show that (ê, e)=O(n ^–1/2) whenn . When the sample size is small, we argue that high values of (ê, e) can be achieved only when the residual error distribution has very heavy tails and when no outlier presents in the data. Finally, we show that in order for (ê, e) to be bounded away from zero asymptotically,ê has to be biased.     

Explicit formulas for the estimation of linear regression coefficients

Lithuanian Mathematical Journal -     

Shrinkage estimation and variable selection in multiple regression models with random coefficient autoregressive errors

In this paper, we consider improved estimation strategies for the parameter vector in multiple regression models with first-order random coefficient autoregressive errors (RCAR(1)). We propose a shrinkage estimation strategy and implement variable selection methods such as lasso and adaptive lasso strategies. The simulation results reveal that the shrinkage estimators perform better than both lasso and adaptive lasso when and only when there are many nuisance variables in the model.     

具有不定位势的渐近线性p-Laplacian Dirichlet问题

利用山路引理及极小作用原理,证明了当非线性项在无穷远处满足一定的渐近线性条件时,具有不定位势的渐近线性p-Laplacian Dirichlet问题,存在非平凡解.     

Independence of linear forms with random coefficients

We extend the classical Darmois–Skitovich theorem to the case where the linear forms L _{r 1} = U ₁ X ₁+ · · · +U _n X _n and L _{r 2} = U _{n +1} X ₁+· · · +U _{2 n} X _n have random coefficients U ₁, . . . ,U _{2 n} . Under minimal restrictions on the random coefficients we completely describe the distributions of the independent random variables X ₁, . . . ,X _n and U ₁, . . . ,U _{2 n} such that the linear forms L _{r 1} and L _{r 2} are independent.     

Asymptotically optimal selection of a piecewise polynomial estimator of a regression function

Let (X, Y) be a pair of random variables such that X = (X₁,…, X_d) ranges over a nondegenerate compact d-dimensional interval C and Y is real-valued. Let the conditional distribution of Y given X have mean θ(X) and satisfy an appropriate moment condition. It is assumed that the distribution of X is absolutely continuous and its density is bounded away from zero and infinity on C. Without loss of generality let C be the unit cube. Consider an estimator of θ having the form of a piecewise polynomial of degree k_n based on m_n^d cubes of length 1/m_n, where the m_n^d(_d^k_n+d) coefficients are chosen by the method of least squares based on a random sample of size n from the distribution of (X, Y). Let (k_n, m_n) be chosen by the FPE procedure. It is shown that the indicated estimator has an asymptotically minimal squared error of prediction if θ is not of the form of piecewise polynomial.     

Local linear regression for data with AR errors

In many statistical applications, data are collected over time, and they are likely correlated. In this paper, we investigate how to incorporate the correlation information into the local linear regression. Under the assumption that the error process is an auto-regressive process, a new estimation procedure is proposed for the nonparametric regression by using local linear regression method and the profile least squares techniques. We further propose the SCAD penalized profile least squares method to determine the order of auto-regressive process. Extensive Monte Carlo simulation studies are conducted to examine the finite sample performance of the proposed procedure, and to compare the performance of the proposed procedures with the existing one. From our empirical studies, the newly proposed procedures can dramatically improve the accuracy of naive local linear regression with working-independent error structure. We illustrate the proposed methodology by an analysis of real data set.     

An optimal control problem with a random stopping time

This paper deals with a stochastic optimal control problem where the randomness is essentially concentrated in the stopping time terminating the process. If the stopping time is characterized by an intensity depending on the state and control variables, one can reformulate the problem equivalently as an infinite-horizon optimal control problem. Applying dynamic programming and minimum principle techniques to this associated deterministic control problem yields specific optimality conditions for the original stochastic control problem. It is also possible to characterize extremal steady states. The model is illustrated by an example related to the economics of technological innovation.This research has been supported by NSERC-Canada, Grants 36444 and A4952; by FCAR-Québec, Grant 88EQ3528, Actions Structurantes; and by MESS-Québec, Grant 6.1/7.4(28).