Polynomial regression with errors in the variables

A polynomial functional relationship with errors in both variables can be consistently estimated by constructing an ordinary least squares estimator for the regression coefficients, assuming hypothetically the latent true regressor variable to be known, and then adjusting for the errors. If normality of the error variables can be assumed, the estimator can be simplified considerably. Only the variance of the errors in the regressor variable and its covariance with the errors of the response variable need to be known. If the variance of the errors in the dependent variable is also known, another estimator can be constructed.     

Missing data in linear models with correlated errors

One common method for analyzing data in experimental designs when observations are missing was devised by Yates (1933), who developed his procedure based upon a suggestion by R. A. Fisher. Considering a linear model with independent, equi-variate errors, Yates substituted algebraic values for the missing data and then minimized the error sum of squares with respect to both the unknown parameters and the algebraic values. Yates showed that this procedure yielded the correct error sum of squares and a positively biased hypothesis sum of squares.

Others have elaborated on this technique. Chakrabarti (1962) gave a formal proof of Fisher's rule that produced a way to simplify the calculations of the auxiliary values to be used in place of the missing observations. Kshirsagar (1971) proved that the hypothesis sum of squares based on these values was biased, and developed an easy way to compute that bias. Sclove     

正交多项式回归模型参数估计的格子设计及其最小二乘估计

对二元二次多项式回归模型进行预先正交化处理,提出使用因子空间的N等份的格子设计的观点,推导出了信息矩阵的一般性结构,并给出了该设计的非退化条件及其最小二乘估计和对应的协方差矩阵。     

Standard errors for the Laspeyres index number with autocorrelated error models

This paper deals with the stochastic approach to Laspeyres price index number with the assumption of serial correlation of orders 1 and 2. The first round of estimation provides the estimates of Laspeyres index numbers in the presence of serial correlation assuming that variance is independent of time. In the second round of estimation, we use the weighted least square approach to derive the standard errors of Laspeyres index number assuming variance is dependent on time. These standard errors are linked to the variability of relative prices and are simple to evaluate. It shows that the larger index numbers are expected to estimate with less degree of precision. The results are illustrated with price data of Pakistan.     

Method of Moments Estimation in Linear Regression with Errors in both Variables

Recently, in this journal, there has been revised attention on estimating the parameters of the errors in variables, linear structural model. For example, O’Driscoll and Ramirez (2011) used a geometric approach to give insight into the performance of various slope estimators for the linear structural model as introduced by the present author. This article aims to provide a unified method of moments approach for estimating the parameters in the linear structural model, concentrating attention on estimators using the higher moments, which to date has received only little attention in the literature.     

Equivalence of two tests in varying coefficient partially linear errors in variable model with missing responses

This paper considers two tests on varying coefficient partially linear errors-in-variables models (VCPLM-EV) with missing responses under the linear constraint. The restricted estimator for the parametric component is derived and proven to share asymptotically normal distribution. In order to test the linear constraint, two statistics based on the profile Lagrange multiplier method and the corrected residual sum of squares method respectively, are proposed. It is of interest to obtain that the magnitudes of the two statistics are equal exactly and follow the asymptotical chi-square distribution. This reveals a new type of Wilk’s phenomenon in VCPLM-EV models with missing response. Finally, some numerical examples are carried out to illustrate relevant performances.     

Estimation of linear models for field experiments

General mixed linear models for experiments conducted over a series of sltes and/or years are described. The ordinary least squares (OLS) estlmator is simple to compute, but is not the best unbiased estimator. Also, the usuaL formula for the varlance of the OLS estimator is not correct and seriously underestimates the true variance. The best linear unbiased estimator is the generalized least squares (GLS) estimator. However, t requires an inversion of the variance-covariance matrix V, whlch is usually of large dimension. Also, in practice, V is unknown.

We presented an estlmator [Vcirc] of the matrix V using the estimators of variance components [for sites, blocks (sites), etc.]. We also presented a simple transformation of the data, such that an ordinary least squares regression of the transformed data gives the estimated generalized least squares (EGLS) estimator. The standard errors obtained from the transformed regression serve as asymptotic standard errors of the EGLS estimators. We also established that the EGLS estlmator is unbiased.

An example of fitting a linear model to data for 18 sites (environments) located in Brazil is given. One of the site variables (soil test phosphorus) was measured by plot rather than by site and this established the need for a covariance model such as the one used rather than the usual analysis of variance model. It is for this variable that the resulting parameter estimates did not correspond well between the OLS and EGLS estimators. Regression statistics and the analysis of variance for the example are presented and summarized.     

Analysis of least squares regression estimates in case of additional errors in the variables

Estimation of a regression function from independent and identical distributed data is considered. The L₂ error with integration with respect to the design measure is used as error criterion. Upper bounds on the L₂ error of least squares regression estimates are presented, which bound the error of the estimate in case that in the sample given to the estimate the values of the independent and the dependent variables are pertubated by some arbitrary procedure. The bounds are applied to analyze regression-based Monte Carlo methods for pricing American options in case of errors in modelling the price process.     

Minimax A-, c-, and I-optimal regression designs for models with heteroscedastic errors

It is well known that it is difficult to construct minimax optimal designs. Furthermore, since in practice we never know the true error variance, it is important to allow small deviations and construct robust optimal designs. We investigate a class of minimax optimal regression designs for models with heteroscedastic errors that are robust against possible misspecification of the error variance. Commonly used A-, c-, and I-optimality criteria are included in this class of minimax optimal designs. Several theoretical results are obtained, including a necessary condition and a reflection symmetry for these minimax optimal designs. In this article, we focus mainly on linear models and assume that an approximate error variance function is available. However, we also briefly discuss how the methodology works for nonlinear models. We then propose an effective algorithm to solve challenging nonconvex optimization problems to find minimax designs on discrete design spaces. Examples are given to illustrate minimax optimal designs and their properties.     

Smoothing Time Series with Local Polynomial Regression on Time

Time series smoothers estimate the level of a time series at time t as its conditional expectation given present, past and future observations, with the smoothed value depending on the estimated time series model. Alternatively, local polynomial regressions on time can be used to estimate the level, with the implied smoothed value depending on the weight function and the bandwidth in the local linear least squares fit. In this article we compare the two smoothing approaches and describe their similarities. Through simulations, we assess the increase in the mean square error that results when approximating the estimated optimal time series smoother with the local regression estimate of the level.     

The weighted least square based estimators with censoring indicators missing at random

In this paper, we study linear regression analysis when some of the censoring indicators are missing at random. We define regression calibration estimate, imputation estimate and inverse probability weighted estimate for the regression coefficient vector based on the weighted least squared approach due to Stute (1993), and prove all the estimators are asymptotically normal. A simulation study was conducted to evaluate the finite properties of the proposed estimators, and a real data example is provided to illustrate our methods.     

Total least squares and bootstrapping with applications in calibration

The solution to the errors-in-variables problem computed through total least squares is highly nonlinear. Because of this, many statistical procedures for constructing confidence intervals and testing hypotheses cannot be applied. One possible solution to this dilemma is bootstrapping. A nonparametric bootstrap technique could fail. Here, the proper nonparametric bootstrap procedure is provided and its correctness is proved. On the other hand, a residual bootstrap is not valid and suitable in this case. The results are illustrated through a simulation study. An application of this approach to calibration data is presented.     

Multidimensional scaling models with inequality and equality constraints

Recently, a lot of attention has been brought to constrained estimation theory in multidimensional scaling models. So far, only equality constraints have been thoroughly studied. In this paper, the optimization theory is extended to general multidi-mensional scaling models with both inequality and equality constraints. A Newton-Raphson based algorithm is developed to produce the constrained least squares estimate. To illustrate the theory, some classical color data are reanalyzed in the context of the linear Euclidean distance model.     

Mixture models in measurement error problems, with reference to epidemiological studies

Summary. The paper focuses on a Bayesian treatment of measurement error problems and on the question of the specification of the prior distribution of the unknown covariates. It presents a flexible semiparametric model for this distribution based on a mixture of normal distributions with an unknown number of components. Implementation of this prior model as part of a full Bayesian analysis of measurement error problems is described in classical set-ups that are encountered in epidemiological studies: logistic regression between unknown covariates and outcome, with a normal or log-normal error model and a validation group. The feasibility of this combined model is tested and its performance is demonstrated in a simulation study that includes an assessment of the influence of misspecification of the prior distribution of the unknown covariates and a comparison with the semiparametric maximum likelihood method of Roeder, Carroll and Lindsay. Finally, the methodology is illustrated on a data set on coronary heart disease and cholesterol levels in blood.     

Evaluation of Response Surface Designs in Presence of Errors in Factor Levels

Experimenters are often confronted with the problem that errors in setting factor levels cannot be measured. In the robust design scenario, the goal is to determine the design that minimizes the variability transmitted to the response from the variables’ errors. The prediction variance performance of response surface designs with errors is investigated using design efficiency and the maximum and minimum scaled prediction variance. The evaluation and comparison of response surface designs with and without errors in variables are developed for second order designs on spherical regions. The prediction variance and design efficiency results and recommendations for their use are provided.     

Robust estimation in certain heteroscedastic linear models when there are many parameters

We study estimation of regression parameters in heteroscedastic linear models when the number of parameters is large. The results generalize work of Huber (1973), Yohai and Maronna (1979), and Carroll and Rupert (1982a).     

Estimation of the linear-linear segmented regression model in the presence of measurement error

A simple segmented regression model in which the independent variable is measured with error is considered. The method of moments is used to obtain parameter estimates and the joint asymptotic distribution of the estimators is presented. The small sample properties of the inference procedures based on the asymptotic distribution of the estimators are studied numerically.     

Statistical inference in nonstationary markov models with embedded explanatory variables

In this paper, we develop an operational nonstationary Markov process model for use with macro aggregate frequency data. Independent, time-variant factors assumed to affect the process of interest are embedded in the model. Transition probabilities are estimated indirectly from the coefficients on the embedded variables. We previously concluded that either the Marquardt or the simplex, derivative-free nonlinear programming algorithm could be used to estimate such a model. Here, we propose a test for parameter stationarity. By means of designed simulation experiments for the two-state model, we find that our test has acceptable Type I error probabilities, and that power rises with the degree of departure from the null hypothesis. Both validity and power performance can be improved by longer time records of data and a greater number of entities observed.     

The partial least squares-fix point method of estimating interdependent systems with latent variables

This paper describes a method for estimating the unknown parameters of an interdependent simultaneous equations model with latent variables. For each latent variable there may be single or multiple indicators. Estimation proceeds in three stages: first, estimates of the latent variables are constructed from the associated manifest indicators; second, treating the estimates as directly observed, fix-point estimates of the structural form parameters are obtained; third, the location parameters are estimated. The method involves only repeated application of ordinary least squares and no distributional assumptions are needed. The paper concludes with an empirical application of the method.