Asymptotics of improved generalized moment estimators for spatial autoregressive error models

Abstract

This article considers linear models with a spatial autoregressive error structure. Extending Arnold and Wied (2010) Arnold, M., Wied, D. (2010). Improved GMM estimation of the spatial autoregressive error model. Econ. Lett. 108:65–68.[Crossref], [Web of Science ®] , [Google Scholar], who develop an improved generalized method of moment (GMM) estimator for the parameters of the disturbance process to reduce the bias of existing estimation approaches, we establish the asymptotic normality of a new weighted version of this improved estimator and derive the efficient weighting matrix. We also show that this efficiently weighted GMM estimator is feasible as long as the regression matrix of the underlying linear model is non stochastic and illustrate the performance of the new estimator by a Monte Carlo simulation and an application to real data.     

Asymptotic properties of nonparametric regression for long memory random fields

The kernel estimator of spatial regression function is investigated for stationary long memory (long range dependent) random fields observed over a finite set of spatial points. A general result on the strong consistency of the kernel density estimator is first obtained for the long memory random fields, and then, under some mild regularity assumptions, the asymptotic behaviors of the regression estimator are established. For the linear long memory random fields, a weak convergence theorem is also obtained for kernel density estimator. Finally, some related issues on the inference of long memory random fields are discussed through a simulation example.     

First-order random coefficient integer-valued autoregressive processes

A first-order random coefficient integer-valued autoregressive (RCINAR(1)) model is introduced. Ergodicity of the process is established. Moments and autocovariance functions are obtained. Conditional least squares and quasi-likelihood estimators of the model parameters are derived and their asymptotic properties are established. The performance of these estimators is compared with the maximum likelihood estimator via simulation.     

Estimation in linear mixed models for longitudinal data under linear restricted conditions

In the paper, we consider a linear mixed model (LMM) for longitudinal data under linear restriction and find the estimators for the parameters of interest. The strong consistency and asymptotic normality of the estimators are obtained under some regularity conditions. Besides, we derive the strong consistent estimator of the fourth moment for the error which is useful for statistical inference for random effects and error variance. Simulations and an example are reported for illustration.     

Simultaneous bootstrap for all three parameters in random coefficient autoregressive models

In this paper we consider autoregressive processes with random coefficients and develop bootstrap approaches that asymptotically work for the distribution of estimated autoregressive parameter as well as for the distribution of estimated variances of the innovation noise and the disturbance noise. We discuss how to obtain approximative residuals of the process and how to separate between the innovation and the disturbance noise in order to be able to extend the classical residual bootstrap for autoregressive processes to the situation considered in this paper. Thereafter, we propose a wild bootstrap procedure as a variation of the residual bootstrap that uses estimated densities of the innovation and the disturbance noise to generate bootstrap replicates of the data generating process. The consistency of the bootstrap approaches is established and their performance is illustrated by a simulation study.     

A stochastic recurrence equations approach for score driven correlation models

We describe stationarity and ergodicity (SE) regions for a recently proposed class of score driven dynamic correlation models. These models have important applications in empirical work. The regions are derived from sufficiency conditions in Bougerol (1993 Bougerol, P. (1993). Kalman filtering with random coefficients and contractions. SIAM Journal on Control and Optimization 31(4):942–959.[Crossref], [Web of Science ®] , [Google Scholar]) and take a nonstandard form. We show that the nonstandard shape of the sufficiency regions cannot be avoided by reparameterizing the model or by rescaling the score steps in the transition equation for the correlation parameter. This makes the result markedly different from the volatility case. Observationally equivalent decompositions of the stochastic recurrence equation yield regions with different shapes and sizes. We use these results to establish the consistency and asymptotic normality of the maximum likelihood estimator. We illustrate our results with an analysis of time-varying correlations between U.K. and Greek equity indices. We find that also in empirical applications different decompositions can give rise to different conclusions regarding the stability of the estimated model.     

Statistical inference for heteroscedastic semi-varying coefficient EV models

This paper proposes an estimation procedure for a class of semi-varying coefficient regression models when the covariates of the linear part are subject to measurement errors. Initial estimates for the regression and varying coefficients are first constructed by the profile least-squares procedure without input from heteroscedasticity, a bias-corrected kernel estimate for the variance function then is proposed, which in turn is used to define re-weighted bias-corrected estimates of the regression and varying coefficients. Large sample properties of the proposed estimates are thoroughly investigated. The finite-sample performance of the proposed estimates is assessed by an extensive simulation study and an application to the Boston housing data set. The simulation results show that the re-weighted bias-corrected estimates outperform the initial estimates and the naive estimates.     

A Further Study on Reliable Life Estimation under Ranked Set Sampling

This article considers nonparametric estimation of reliable life based on ranked set sampling and its properties. It is proven analytically that the large sample efficiency of the reliable life estimator under the balanced ranked set sampling is higher than that under the simple random sampling of the same size, but the relative efficiency damps away as the reliable life moves away from the median on both directions. To improve the efficiency for the estimation of extreme reliable life, we then propose a reliable life estimator under a modified ranked set sampling protocol, its strong consistency and asymptotic normality are established. The proposed sampling is shown to be superior to the balanced ranked set sampling, and the relative advantage improves as the reliable life moves away from median. Finally, results of simulation studies for small sample as well as an application to a real data set are presented to illustrate some of the theoretical findings.     

Parameter estimation for generalized random coefficient autoregressive processes

A generalized random coefficient autoregressive (GRCA) process is introduced in which the random coefficients are permitted to be correlated with the error process. The ordinary random coefficient autoregressive process, the Markovian bilinear model and its generalization, and the random coefficient exponential autoregressive process, among others, are seen to be special cases of the GRCA process. Conditional least squares, and weighted least-squares estimators of the mean of the random coefficient vector are derived and their limit distributions are studied. Estimators of the variance-covariance parameters are also discussed. A simulation study is presented which shows that the weighted least-squares estimator dominates the unweighted least-squares estimator.     

Penalized regression models with autoregressive error terms

Penalized regression methods have recently gained enormous attention in statistics and the field of machine learning due to their ability of reducing the prediction error and identifying important variables at the same time. Numerous studies have been conducted for penalized regression, but most of them are limited to the case when the data are independently observed. In this paper, we study a variable selection problem in penalized regression models with autoregressive (AR) error terms. We consider three estimators, adaptive least absolute shrinkage and selection operator, bridge, and smoothly clipped absolute deviation, and propose a computational algorithm that enables us to select a relevant set of variables and also the order of AR error terms simultaneously. In addition, we provide their asymptotic properties such as consistency, selection consistency, and asymptotic normality. The performances of the three estimators are compared with one another using simulated and real examples.     

Asymptotic behavior of RA-estimates in autoregressive 2D processes

In this work we study the asymptotic behavior of a robust class of estimators of the coefficient of a AR-2D process. We establish the precise conditions for the consistency and asymptotic normality of the RA estimator. The AR-2D model has many applications in image modeling and statistical image processing, therefore the relevance of knowing such properties. The adequacy of the AR-2D model is analyzed with real images; we also show the impact of contamination and the capability of the RA estimator to produce useful results even in the presence of spurious data.     

Monitoring parameter changes for random coefficient autoregressive models

In this paper, we develop a monitoring procedure for an early detection of parameter changes in random coefficient autoregressive models. It is shown that the stopping rule signaling a parameter change satisfies the desired asymptotic property as seen in Lee, Lee, and Na (submitted for publication). Simulation results are provided for illustration.     

Risk efficient estimation of fully dependent random coefficient autoregressive models of general order

We consider a stochastic dynamic model with autoregressive progression. The drift coefficients of the autoregressive model are random where the randomness in the coefficients can have any dependence structure. We propose a two-step sequential estimator and study the asymptotic behavior of few important properties. Paradigm of sequential estimation has its own advantage in reducing sample size and plugging estimates of nuisance parameters while inferring about the main parameters. Our proposed estimator is asymptotically optimal as the predictive risk of the proposed estimator attains the risk of the oracle that assumes known nuisance parameters. Extensive simulation confirms our results.     

Moment Estimation of the Parameters in Rayleigh Distribution with Two Parameters

In this article, the moment estimation of the parameters in two-parameter Rayleigh distribution is studied. For given sample values, the necessary and sufficient conditions on the estimating equations which have unique solution are obtained, and it is also proved that these conditions are satisfied on asymptotic probability 1. Furthermore, the strong consistency and asymptotic normality are obtained. Finally, some simulation experiments are made to show the conclusions.     

Estimating function method for product autoregressive models

The first-order product autoregressive (PAR(1)) model introduced by McKenzie in 1982 McKenzie, E. D. (1982). Product autoregression: A time series characterization of the gamma distribution. Journal of Applied Probability 19:463–468. [Google Scholar] did not attract the attention of practitioners due to the unavailability of a proper estimation method. This article proposes an estimating function (EF) method to fill the gap. In particular, we suggest an optimal combination of linear and quadratic EFs to overcome the problem of parameter identification. The procedure is applied to Weibull and Gamma PAR(1) models. Simulation and data analysis show that the proposed method performs better than the existing methods.     

L 1-estimation for varying coefficient models

The varying coefficient model is a useful extension of linear models and has many advantages in practical use. To estimate the unknown functions in the model, the kernel type with local linear least-squares (L ₂) estimation methods has been proposed by several authors. When the data contain outliers or come from population with heavy-tailed distributions, L ₁-estimation should yield better estimators. In this article, we present the local linear L ₁-estimation method and derive the asymptotic distributions of the L ₁-estimators. The simulation results for two examples, with outliers and heavy-tailed distribution, respectively, show that the L ₁-estimators outperform the L ₂-estimators.     

Estimation in autoregressive models with surrogate data and validation data

Time-series data are often subject to measurement error, usually the result of needing to estimate the variable of interest. Generally, however, the relationship between the surrogate variables and the true variables can be rather complicated compared to the classical additive error structure usually assumed. In this article, we address the estimation of the parameters in autoregressive models in the presence of function measurement errors. We first develop a parameter estimation method with the help of validation data; this estimation method does not depend on functional form and the distribution of the measurement error. The proposed estimator is proved to be consistent. Moreover, the asymptotic representation and the asymptotic normality of the estimator are also derived, respectively. Simulation results indicate that the proposed method works well for practical situation.