Asymptotics of improved generalized moment estimators for spatial autoregressive error models

Abstract

This article considers linear models with a spatial autoregressive error structure. Extending Arnold and Wied (2010) Arnold, M., Wied, D. (2010). Improved GMM estimation of the spatial autoregressive error model. Econ. Lett. 108:65–68.[Crossref], [Web of Science ®] , [Google Scholar], who develop an improved generalized method of moment (GMM) estimator for the parameters of the disturbance process to reduce the bias of existing estimation approaches, we establish the asymptotic normality of a new weighted version of this improved estimator and derive the efficient weighting matrix. We also show that this efficiently weighted GMM estimator is feasible as long as the regression matrix of the underlying linear model is non stochastic and illustrate the performance of the new estimator by a Monte Carlo simulation and an application to real data.     

Robustness of the Affine Equivariant Scatter Estimator Based on the Spatial Rank Covariance Matrix

Visuri et al. (2000 Visuri, S., Koivunen, V., Oja, H. (2000). Sign and rank covariance matrices. J. Stat. Plann. Inference 91:557–575.[Crossref], [Web of Science ®] , [Google Scholar]) proposed a technique for robust covariance matrix estimation based on different notions of multivariate sign and rank. Among them, the spatial rank based covariance matrix estimator that utilizes a robust scale estimator is especially appealing due to its high robustness, computational ease, and good efficiency. Also, it is orthogonally equivariant under any distribution and affinely equivariant under elliptically symmetric distributions. In this paper, we study robustness properties of the estimator with respective to two measures: breakdown point and influence function. More specifically, the upper bound of the finite sample breakdown point can be achieved by a proper choice of univariate robust scale estimator. The influence functions for eigenvalues and eigenvectors of the estimator are derived. They are found to be bounded under some assumptions. Moreover, finite sample efficiency comparisons to popular robust MCD, M, and S estimators are reported.     

MULTI-LEVEL FACTORIAL DESIGNS WITH MINIMUM NUMBERS OF LEVEL CHANGES

The order of experimental runs in a fractional factorial experiment is essential when the cost of level changes in factors is considered. The generalized foldover scheme given by [1] Coster, D. C. and Cheng, C. S. 1988. Minimum cost trend free run orders of fractional factorial designs. The Annals of Statistics, 16: 1188–1205. [Crossref], [Web of Science ®] , [Google Scholar]gives an optimal order to experimental runs in an experiment with specified defining contrasts. An experiment can be specified by a design requirement such as resolution or estimation of some interactions. To meet such a requirement, we can find several sets of defining contrasts. Applying the generalized foldover scheme to these sets of defining contrasts, we obtain designs with different numbers of level changes and then the design with minimum number of level changes. The difficulty is to find all the sets of defining contrasts. An alternative approach is investigated by [2] Cheng, C. S., Martin, R. J. and Tang, B. 1998. Two-level factorial designs with extreme numbers of level changes. The Annals of Statistics, 26: 1522–1539. [Crossref], [Web of Science ®] , [Google Scholar]for two-level fractional factorial experiments. In this paper, we investigate experiments with all factors in slevels.     

A Simple Corrected Score for Logistic Regression with Errors-in-Covariates

We develop a simple corrected score for logistic regression with errors-in-covariates. The new method is an extension of the consistent functional methods proposed by Huang and Wang (2001) and is closely related to the corrected score method by Nakamura (1990 Nakamura, T. (1990). Corrected score function for errors-in-variables models: Methodology and application to generalized linear models. Biometrika. 77:127–137.[Crossref], [Web of Science ®] , [Google Scholar]) and Stefanski (1989 Stefanski, L.A. (1989). Unbiased estimation of a nonlinear function a normal mean with application to measurement error models. Commun. Stat. Ser. A - Theory Methods. 18:4335–4358.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The new method requires that the measurement error distribution is known, but does not require normality. The new method yields a consistent and asymptotically normal estimator under regularity conditions. We examine the finite-sample performance of the new estimator through simulation studies. Finally, we illustrate the new method by applying it to an AIDS study.     

More on the two-parameter estimation in the restricted regression

ABSTRACT

In this paper, we introduce a new restricted two-parameter (RTP) estimator for the vector of parameters in a linear model when additional linear restrictions on the parameter vector are assumed to hold. We show that our new biased estimator is superior in the matrix mean square error criterion to the restricted ridge estimator proposed by Groß (2003 Groß, J. (2003). Restricted ridge estimation. Stat. Probab. Lett. 65:57–64.[Crossref], [Web of Science ®] , [Google Scholar]), restricted Liu estimator introduced by Kaçiranlar et al. (1999 Kaçiranlar, S., Sakall?oglus, S., Akdeniz, F., Styan, G.P.H., Werner, H.J. (1999). A new biased estimator in linear regression and a detailed analysis of the widely-analysed dataset on Portland cement. Sankhya Ser. B., Ind. J. Stat. 61:443–459. [Google Scholar]), and RTP estimator introduced by Özkale and Kaçiranlar (2007 Özkale, M., Kaçiranlar, S. (2007). The restricted and unrestricted two-parameter estimators. Commun. Stat. Theory Methods 36:2707–2725.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). A numerical example and a Monte Carlo simulation have been analyzed to illustrate some of the theoretical results.     

An improved estimation in stratified random sampling

ABSTRACT

The article suggests a class of estimators of population mean in stratified random sampling using auxiliary information with its properties. In addition, various known estimators/classes of estimators are identified as members of the suggested class. It has been shown that the suggested class of estimators under optimum condition performs better than the usual unbiased, usual combined ratio, usual combined regression, Kadilar and Cingi (2005 Kadilar, C., Cingi, H. (2005). A new ratio estimator in stratified sampling. Commun. Stat. Theory Methods 34:597–602.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Singh and Vishwakarma (2006 Singh, H.P., Vishwakarma, G.K. (2006). Combined ratio-product estimator of finite population mean in stratified sampling. Metodologia de Encuestas Monografico: Incidencias en el trabjo de Campo 7(1):32–40. [Google Scholar]) estimators and the members belonging to the classes of estimators envisaged by Kadilar and Cingi (2003 Kadilar, C., Cingi, H. (2003). Ratio estimator in stratified sampling. Biomet. J. 45:218–225.[Crossref], [Web of Science ®] , [Google Scholar]), Singh, Tailor et al. (2008 Singh, H.P., Agnihotri, N. (2008). A general procedure of estimating population mean using auxiliary information in sample surveys. Stat. Trans. 9(1):71–87. [Google Scholar]), Singh et al. (2009 Singh, R., Kumar, M., Chaudhary, M.K., Kadilar, C. (2009). Improved exponential estimator in stratified random sampling. Pak. J. Stat. Oper. Res. 5(2):67–82.[Crossref] , [Google Scholar]), Singh and Vishwakarma (2010 Singh, H.P., Vishwakarma, G.K. (2010). A general procedure for estimating the population mean in stratified sampling using auxiliary information. METRON 67(1):47–65.[Crossref] , [Google Scholar]) and Koyuncu and Kadilar (2010) Koyuncu, N., Kadilar, C. (2010). On improvement in estimating population mean in stratified random sampling. J. Appl. Stat. 37(6):999–1013.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar].     

Quantile-based Chernoff distance for truncated random variables

Several probability distributions such as power-Pareto distribution (see Gilchrist 2000 Gilchrist, W. 2000. Statistical modelling with quantile functions. Boca Raton, FL: Chapman and Hall/CRC.[Crossref] , [Google Scholar] and Hankin and Lee 2006 Hankin, R. K. S., and A. Lee. 2006. A new family of non-negative distributions. Australian and New Zealand Journal of Statistics 48:67–78.[Crossref], [Web of Science ®] , [Google Scholar]), various forms of lambda distributions (see Ramberg and Schmeiser 1974 Ramberg, J. S., and B. W. Schmeiser. 1974. An appropriate method for generating asymmetric random variables. Communications of the ACM 17:78–82.[Crossref], [Web of Science ®] , [Google Scholar] and Freimer et al. 1988 Freimer, M., S. Mudholkar, G. Kollia, and C. T. Lin. 1988. A study of the generalized lambda family. Communications in Statistics - Theory and Methods 17:3547–67.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), Govindarajulu distribution (see Nair, Sankaran, and Vineshkumar 2012 Nair, U. N., P. G. Sankaran, and B. Vineshkumar. 2012. The Govindarajulu distribution: some properties and applications. Communications in Statistics—Theory and Methods 41:4391–406.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), etc., do not have manageable distribution functions, though they have tractable quantile functions. Hence, analytical study of the properties of Chernoff distance of two random variables associated with these distributions via traditional distribution function-based tool becomes difficult. To make this simple, in this paper, we introduce quantile-based Chernoff distance for (left or right) truncated random variables and study its various properties. Some useful bounds as well as characterization results are obtained.     

On Augmented Franses Tests for Seasonal Unit Roots

This article extends the results reported in del Barrio Castro, Osborn and Taylor (2012 del Barrio Castro, T., Osborn, D.R., Taylor, A. M.R. (2012). On augmented HEGY tests for seasonal unit roots. Econometric Theor. 18:1121–1143.[Crossref], [Web of Science ®] , [Google Scholar]) to the approach followed by Franses (1991a Franses, P. H. (1991a). Model selection and seasonality in time series. Tibergen Institute Series, 18. [Google Scholar],b Franses, P.H. (1991b). Seasonality, non-stationarity and the forecasting of monthly time series. Int. J. Forecast. 7:199–208.[Crossref], [Web of Science ®] , [Google Scholar]) to test for seasonal unit roots, providing the asymptotic representation to the seasonal unit roots tests proposed by Franses for a general number of seasons S.     

On Fitting Transformation Model to Survey Data

In this article, we consider fitting a semiparametric linear model to survey data with censored observations. The specific goal of the paper is to extend the methods of Cheng et al. (1995 Cheng, S.C., Wei, L.J., Ying, Z. (1995). Analysis of transformation models with censored data. Biometrika 82(4):835–845.[Crossref], [Web of Science ®] , [Google Scholar]) and Chen et al. (2002 Chen, K., Jin, Z. Ying, Z. (2002). Semiparametric analysis of transformation models with censored data. Biometrika 89:659–668.[Crossref], [Web of Science ®] , [Google Scholar]) to the case when the sample has been drawn from a population using a complex sampling design. Similar to the approach of Lin (2000 Lin, D.Y. (2000). On fitting Cox’s proportional hazards models to survey data. Biometrika 87:37–47.[Crossref], [Web of Science ®] , [Google Scholar]), we regard the survey population as a random sample from an infinite universe and accounts for this randomness in the statistical inference. A simulation study is conducted to investigate the performance of the proposed estimators.     

On General Continuous Triangular and Two-sided Power Distributions

In this article, we directly introduce the continuous version of the general discrete triangular distributions (Kokonendji and Zocchi, 2010 Kokonendji, C.C., Zocchi, S.S. (2010). Extensions of discrete triangular distribution and boundary bias in kernel estimation for discrete functions. Statist. Probab. Lett. 80:1655–1662.[Crossref], [Web of Science ®] , [Google Scholar]). It is bounded and, in general, unimodal with pike. It contains thus a very useful class of two-sided power distributions (van Dorp and Kotz, 2002a Van Dorp, J.R., Kotz, S. (2002a). A novel extension of the triangular distribution and its parameter estimation. Statistician 51:1–17. [Google Scholar],b Van Dorp, J.R., Kotz, S. (2002b). The standard two-sided power distribution and its properties; with applications in financial engineering. Amer. Statistician 56:90–99.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar], 2003 Van Dorp, J.R., Kotz, S. (2003). Generalization of two-sided power distributions and their convolution. Commun. Statist. Theor. Meth. 32:1703–1723.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). Moments, particular cases, limit distributions, and relations between parameters are straightforwardly derived.     

Faster Convergence to the Estimation of Quadratic Variation with Microstructure Noise

The continuous quadratic variation of asset return plays a critical role for high-frequency trading. However, the microstructure noise could bias the estimation of the continuous quadratic variation. Zhang et al. (2005 Zhang, L., Mykland, P., Ait-Sahalia, Y. (2005). A tale of two time scales: determining integrated volatility with noisy high-frequency data. J. Amer. Statist. Assoc. 100(472):1394–1411.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) proposed a batch estimator for the continuous quadratic variation of high-frequency data in the presence of microstructure noise. It gives the estimates after all the data arrive. This article proposes a recursive version of their estimator that outputs variation estimates as the data arrive. Our estimator gives excellent estimates well before all the data arrive. Both real high-frequency futures data and simulation data confirm the performance of the recursive estimator.     

COMBINING THE LIU ESTIMATOR AND THE PRINCIPAL COMPONENT REGRESSION ESTIMATOR

In this paper we introduce a class of estimators which includes the ordinary least squares (OLS), the principal components regression (PCR) and the Liu estimator [1] Liu, K. 1993. A new class of biased estimate in linear regression. Communications in Statistics – Theory and Methods, 22(2): 393–402. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]. In particular, we show that our new estimator is superior, in the scalar mean-squared error (mse) sense, to the Liu estimator, to the OLS estimator and to the PCR estimator.     

Regression M-estimators with One Modified Form of Doubly Censored Data

In this article, we consider the M-estimators for the linear regression model when both response and covariate variables are subject to double censoring. The proposed estimators are constructed as some functional of three types of estimators for a bivariate survival distribution. The first two estimators are the generalizations of the Campbell and Földes (1982 Campbell, G. and Földes, A. 1982. “Large sample properties of nonparametric statistical inference”. In Nonparametric Statistical Inference., Edited by: Gnredenko, B. V., Puri, M. L. and Vineze, I. 103–122. Amsterdam: North-Holland.  [Google Scholar]) and Dabrowska (1988 Dabrowska, D. M. 1988. Kaplan-Meier estimate on the plane. Annals of Statistics, 18: 1475–1489. [Crossref], [Web of Science ®] , [Google Scholar]) estimators proposed by Shen (2009 Shen, P. S. 2009. Nonparametric estimation of the bivariate survival function one modified form of doubly censored data. Computational Statistics, 25: 203–313. [Crossref], [Web of Science ®] , [Google Scholar]). The third estimator is the generalization of the Prentice and Cai (1992 Prentice, R. L. and Cai, J. 1992. Covariance and survivor function estimation using censored multivariate failure time data. Biometrika, 79: 495–512. [Crossref], [Web of Science ®] , [Google Scholar]) estimator. The consistency of the proposed M-estimators is established. A simulation study is conducted to investigate the performance of the proposed estimators. Furthermore, the simple bootstrap methods are used to estimate standard deviations and construct interval estimators.     

A NOTE ON ‘A COMPARISON OF BAYES AND MAXIMUM LIKELIHOOD ESTIMATION OF THE INTRACLASS CORRELATION COEFFICIENT’

Palmer and Broemeling [1] Palmer, J. L. and Broemeling, L. D. 1990. A Comparison of Bayes and Maximum Likelihood Estimation of the Intraclass Correlation Coefficient. Comm. Statist.-Theory Meth, 19: 953–975. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar] compare Bayes and maximum likelihood estimates of the intraclass correlation (ICC). The prior information in their derivation of the Bayes estimator is placed on the variance components instead of the ICC itself. This paper finds a Bayes estimator of the ICC with the prior placed on the ICC. Bayes estimates based on three different priors are then compared to method of moments estimate.     

A new lifetime model with different types of failure rate

A new class of lifetime distributions, which can exhibit with upside-down bathtub-shaped, bathtub-shaped, decreasing, and increasing failure rates, is introduced. The new distribution is constructed by compounding generalized Weibull and logarithmic distributions, leading to improvement on the lifetime distribution considered in Dimitrakopoulou et al. (2007 Dimitrakopoulou, T., K. Adamidis, and S. Loukas. 2007. A lifetime distribution with an upside-down bathtub-shaped hazard function. IEEE Transactions on Reliability 56:308–11.[Crossref], [Web of Science ®] , [Google Scholar]) by having no restriction on the shape parameter and extending the result studied by Tahmasbi and Rezaei (2008 Tahmasbi, R., and S. Rezaei. 2008. A two-parameter lifetime distribution with decreasing failure rate. Computational Statistics and Data Analysis 52:3889–901.[Crossref], [Web of Science ®] , [Google Scholar]) in the general form. The proposed model includes the exponential–logarithmic and Weibull–logarithmic distributions as special cases. Various statistical properties of the proposed class are discussed. Furthermore, estimation via the maximum likelihood method and the Fisher information matrix are discussed. Applications to real data demonstrate that the new class of distributions is more flexible than other recently proposed classes.     

An adaptive multivariate CUSUM control chart for signaling a range of location shifts

ABSTRACT

In this work, we proposed an adaptive multivariate cumulative sum (CUSUM) statistical process control chart for signaling a range of location shifts. This method was based on the multivariate CUSUM control chart proposed by Pignatiello and Runger (1990 Pignatiello, J.J., Runger, G.C. (1990). Comparisons of multivariate CUSUM charts. J. Qual. Technol. 22(3):173–186.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]), but we adopted the adaptive approach similar to that discussed by Dai et al. (2011 Dai, Y., Luo, Y., Li, Z., Wang, Z. (2011). A new adaptive CUSUM control chart for detecting the multivariate process mean. Qual. Reliab. Eng. Int. 27(7):877–884.[Crossref], [Web of Science ®] , [Google Scholar]), which was based on a different CUSUM method introduced by Crosier (1988 Crosier, R.B. (1988). Multivariate generalizations of cumulative sum quality-control schemes. Technometrics 30(3):291–303.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]). The reference value in this proposed procedure was changed adaptively in each run, with the current mean shift estimated by exponentially weighted moving average (EWMA) statistic. By specifying the minimal magnitude of the mean shift, our proposed control chart achieved a good overall performance for detecting a range of shifts rather than a single value. We compared our adaptive multivariate CUSUM method with that of Dai et al. (2001 Dai, Y., Luo, Y., Li, Z., Wang, Z. (2011). A new adaptive CUSUM control chart for detecting the multivariate process mean. Qual. Reliab. Eng. Int. 27(7):877–884.[Crossref], [Web of Science ®] , [Google Scholar]) and the non adaptive versions of these two methods, by evaluating both the steady state and zero state average run length (ARL) values. The detection efficiency of our method showed improvements over the comparative methods when the location shift is unknown but falls within an expected range.     

Generalized ratio-cum-product type exponential estimator in stratified random sampling

ABSTRACT

In this article, we propose a generalized ratio-cum-product type exponential estimator for estimating population mean in stratified random sampling. Asymptotic expression of the bias and mean squared error of the proposed estimator are obtained. Asymptotic optimum estimator in the proposed estimator has been obtained with its mean squared error formula. Conditions under which the proposed estimator is more efficient than usual unbiased estimator, combined ratio and product type estimators, Singh et al. (2008 Singh, R., Kumar, M., Singh, R.D., Chaudhary, M.K. (2008). Exponential ratio type estimators in stratified random sampling. Presented in International Symposium on Optimisation and Statistics (I.S.O.S) at A.M.U., Dec. 2008, 29–31, Aligarh, India. [Google Scholar]) estimators and Tailor and Chouhan (2014 Tailor, R., Chouhan, S. (2014). Ratio-cum-product type exponential estimator of finite population mean in stratified random sampling. Commun. Statist. Theor. Meth. 43:343–354.[Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) estimator are obtained. An empirical study has also been carried out.     

A New Estimator of Population Mean in Stratified Sampling

Kadilar and Cingi (2005 Kadilar , C. , Cingi , H. ( 2005 ). A new ratio estimator in stratified sampling . Comm. Statist. Theory Meth. 34 : 1 – 6 . [CSA] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) have suggested a new ratio estimator in stratified sampling. The efficiency of this estimator is compared with the traditional combined ratio estimator on the basis of mean square error (MSE). We propose another estimator by utilizing a simple transformation introduced by Bedi (1996 Bedi , P. K. ( 1996 ). Efficient utilization of auxiliary information at estimation stage . Biomet. J. 38 ( 8 ): 973 – 976 . [CSA] [Crossref], [Web of Science ®] , [Google Scholar]). The proposed estimator is found to be more efficient than the traditional combined ratio estimator as well as the Kadilar and Cingi (2005 Kadilar , C. , Cingi , H. ( 2005 ). A new ratio estimator in stratified sampling . Comm. Statist. Theory Meth. 34 : 1 – 6 . [CSA] [Taylor & Francis Online], [Web of Science ®] , [Google Scholar]) ratio estimator.     

The Exact General Formulas for the Moments of a Ridge Regression Estimator when the Regression Error Terms Follow a Multivariate t Distribution

Huang (1999 Huang , J. C. ( 1999 ). Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach . Econ. Lett. 62 : 261 – 264 .[Crossref], [Web of Science ®] , [Google Scholar]) proposed a feasible ridge regression (FRR) estimator to estimate a specific regression coefficient. Assuming that the error terms follow a normal distribution, Huang (1999 Huang , J. C. ( 1999 ). Improving the estimation precision for a selected parameter in multiple regression analysis: an algebraic approach . Econ. Lett. 62 : 261 – 264 .[Crossref], [Web of Science ®] , [Google Scholar]) examined the small sample properties of the FRR estimator. In this article, assuming that the error terms follow a multivariate t distribution, we derive an exact general formula for the moments of the FRR estimator to estimate a specific regression coefficient. Using the exact general formula, we obtain exact formulas for the bias, mean squared error (MSE), skewness, and kurtosis of the FRR estimator. Since these formulas are very complex, we compare the bias, MSE, skewness, and kurtosis of the FRR estimator with those of ordinary least square (OLS) estimator by numerical evaluations. Our numerical results show that the range of MSE dominance of the FRR estimator over the OLS estimator is widen under a fat tail distributional assumption.     

Some theoretical results concerning non parametric estimation by using a judgment poststratification sample

ABSTRACT

In this paper, some of the properties of non parametric estimation of the expectation of g(X) (any function of X), by using a judgment poststratification sample (JPS), have been discussed. A class of estimators (including the standard JPS estimator and a JPS estimator proposed by Frey and Feeman (2012 Frey, J., Feeman, T.G. (2012). An improved mean estimator for judgment post-stratification. Comput. Stat. Data Anal. 56(2):418–426.[Crossref], [Web of Science ®] , [Google Scholar], Comput. Stat. Data An.) is considered. The paper provides mean and variance of the members of this class, and examines their consistency and asymptotic distribution. Specifically, the results are for the estimation of population mean, population variance, and cumulative distribution function. We show that any estimators of the class may be less efficient than simple random sampling (SRS) estimator for small sample sizes. We prove that the relative efficiency of some estimators in the class with respect to balanced ranked set sampling (BRSS) estimator tends to 1 as the sample size goes to infinity. Furthermore, the standard JPS mean estimator, and Frey–Feeman JPS mean estimator are specifically studied and we show that two estimators have the same asymptotic distribution. For the standard JPS mean estimator, in perfect ranking situations, optimum values of H (the ranking class size), for different sample sizes, are determined non parametrically for populations that are not heavily skewed or thick tailed.