On the estimation of serial correlation in Markov-dependent production processes

In this paper, we present a study about the estimation of the serial correlation for Markov chain models which is used often in the quality control of autocorrelated processes. Two estimators, non-parametric and multinomial, for the correlation coefficient are discussed. They are compared with the maximum likelihood estimator [U.N. Bhat and R. Lal, Attribute control charts for Markov dependent production process, IIE Trans. 22 (2) (1990), pp. 181–188.] by using some theoretical facts and the Monte Carlo simulation under several scenarios that consider large and small correlations as well a range of fractions (p) of non-conforming items. The theoretical results show that for any value of p≠0.5 and processes with autocorrelation higher than 0.5, the multinomial is more precise than maximum likelihood. However, the maximum likelihood is better when the autocorrelation is smaller than 0.5. The estimators are similar for p=0.5. Considering the average of all simulated scenarios, the multinomial estimator presented lower mean error values and higher precision, being, therefore, an alternative to estimate the serial correlation. The performance of the non-parametric estimator was reasonable only for correlation higher than 0.5, with some improvement for p=0.5.     

Comparison of the estimators of the intra-cluster correlation for the nested error regression model

The intra-cluster correlation is insisted on nested error regression model that, in practice, is rarely known. This article demonstrates the size in generalized least squares (GLS) F-test using Fuller–Battese transformation and modification F-test. For the balanced case, the former using strictly positive, analysis of covariance (ANCOVA) and analysis of variance (ANOVA) estimators of intra-cluster correlation can control the size for moderate intra-cluster correlations. For small intra-cluster correlation, they perform well when the numbers of cluster are large. The latter using the ANOVA estimator performs well except for small numbers of cluster. When intra-cluster correlation is large, it cannot control the size. For the unbalanced case, the GLS F-test using the Fuller–Battese transformation and the modification F-test using the strictly positive, the ANCOVA and the ANOVA estimators maintain the significance level for small total sample size and small intra-cluster correlations when there is a large variation in cluster sizes, but they perform well in controlling the size for large total sample size and small different variation in cluster sizes. Besides, Henderson’s method 3 estimator maintains the significance level for a few situations.     

A family of power‐divergence diagnostics for goodness‐of‐fit

The author extends to the Bayesian nonparametric context the multinomial goodness‐of‐fit tests due to Cressie & Read (1984). Her approach is suitable when the model of interest is a discrete distribution. She provides an explicit form for the tests, which are based on power‐divergence measures between a prior Dirichlet process that is highly concentrated around the model of interest and the corresponding posterior Dirichlet process. In addition to providing interesting special cases and useful approximations, she discusses calibration and the choice of test through examples.     

On the simple linear regression model with correlated measurement errors

The simple linear regression model with measurement error has been subject to much research. In this work we will focus on this model when the error in the explanatory variable is correlated with the error in the regression equation. Specifically, we are interested in the comparison between the ordinary errors-in-variables estimator of the regression coefficient β$\beta$ and the estimator that takes account of the correlation between the errors. Based on large sample approximations, we compare the estimators and find that the estimator that takes account of the correlation should be preferred in most situations. We also compare the estimators in small sample situations. This is done by stochastic simulation. The results show that the estimators behave quite similarly in most of the simulated situations, but that the ordinary errors-in-variables estimator performs considerably worse than the estimator that takes account of the correlation for certain parameter combinations. In addition, we look briefly into the bias introduced by ignoring correlated errors when computing sample correlations, and in predictions.     

Level-specific correction for nonparametric likelihoods

The popular empirical likelihood method not only has a convenient chi-square limiting distribution but is also Bartlett correctable, leading to a high-order coverage precision of the resulting confidence regions. Meanwhile, it is one of many nonparametric likelihoods in the Cressie–Read power divergence family. The other likelihoods share many attractive properties but are not Bartlett correctable. In this paper, we develop a new technique to achieve the effect of being Bartlett correctable. Our technique is generally applicable to pivotal quantities with chi-square limiting distributions. Numerical experiments and an example reveal that the method is successful for several important nonparametric likelihoods.     

On improvement in estimating the population mean in simple random sampling

Kadilar and Cingi [Ratio estimators in simple random sampling, Appl. Math. Comput. 151 (3) (2004), pp. 893–902] introduced some ratio-type estimators of finite population mean under simple random sampling. Recently, Kadilar and Cingi [New ratio estimators using correlation coefficient, Interstat 4 (2006), pp. 1–11] have suggested another form of ratio-type estimators by modifying the estimator developed by Singh and Tailor [Use of known correlation coefficient in estimating the finite population mean, Stat. Transit. 6 (2003), pp. 655–560]. Kadilar and Cingi [Improvement in estimating the population mean in simple random sampling, Appl. Math. Lett. 19 (1) (2006), pp. 75–79] have suggested yet another class of ratio-type estimators by taking a weighted average of the two known classes of estimators referenced above. In this article, we propose an alternative form of ratio-type estimators which are better than the competing ratio, regression, and other ratio-type estimators considered here. The results are also supported by the analysis of three real data sets that were considered by Kadilar and Cingi.     

A new alternative to the standard F test for clustered data

The data collection process and the inherent population structure are the main causes for clustered data. The observations in a given cluster are correlated, and the magnitude of such correlation is often measured by the intra-cluster correlation coefficient. The intra-cluster correlation can lead to an inflated size of the standard F test in a linear model. In this paper, we propose a solution to this problem. Unlike previous adjustments, our method does not require estimation of the intra-class correlation, which is problematic especially when the number of clusters is small. Our simulation results show that the new method outperforms the existing methods.     

Negative exponential disparity based family of goodness-of-fit tests for multinomial models

This paper investigates a new family of goodness-of-fit tests based on the negative exponential disparities. This family includes the popular Pearson's chi-square as a member and is a subclass of the general class of disparity tests (Basu and Sarkar, 1994) which also contains the family of power divergence statistics. Pitman efficiency and finite sample power comparisons between different members of this new family are made. Three asymptotic approximations of the exact null distributions of the negative exponential disparity famiiy of tests are discussed. Some numerical results on the small sample perfomance of this family of tests are presented for the symmetric null hypothesis. It is shown that the negative exponential disparity famiiy, Like the power divergence family, produces a new goodness-of-fit test statistic that can be a very attractive alternative to the Pearson's chi-square. Some numerical results suggest that, application of this test statistic, as an alternative to Pearson's chi-square, could be preferable to the I ^2/3 statistic of Cressie and Read (1984) under the use of chi-square critical values.     

Decomposable pseudodistances and applications in statistical estimation

The aim of this paper is to introduce new statistical criteria for estimation, suitable for inference in models with common continuous support. This proposal is in the direct line of a renewed interest for divergence based inference tools imbedding the most classical ones, such as maximum likelihood, Chi-square or Kullback–Leibler. General pseudodistances with decomposable structure are considered, they allowing defining minimum pseudodistance estimators, without using nonparametric density estimators. A special class of pseudodistances indexed by α>0$\alpha >0$, leading for α↓0$\alpha \downarrow 0$ to the Kullback–Leibler divergence, is presented in detail. Corresponding estimation criteria are developed and asymptotic properties are studied. The estimation method is then extended to regression models. Finally, some examples based on Monte Carlo simulations are discussed.     

A new kind of stochastic restricted biased estimator for logistic regression model

In the logistic regression model, the variance of the maximum likelihood estimator is inflated and unstable when the multicollinearity exists in the data. There are several methods available in literature to overcome this problem. We propose a new stochastic restricted biased estimator. We study the statistical properties of the proposed estimator and compare its performance with some existing estimators in the sense of scalar mean squared criterion. An example and a simulation study are provided to illustrate the performance of the proposed estimator.KEYWORDS: Logistic regression, maximum likelihood estimator, mean squared error matrix, ridge regression, simulation study, stochastic restricted estimatorMathematics Subject Classifications: Primary 62J05, Secondary 62J07     

On tests of symmetry,marginal homogeneity and quasi-symmetry in two-way contingency tables based on minimum φ-divergence estimator with constraints

The restricted minimum φ-divergence estimator, [Pardo, J.A., Pardo, L. and Zografos, K., 2002, Minimum φ-divergence estimators with constraints in multinomial populations. Journal of Statistical Planning and Inference, 104, 221–237], is employed to obtain estimates of the cell frequencies of an I×I contingency table under hypotheses of symmetry, marginal homogeneity or quasi-symmetry. The associated φ-divergence statistics are distributed asymptotically as chi-squared distributions under the null hypothesis. The new estimators and test statistics contain, as particular cases, the classical estimators and test statistics previously presented in the literature for the cited problems. A simulation study is presented, for the symmetry problem, to choose the best function φ₂ for estimation and the best function φ₁ for testing.     

Divergence based robust estimation of the tail index through an exponential regression model

The extreme value theory is very popular in applied sciences including finance, economics, hydrology and many other disciplines. In univariate extreme value theory, we model the data by a suitable distribution from the general max-domain of attraction characterized by its tail index; there are three broad classes of tails—the Pareto type, the Weibull type and the Gumbel type. The simplest and most common estimator of the tail index is the Hill estimator that works only for Pareto type tails and has a high bias; it is also highly non-robust in presence of outliers with respect to the assumed model. There have been some recent attempts to produce asymptotically unbiased or robust alternative to the Hill estimator; however all the robust alternatives work for any one type of tail. This paper proposes a new general estimator of the tail index that is both robust and has smaller bias under all the three tail types compared to the existing robust estimators. This essentially produces a robust generalization of the estimator proposed by Matthys and Beirlant (Stat Sin 13:853–880, 2003) under the same model approximation through a suitable exponential regression framework using the density power divergence. The robustness properties of the estimator are derived in the paper along with an extensive simulation study. A method for bias correction is also proposed with application to some real data examples.     

Model selection and parameter estimation of a multinomial logistic regression model

In the multinomial regression model, we consider the methodology for simultaneous model selection and parameter estimation by using the shrinkage and LASSO (least absolute shrinkage and selection operation) [R. Tibshirani, Regression shrinkage and selection via the LASSO, J. R. Statist. Soc. Ser. B 58 (1996), pp. 267–288] strategies. The shrinkage estimators (SEs) provide significant improvement over their classical counterparts in the case where some of the predictors may or may not be active for the response of interest. The asymptotic properties of the SEs are developed using the notion of asymptotic distributional risk. We then compare the relative performance of the LASSO estimator with two SEs in terms of simulated relative efficiency. A simulation study shows that the shrinkage and LASSO estimators dominate the full model estimator. Further, both SEs perform better than the LASSO estimators when there are many inactive predictors in the model. A real-life data set is used to illustrate the suggested shrinkage and LASSO estimators.     

Consistency of the likelihood depth estimator for the correlation coefficient

Denecke and Müller (CSDA 55:2724–2738, 2011) presented an estimator for the correlation coefficient based on likelihood depth for Gaussian copula and Denecke and Müller (J Stat Planning Inference 142: 2501–2517, 2012) proved a theorem about the consistency of general estimators based on data depth using uniform convergence of the depth measure. In this article, the uniform convergence of the depth measure for correlation is shown so that consistency of the correlation estimator based on depth can be concluded. The uniform convergence is shown with the help of the extension of the Glivenko-Cantelli Lemma by Vapnik- C? ervonenkis classes.     

New estimators based on order statistics in some families of scale distributions

In this study some new unbiased estimators based on order statistics are proposed for the scale parameter in some family of scale distributions. These new estimators are suitable for the cases of complete (uncensored) and symmetric doubly Type-II censored samples. Further, they can be adapted to Type II right or Type II left censored samples. In addition, unbiased standard deviation estimators of the proposed estimators are also given. Moreover, unlike BLU estimators based on order statistics, expectation and variance-covariance of relevant order statistics are not required in computing these new estimators.

Simulation studies are conducted to compare performances of the new estimators with their counterpart BLU estimators for small sample sizes. The simulation results show that most of the proposed estimators in general perform almost as good as the counterpart BLU estimators; even some of them are better than BLU in some cases. Furthermore, a real data set is used to illustrate the new estimators and the results obtained parallel with those of BLUE methods.     

Weibull Regression for Lifetimes Measured with Error

Models are considered in which true lifetimes are generated by a Weibull regression model and measured lifetimes are determined from the true times by certain measurement error models. Adjusted estimators are obtained under one parametric specification. The bias properties of these estimators and standard estimators are compared both theoretically, using small measurement error asymptotics, and by simulation. The standard estimators of regression coefficients, other than the intercept, are bias-robust. The adjusted estimator of the shape parameter removes the bias of the standard estimator.     

Consistent estimation approach to tackling collinearity and Berkson-type measurement error in linear regression using adjusted Wald-type estimator

This article proposes a consistent estimation approach in linear regression models for the case when the predictor variables are subject to collinearities and Berkson-type measurement errors simultaneously. Our presented procedure does not rely on ridge regression (RR) methods that have been widely addressed in the literature for ill-conditioned problems resulted from multicollinearity. Instead, we review and propose new consistent estimators due to Wald (1940 Wald, A. (1940). Fitting of straight lines if both variables are subject to error. Ann. Math. Stat. 11:284–300.[Crossref] , [Google Scholar]) so that, except finite fourth moments assumptions, no prior knowledge of parametric settings on observations and errors is used, and there is no need to solve estimating equations for coefficient parameters. The performance of the estimation procedure is compared with that of RR-based estimators by using a variety of numerical experiments through Monte Carlo simulation under estimated mean squared error (EMSE) criterion.     

Estimation and influence diagnostics for zero-inflated hyper-Poisson regression model: full Bayesian analysis

The purpose of this paper is to develop a Bayesian analysis for the zero-inflated hyper-Poisson model. Markov chain Monte Carlo methods are used to develop a Bayesian procedure for the model and the Bayes estimators are compared by simulation with the maximum-likelihood estimators. Regression modeling and model selection are also discussed and case deletion influence diagnostics are developed for the joint posterior distribution based on the functional Bregman divergence, which includes ψ-divergence and several others, divergence measures, such as the Itakura–Saito, Kullback–Leibler, and χ² divergence measures. Performance of our approach is illustrated in artificial, real apple cultivation experiment data, related to apple cultivation.